Month: November 2024
-
Evenly cascaded convolutional networks
We introduce Evenly Cascaded convolutional Network (ECN), a neural network taking inspiration from the cascade algorithm of wavelet analysis. ECN employs two feature streams – a low-level and high-level steam....
-
Context in Human Action Through Motion Complementarity
Motivated by Goldman’s Theory of Human Action – a framework in which action decomposes into 1) base physical movements, and 2) the context in which they occur – we propose...
-
Therbligs in Action: Video Understanding Through Motion Primitives
In this paper we introduce a rule-based, compositional, and hierarchical modeling of action using Therbligs as our atoms. Introducing these atoms provides us with a consistent, expressive, contact-centered representation of...
-
Egocentric Object Manipulation Graphs
We introduce Egocentric Object Manipulation Graphs (Ego-OMG) – a novel representation for activity modeling and anticipation of near future actions integrating three components: 1) semantic temporal structure of activities, 2)...
-
Goal-Driven Autonomy for Cognitive Systems
Complex, dynamic environments present special challenges to autonomous agents. Specifically, agents have difficulty when the world does not cooperate with design assumptions. We present an approach to autonomy that seeks...
-
Forecasting Action Through Contact Representations From First Person Video
Human actions involving hand manipulations are structured according to the making and breaking of hand-object contact, and human visual understanding of action is reliant on anticipation of contact as is...