{"id":82,"date":"2025-04-22T14:09:25","date_gmt":"2025-04-22T14:09:25","guid":{"rendered":"https:\/\/michaelmaynord.net\/?p=82"},"modified":"2025-04-22T14:09:26","modified_gmt":"2025-04-22T14:09:26","slug":"context-in-human-action-through-motion-complementarity","status":"publish","type":"post","link":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/","title":{"rendered":"Context in Human Action through Motion Complementarity"},"content":{"rendered":"\n<p>Motivated by Goldman\u2019s Theory of Human Action &#8211; a framework in which action decomposes into 1) base physical movements, and 2) the context in which they occur &#8211; we propose a novel learning formulation for motion and context, where context is derived as the complement to motion.<br>More specifically, we model physical movement through the adoption of Therbligs, a set of elemental physical motions centered around object manipulation. Context is modeled through the use of a contrastive mutual information loss that formulates context information as the action information not contained within movement information. We empirically prove the utility brought by this separation of representation, showing sizable improvements in action recognition and action anticipation accuracies for a variety of models. We present results over two object manipulation datasets: EPIC Kitchens 100, and 50 Salads.<\/p>\n\n\n\n<p>Read more here: <a href=\"https:\/\/openaccess.thecvf.com\/content\/WACV2024\/papers\/Dessalene_Context_in_Human_Action_Through_Motion_Complementarity_WACV_2024_paper.pdf\">https:\/\/openaccess.thecvf.com\/content\/WACV2024\/papers\/Dessalene_Context_in_Human_Action_Through_Motion_Complementarity_WACV_2024_paper.pdf<\/a><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Motivated by Goldman\u2019s Theory of Human Action &#8211; a framework in which action decomposes into 1) base physical movements, and 2) the context in which they occur &#8211; we propose&#8230; <\/p>\n","protected":false},"author":1,"featured_media":83,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-82","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-currentpublications"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Context in Human Action through Motion Complementarity - Michael Maynord<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Context in Human Action through Motion Complementarity - Michael Maynord\" \/>\n<meta property=\"og:description\" content=\"Motivated by Goldman\u2019s Theory of Human Action &#8211; a framework in which action decomposes into 1) base physical movements, and 2) the context in which they occur &#8211; we propose...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/\" \/>\n<meta property=\"og:site_name\" content=\"Michael Maynord\" \/>\n<meta property=\"article:published_time\" content=\"2025-04-22T14:09:25+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-04-22T14:09:26+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Context-in-human.png\" \/>\n\t<meta property=\"og:image:width\" content=\"460\" \/>\n\t<meta property=\"og:image:height\" content=\"476\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/\",\"url\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/\",\"name\":\"Context in Human Action through Motion Complementarity - Michael Maynord\",\"isPartOf\":{\"@id\":\"https:\/\/michaelmaynord.net\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Context-in-human.png\",\"datePublished\":\"2025-04-22T14:09:25+00:00\",\"dateModified\":\"2025-04-22T14:09:26+00:00\",\"author\":{\"@id\":\"https:\/\/michaelmaynord.net\/#\/schema\/person\/4032622d57ec607730c1f229bb9fe96c\"},\"breadcrumb\":{\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/#primaryimage\",\"url\":\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Context-in-human.png\",\"contentUrl\":\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Context-in-human.png\",\"width\":460,\"height\":476,\"caption\":\"Context In Human Action\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/michaelmaynord.net\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Context in Human Action through Motion Complementarity\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/michaelmaynord.net\/#website\",\"url\":\"https:\/\/michaelmaynord.net\/\",\"name\":\"Michael Maynord\",\"description\":\"Research Scientist\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/michaelmaynord.net\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/michaelmaynord.net\/#\/schema\/person\/4032622d57ec607730c1f229bb9fe96c\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/michaelmaynord.net\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2026\/03\/cropped-Transparent-Avatar-96x96.png\",\"contentUrl\":\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2026\/03\/cropped-Transparent-Avatar-96x96.png\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/michaelmaynord.net\"],\"url\":\"https:\/\/michaelmaynord.net\/index.php\/author\/robert_4gn3jyiv\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Context in Human Action through Motion Complementarity - Michael Maynord","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/","og_locale":"en_US","og_type":"article","og_title":"Context in Human Action through Motion Complementarity - Michael Maynord","og_description":"Motivated by Goldman\u2019s Theory of Human Action &#8211; a framework in which action decomposes into 1) base physical movements, and 2) the context in which they occur &#8211; we propose...","og_url":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/","og_site_name":"Michael Maynord","article_published_time":"2025-04-22T14:09:25+00:00","article_modified_time":"2025-04-22T14:09:26+00:00","og_image":[{"width":460,"height":476,"url":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Context-in-human.png","type":"image\/png"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/","url":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/","name":"Context in Human Action through Motion Complementarity - Michael Maynord","isPartOf":{"@id":"https:\/\/michaelmaynord.net\/#website"},"primaryImageOfPage":{"@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/#primaryimage"},"image":{"@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/#primaryimage"},"thumbnailUrl":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Context-in-human.png","datePublished":"2025-04-22T14:09:25+00:00","dateModified":"2025-04-22T14:09:26+00:00","author":{"@id":"https:\/\/michaelmaynord.net\/#\/schema\/person\/4032622d57ec607730c1f229bb9fe96c"},"breadcrumb":{"@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/#primaryimage","url":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Context-in-human.png","contentUrl":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Context-in-human.png","width":460,"height":476,"caption":"Context In Human Action"},{"@type":"BreadcrumbList","@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/22\/context-in-human-action-through-motion-complementarity\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/michaelmaynord.net\/"},{"@type":"ListItem","position":2,"name":"Context in Human Action through Motion Complementarity"}]},{"@type":"WebSite","@id":"https:\/\/michaelmaynord.net\/#website","url":"https:\/\/michaelmaynord.net\/","name":"Michael Maynord","description":"Research Scientist","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/michaelmaynord.net\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/michaelmaynord.net\/#\/schema\/person\/4032622d57ec607730c1f229bb9fe96c","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/michaelmaynord.net\/#\/schema\/person\/image\/","url":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2026\/03\/cropped-Transparent-Avatar-96x96.png","contentUrl":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2026\/03\/cropped-Transparent-Avatar-96x96.png","caption":"admin"},"sameAs":["https:\/\/michaelmaynord.net"],"url":"https:\/\/michaelmaynord.net\/index.php\/author\/robert_4gn3jyiv\/"}]}},"_links":{"self":[{"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/posts\/82","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/comments?post=82"}],"version-history":[{"count":1,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/posts\/82\/revisions"}],"predecessor-version":[{"id":84,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/posts\/82\/revisions\/84"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/media\/83"}],"wp:attachment":[{"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/media?parent=82"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/categories?post=82"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/tags?post=82"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}