{"id":58,"date":"2025-04-09T13:42:19","date_gmt":"2025-04-09T13:42:19","guid":{"rendered":"https:\/\/michaelmaynord.net\/?p=58"},"modified":"2025-04-22T13:36:32","modified_gmt":"2025-04-22T13:36:32","slug":"therbligs-in-action-video-understanding-through-motion-primitives","status":"publish","type":"post","link":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/","title":{"rendered":"Therbligs in Action: Video Understanding through Motion Primitives"},"content":{"rendered":"\n<p>Therbligs in Action: Video Understanding through Motion Primitives<br>Eadom Dessalene, Michael Maynord, Cornelia Ferm\u00a8uller, Yiannis Aloimonos<br>University of Maryland, College Park<br>College Park, MD 20742, USA<br>{edessale,maynord,fermulcm,jyaloimo@umd.edu}<br><br>In this paper we introduce a rule-based, compositional,<br>and hierarchical modeling of action using Therbligs as our<br>atoms. Introducing these atoms provides us with a con-<br>sistent, expressive, contact-centered representation of ac-<br>tion. Over the atoms we introduce a differentiable method of<br>rule-based reasoning to regularize for logical consistency.<br>Our approach is complementary to other approaches in that<br>the Therblig-based representations produced by our archi-<br>tecture augment rather than replace existing architectures\u2019<br>representations. We release the first Therblig-centered an-<br>notations over two popular video datasets &#8211; EPIC Kitchens<br>100 and 50-Salads. We also broadly demonstrate bene-<br>fits to adopting Therblig representations through evalua-<br>tion on the following tasks: action segmentation, action<br>anticipation, and action recognition &#8211; observing an aver-<br>age 10.5%\/7.53%\/6.5% relative improvement, respectively,<br>over EPIC Kitchens and an average 8.9%\/6.63%\/4.8% rel-<br>ative improvement, respectively, over 50 Salads. Code and<br>data will be made publicly available.<\/p>\n\n\n\n<p>Read More here: <a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2023\/papers\/Dessalene_Therbligs_in_Action_Video_Understanding_Through_Motion_Primitives_CVPR_2023_paper.pdf\">https:\/\/openaccess.thecvf.com\/content\/CVPR2023\/papers\/Dessalene_Therbligs_in_Action_Video_Understanding_Through_Motion_Primitives_CVPR_2023_paper.pdf<\/a><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Therbligs in Action: Video Understanding through Motion PrimitivesEadom Dessalene, Michael Maynord, Cornelia Ferm\u00a8uller, Yiannis AloimonosUniversity of Maryland, College ParkCollege Park, MD 20742, USA{edessale,maynord,fermulcm,jyaloimo@umd.edu} In this paper we introduce a rule-based,&#8230; <\/p>\n","protected":false},"author":1,"featured_media":59,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-58","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-currentpublications"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Therbligs in Action: Video Understanding through Motion Primitives - Michael Maynord<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Therbligs in Action: Video Understanding through Motion Primitives - Michael Maynord\" \/>\n<meta property=\"og:description\" content=\"Therbligs in Action: Video Understanding through Motion PrimitivesEadom Dessalene, Michael Maynord, Cornelia Ferm\u00a8uller, Yiannis AloimonosUniversity of Maryland, College ParkCollege Park, MD 20742, USA{edessale,maynord,fermulcm,jyaloimo@umd.edu} In this paper we introduce a rule-based,...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/\" \/>\n<meta property=\"og:site_name\" content=\"Michael Maynord\" \/>\n<meta property=\"article:published_time\" content=\"2025-04-09T13:42:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-04-22T13:36:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Therblig-model.png\" \/>\n\t<meta property=\"og:image:width\" content=\"651\" \/>\n\t<meta property=\"og:image:height\" content=\"297\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/\",\"url\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/\",\"name\":\"Therbligs in Action: Video Understanding through Motion Primitives - Michael Maynord\",\"isPartOf\":{\"@id\":\"https:\/\/michaelmaynord.net\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Therblig-model.png\",\"datePublished\":\"2025-04-09T13:42:19+00:00\",\"dateModified\":\"2025-04-22T13:36:32+00:00\",\"author\":{\"@id\":\"https:\/\/michaelmaynord.net\/#\/schema\/person\/4032622d57ec607730c1f229bb9fe96c\"},\"breadcrumb\":{\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/#primaryimage\",\"url\":\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Therblig-model.png\",\"contentUrl\":\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Therblig-model.png\",\"width\":651,\"height\":297,\"caption\":\"Therbigs in Action\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/michaelmaynord.net\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Therbligs in Action: Video Understanding through Motion Primitives\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/michaelmaynord.net\/#website\",\"url\":\"https:\/\/michaelmaynord.net\/\",\"name\":\"Michael Maynord\",\"description\":\"Research Scientist\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/michaelmaynord.net\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/michaelmaynord.net\/#\/schema\/person\/4032622d57ec607730c1f229bb9fe96c\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/michaelmaynord.net\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2026\/03\/cropped-Transparent-Avatar-96x96.png\",\"contentUrl\":\"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2026\/03\/cropped-Transparent-Avatar-96x96.png\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/michaelmaynord.net\"],\"url\":\"https:\/\/michaelmaynord.net\/index.php\/author\/robert_4gn3jyiv\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Therbligs in Action: Video Understanding through Motion Primitives - Michael Maynord","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/","og_locale":"en_US","og_type":"article","og_title":"Therbligs in Action: Video Understanding through Motion Primitives - Michael Maynord","og_description":"Therbligs in Action: Video Understanding through Motion PrimitivesEadom Dessalene, Michael Maynord, Cornelia Ferm\u00a8uller, Yiannis AloimonosUniversity of Maryland, College ParkCollege Park, MD 20742, USA{edessale,maynord,fermulcm,jyaloimo@umd.edu} In this paper we introduce a rule-based,...","og_url":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/","og_site_name":"Michael Maynord","article_published_time":"2025-04-09T13:42:19+00:00","article_modified_time":"2025-04-22T13:36:32+00:00","og_image":[{"width":651,"height":297,"url":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Therblig-model.png","type":"image\/png"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/","url":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/","name":"Therbligs in Action: Video Understanding through Motion Primitives - Michael Maynord","isPartOf":{"@id":"https:\/\/michaelmaynord.net\/#website"},"primaryImageOfPage":{"@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/#primaryimage"},"image":{"@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/#primaryimage"},"thumbnailUrl":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Therblig-model.png","datePublished":"2025-04-09T13:42:19+00:00","dateModified":"2025-04-22T13:36:32+00:00","author":{"@id":"https:\/\/michaelmaynord.net\/#\/schema\/person\/4032622d57ec607730c1f229bb9fe96c"},"breadcrumb":{"@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/#primaryimage","url":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Therblig-model.png","contentUrl":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2025\/04\/Therblig-model.png","width":651,"height":297,"caption":"Therbigs in Action"},{"@type":"BreadcrumbList","@id":"https:\/\/michaelmaynord.net\/index.php\/2025\/04\/09\/therbligs-in-action-video-understanding-through-motion-primitives\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/michaelmaynord.net\/"},{"@type":"ListItem","position":2,"name":"Therbligs in Action: Video Understanding through Motion Primitives"}]},{"@type":"WebSite","@id":"https:\/\/michaelmaynord.net\/#website","url":"https:\/\/michaelmaynord.net\/","name":"Michael Maynord","description":"Research Scientist","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/michaelmaynord.net\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/michaelmaynord.net\/#\/schema\/person\/4032622d57ec607730c1f229bb9fe96c","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/michaelmaynord.net\/#\/schema\/person\/image\/","url":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2026\/03\/cropped-Transparent-Avatar-96x96.png","contentUrl":"https:\/\/michaelmaynord.net\/wp-content\/uploads\/2026\/03\/cropped-Transparent-Avatar-96x96.png","caption":"admin"},"sameAs":["https:\/\/michaelmaynord.net"],"url":"https:\/\/michaelmaynord.net\/index.php\/author\/robert_4gn3jyiv\/"}]}},"_links":{"self":[{"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/posts\/58","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/comments?post=58"}],"version-history":[{"count":2,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/posts\/58\/revisions"}],"predecessor-version":[{"id":61,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/posts\/58\/revisions\/61"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/media\/59"}],"wp:attachment":[{"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/media?parent=58"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/categories?post=58"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/michaelmaynord.net\/index.php\/wp-json\/wp\/v2\/tags?post=58"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}