Record Details

Hierarchical graphical models for activity recognition in videos

ScholarsArchive at Oregon State University

Field Value
Title Hierarchical graphical models for activity recognition in videos
Names Amer, Mohamed R. (creator)
Todorovic, Sinisa (advisor)
Date Issued 2014-05-19 (iso8601)
Note Graduation date: 2014
Abstract This dissertation addresses the problem of recognizing human activities in videos. Our focus is on activities with stochastic structure, where the activities are characterized by variable space-time arrangements of actions, and conducted by a variable number of actors. These activities occur frequently in sports and surveillance videos. They may appear jointly in multiple instances, at different spatial and temporal scales, under occlusion, and amidst background clutter. These challenges have never been addressed in the literature. Our hypothesis is that these challenges can be successfully addressed using expressive, hierarchical models explicitly encoding activity parts and their spatio-temporal relations.

Our hypothesis is formalized using two novel paradigms. One specifies a new constrained hierarchical model of activities allowing efficient activity recognition. Specifically, we formulate Sum-Product Networks (SPNs) for modeling activities, and develop two new learning algorithms using variational learning. The other paradigm considers a more expressive (unconstrained) hierarchical model, And-Or Graphs (AOGs), requiring cost-efficient algorithms for activity recognition. In particular, we develop a new, Monte Carlo Tree Search based inference of AOGs. Our theoretical and empirical studies advance computer vision through demonstrated advantages of each paradigm, compared to the state-of-the-art.
Genre Thesis/Dissertation
Access Condition http://creativecommons.org/licenses/by/3.0/us/
Topic Activity Recognition
Identifier http://hdl.handle.net/1957/49128

© Western Waters Digital Library - GWLA member projects - Designed by the J. Willard Marriott Library - Hosted by Oregon State University Libraries and Press