| Multi-agent event recognition in structured scenarios
+
| Multi-Agent Event Recognition in Structured Scenarios
|-
|-
| June 16
| June 16
Line 89:
Line 89:
+
==Talk Abstracts==
−
==Current seminar series coordinators==
+
====Multi-Agent Event Recognition in Structured Scenarios====
+
Speaker: Vlad Morariu -- Date: June 9, 2011
+
+
I will present a framework for the automatic recognition of complex multi-agent events in settings where structure is imposed by rules that agents must follow while performing activities. Given semantic spatio-temporal descriptions of what generally happens (i.e., rules, event descriptions, physical constraints), and based on video analysis, the framework determines the events that occurred. Knowledge about spatio-temporal structure is encoded using first-order logic using an approach based on Allen's Interval Logic, and robustness to low-level observation uncertainty is provided by Markov Logic Networks (MLN). The main contribution is that the framework integrates interval-based temporal reasoning with probabilistic logical inference, relying on an efficient bottom-up grounding scheme to avoid combinatorial explosion. Applied to one-on-one basketball, the framework detects and tracks players, their hands and feet, and the ball, generates event observations from the resulting trajectories, and performs probabilistic logical inference to determine the most consistent sequence of events.