People, objects, actions and interactions

Database

Scope

Disclaimers

Download

Description

Scope: This database contains annotations of characters, objects, actions and their interactions during commercial movies. The main unit of annotation was a movie shot, defined as the interval between two cuts (see example below). Movie cuts were defined using a computational algorithm. All other annotations were derived from supervised automatic algorithms and manual labeling.

Dislaimers: The database is provided as is and there is no technical support. All the movie frames and audio are copyrighted and we cannot provide it here.

Description: Database description.

cut_definition

Figure 1: Definition of a "shot" consisting of 65 consecutive frames separated by "cuts" where there is a significant transition between adjacent frames. All labels and annotations are based on shots.

annotations_characters

Figure 2: Example annotations for each of 29 characters. The x-axis indicates frame numbers. Each rows indicates the presence or absence of a specific character at specific frames. The color denotes the viewpoint (front, side, back, occluded).

eye_tracking_eg

Figure 3: Example of eye tracking data during the movie. Each color denotes a different subject.
Download:

Click here to download notes and format documentation [pdf, 88k]

Click here to download annotations for 40m_act_24_S06E01_30fps [matlab format, 492k]

 


 
Top