Scope: This database contains annotations of characters, objects, actions and their interactions during commercial movies. The main unit of annotation was a movie shot, defined as the interval between two cuts (see example below). Movie cuts were defined using a computational algorithm. All other annotations were derived from supervised automatic algorithms and manual labeling.
Dislaimers: The database is provided as is and there is no technical support. All the movie frames and audio are copyrighted and we cannot provide it here.
Description: Database description.
Figure 1: Definition of a "shot" consisting of 65 consecutive frames separated by "cuts" where there is a significant transition between adjacent frames. All labels and annotations are based on shots.
Figure 2: Example annotations for each of 29 characters. The x-axis indicates frame numbers. Each rows indicates the presence or absence of a specific character at specific frames. The color denotes the viewpoint (front, side, back, occluded).
Figure 3: Example of eye tracking data during the movie. Each color denotes a different subject.
Download:
Click here to download notes and format documentation [pdf, 88k]
Click here to download annotations for 40m_act_24_S06E01_30fps [matlab format, 492k]