SUN3D is a large-scale RGB-D video database containing 8 annotated sequences. Each frame contains semantic segmentation of objects in the scene and camera position information. The dataset consists of 415 sequences captured at 254 different locations in 41 different buildings. Some locations were captured multiple times at different times of the day.