Markerless Match Moving with 2D Camera Tracking & Compositing
R. Hoetzlein, Media Arts & Technology Program, UCSB
A simple system for 2D match moving was developed. This system requires no markers, using video tracking to determine virtual camera angles. A stationary camera is first used to record real world video with arbitrary pan and zoom. Custom camera tracking software then automatically inserts and follows track points to recreate unstable camera motion. A virtual camera is constructed, which can be used to create stable pans, panoramic mattes, or insert digital objects.

In this example, a 3D model of a mechanical snake is inserted into a slow pan of a tree limb. The tree limb and snake are modeled in 3D Studio MAX. Virtual camera motion was generated from the original video and imported into MAX. A panoramic matte for this scene is shown below.

Tools: C++, 3D Studio MAX, Panasonic DVX-100