Automatic Camera Tracking

May 31, 2010

This is a project I finished in my sophomore year during 2005 to 2006. I finished the first version of a fully automatic camera tracking software, in the guidance of Dr. Guofeng Zhang, which I named XTrack. It is pretty like a comerical software named Boujou, which is used widely in holywood film making. The core algorithm was developed by Dr Zhang, which is better than Boujou.

In short, camera tracking takes a video sequence as its input, and try to find out the camera parameters of all the frames, which include the intrinsic parameters, the positions and the orientations of the cameras. Since image feature points are required as intermediate clues to solve the cameras, the output of camera tracking also include the 3d positions of the feature points.

Camera tracking is very useful, it is the foundation of video synthesis, 3d reconstruction, and many other interesting special effects in film making, such as bullet time and stereo video. See Dr. Zhang’s homepage for more information.

These are the user interface of the software

And this is a video synthesis example. Dr Zhang made it.

Here is also a live demonstration video.

Filed under: By Language - English,Work Show