Automatic Camera Tracking

This is a project I finished in my sophomore year during 2005 to 2006. I finished the first version of a fully automatic camera tracking software, in the guidance of Dr. Guofeng Zhang, which I named XTrack. It is pretty like a comerical software named Boujou, which is used widely in holywood film making. The core algorithm was developed by Dr Zhang, which is better than Boujou.

In short, camera tracking takes a video sequence as its input, and try to find out the camera parameters of all the frames, which include the intrinsic parameters, the positions and the orientations of the cameras. Since image feature points are required as intermediate clues to solve the cameras, the output of camera tracking also include the 3d positions of the feature points.

Camera tracking is very useful, it is the foundation of video synthesis, 3d reconstruction, and many other interesting special effects in film making, such as bullet time and stereo video. See Dr. Zhang’s homepage for more information.

These are the user interface of the software

And this is a video synthesis example. Dr Zhang made it.

Here is also a live demonstration video.

1 Comment May 31, 2010

Document Image Rectification and Surface Reconstruction

Automatically modeling the document surface with the application of rectifying it to a flattened view from single input image with uncalibrated camera. This is my first paper accepted by a renowned international conference.

(Research Paper at ICDAR 2009)

Leave a Comment July 26, 2009

Matting Practice

In the guidance of Dr. Guofeng Zhang and Dr. Zilong Dong, I implemented “A Bayesian Approach to Digital Matting” and “Optimized Color Sampling for Robust Matting”.

(a) Source Image	(b) Input Trimap
(c) Result Trimap	(b) Result Matte
(c) Original Image 2	(b) Resulted Matt 2

4 Comments October 2, 2007

3D Tetrix Game

This is a game I developed in the Programming Practice class in my freshman year at Zhejiang University.

Leave a Comment December 26, 2003