Removing Perspective distortion

Started by April 13, 2011

I am working on a project in which i need to create a panorama by taking images from a PTZ camera.
The problem I am facing is when I capture two images at different angles, the overlapping region between the two images have perspective distortion. So to remove it, I thought of bringing both the images in same plane and then compare and stitch them.
To bring the images in same plane I thought of rotating one image through the angle by which the PTZ has moved.
But I am not able to find a transform or algorithm to rotate one of the images around one axis(say Y axis).
So, can anybody please suggest me an algorithm for rotating and is it a correct method of removing perspective distortion.

Also can you please suggest me a book that would help me start 3D image processing.

Akshay Jain.