I have already done the comparison of 2 images of same scene which are taken by one camera with different view angles(say left and right) using SURF in emgu
To figure out camera motion (exact rotation and translation up to a scaling factor) you need
Create a special 3x3 matrix
0 -1 0
W = 1 0 0
0 0 1
that helps to run decomposition:
R = UW-1VT, Tx = ULWUT, where
0 -tx ty
Tx = tz 0 -tx
-ty tx 0