The graph based approach is interesting... But I wonder if better and far simpler results might be had by simply using a few iterations of optical flow to perfect the alignment of each frame starting from the alignment of the previous frame?

As a benefit, the transformation could use images after being projected onto a deformable mesh to model the hills etc.