I had noticed that zoom on GSV was a little odd and I just figured it out. It actually zooms to wherever your cursor is! It's really odd when your cursor is to one side of the screen and it looks like you are turning your head while zooming!

Really cool, I wish Matterport was like that!