This is pretty wild. Try playing the video below and - lo and behold - you can use your mouse to interact with it much in the same way you would interact with a 3d gaming environment.
Apparently this is a demo of Yellowbird's new 3d video technology. It allows you to produce a very immersive registration of a filmed event based on footage obtained by filming with a bunch of cameras simultaneously in different directions.
Very interesting stuff! See their site for more information.