In case you didn’t see this write-up about using the Echo Nest Remix API:

http://musicmachinery.com/2009/06/21/wheres-the-pow/

“. . . You use all of the tools that you use in the audio remix, except that the object you are manipulating has a video component as well. This makes it easy to take an audio remix and turn it into a video remix. . . .”