Scrambled Hackz

Very cool software that assembles music or speech from a pre-existent database. Most persuasive is this great video by its inventor.

“1) Scrambled Hackz analyzes the audio portion of a video file to determine the tempo of the incoming audio, and then slices it up into discrete chunks of a quarter note, eighth note, sixteenth note and so on (a process also used by audio editing programs such as Ableton Live and Sony's Acid software).

2) Using a large number of vectors, those slices are classified into a database according to their sonic characteristics.

3) When you send new audio information to the program (using, say, your voice and a microphone), it follows approximately the same process, becoming classified in the database. The software then outputs the pre-analyzed sample that is most similar to that newly cached sample.

4) The result, as you can see in the video, is that König is able to reconfigure a Michael Jackson interview or any number of '80s music videos on the fly, so that they produce a sound similar to whatever he inputs. On screen, the software plays the frames of video that accompany the selected audio.” [Source]

[More on Sven König]