wave exchange
This is a research project i did in the summer of 2007, exploring ways to convert video data in sound. I used ImageMagick and a self-written C++ application to split a video into it's frames and then for every pixel of a frame i used brightness as amplitude, hue as frequency and the position on the x-axis for the position in the stereo-spectrum (intensity stereophony) to synthesize audio from the video source material.I've tested the process on a short clip featuring footage from Las Vegas (simply because it's colorful and contrasty) and you can take a look at it here:
wave_exchange.mov (53.4MB)
(Please mind that the video is licensed under the CC-by-sa 2.0 license and that the original file can be found here: http://blip.tv/file/12822 - A big thankyou to ViVlog Las Vegas for posting it there!)
ยป ImageMagick