Digital Media Audio Blogs > Audio

Mapping the Future of Music


Visionary architect Buckminster Fuller reportedly liked to jumpstart his creativity by grabbing the magazine at the top right corner of the newsstand rack, no matter what the subject was. I'm trying the same experiment this week by attending O'Reilly's decidedly non-musical Where 2.0 Conference.

Where 2.0 is all about digital map-making. The stars here are the creators of Google Earth (amazing new version released yesterday), Microsoft Virtual Earth, and dozens of start-up companies that build wild new ways to interact with geographic data. Even though all of the presentations have been silent, they've got me thinking about the future of music software.

Windows Live Local Tech Preview

Microsoft demoed a Web app that lets you drive through photographic rendition of San Francisco.

In fact, the word that came up over and over was a musical one: mash-up. It's fascinating to watch as decades of high-resolution mapping data becomes available through the Web for normal people to remix. One of the most impressive demos was the way Google is integrating its recently acquired 3D modeling application, SketchUp, with Google Maps. WIth a few twists and tweaks of the mouse, the demonstrator extruded a 3D box from a 2D map and then tiled a photograph onto it. Within minutes, he had a photorealistic model integrated into the formerly flat map.

Jaws dropped. We were 15 minutes into lunch, and no one left. If visualizing location data is this exciting, I thought, how could we improve music visualization? Traditional notation is like the sketchiest of 2D maps. 3D frequency plots and jukebox visualizers are closer, but too impressionistic to understand viscerally.

In another demo, animated paths traced their way along a flat surface, building a street map before our eyes. The data for the paths, it turned out, came from couriers with location transmitters. I started to wonder what it would look like to map the performance of a piece of music. As you navigate a song, your rate of "travel" changes slightly and so does your pitch (sometimes drastically when you hit the wrong notes). Could common performance mistakes be equivalent to traffic hazard areas?

When you think about it, a lot of art is about mapping — in the sense of transferring the concepts or characteristics of one thing onto another. Those juxtapositions, those mash-ups, create a tension that provokes the observer to resolve the symbols and derive meaning.

Categories





AddThis Social Bookmark Button
Comments (4)
Read More Entries by David Battino.

4 Comments

Nick said:

David,

Thank you for your comment and sorry for late reply.
It is not spam just a hint for those who want to
process music into FFT and visualize signals in real time.
Since software mentioned works with LabView and others signal processing packages it might be helpful for those who needs to see signals.
we invite you (David) and anyone who wants to visualize musical signals to submit data to us.
We are also open to discuss with acoustic signal community
possible ways to explore music data with multidimensional visualization features that ScienceGL software offer.
I wish I could upload some 3D sample shots, but I cannot see this option.
For an idea how 2D FFT signals might be visualized in 3D screen you can have a look at
http://www.sciencegl.com/EEG_3D_spectrum/biofeedback_3D.htm
It is not music but similar to acoustic signals processed into 2D FFT surfaces.


Nick

@Nick: Your comment reads like spam, but I've left it in case readers want to explore your software. Can you share some examples or suggestions about using it to visualize music?

Nick said:

Making 3D music can be easy if one use sophisticated fast 3D engine like this
3D Visualization

Tyler Clark said:

I love the thinking about 3d musical visualization. Lots to exploit there.

Recommended for You

Topics of Interest

Archives


 
 


Or, visit our complete archive.