More
See all Show me
5. Desktop Robot
1 year ago
1. Visualization in 7/4
2 years ago
This is a project I did this semester for a class in Audiovisual Systems, by professor Golan Levin. I used Tristan Jehan and Brian Whitman's Echo Nest API for most of the audio analysis and animated the video in Processing using Toxi's Vec3D library, Kristian Damkjer's OCD camera controls, and the jogl Java bindings for OpenGL.

The movements are timed to segment start times and duration, filtered by a threshold of attack emphasis (the fourth timbre basis function in Echo Nest Analysis). Colors are mapped by the first three timbre basis functions. The twelve glowing lights sources are mapped to the twelve pitches of the chromatic scale (regardless of octave modulation). The whole visualization is wrapped in a sphere with a custom lighting system so that all twelve lights shine on the walls to create ambient lighting.

Much thanks to Robert Hogin for posting his source code to Particle Emitter, which helped me considerably with 3D billboarding, to Golan for his continued support, to the folks at the Echo Nest for their hard work, and to Broken Social Scene for my use of their track.

Credits

63 Likes

  • whitekross 2 years ago
    really nice! this is great
  • Eamae Mirkin 2 years ago
    Hey thanks a lot!
  •  
  • lukasz plus 2 years ago
    looks great... like the way u've mapped the colours.
  • Eamae Mirkin 2 years ago
    Thanks
  •  
  • Jordan Snyder plus 2 years ago
    brilliant
  •  
  • Corrado 2 years ago
    amazing work
    C.
  •  
  • Lee Byron 2 years ago
    This came out really fantastic
  •  
  • blackpawn plus 1 year ago
    cool man
  •  
  • suprb plus 1 year ago
    Yum!
  •  
  • TST-Blade 1 year ago
    Wow realy Great !!!
  •  
  • ilter 11 months ago
    It looks promising. I wonder how acurate it could be and how much modifiable it is. It could be a great tool for some music and audio production related stages.
    If you are interested in cooperation and have time for improvement, don't hesitate to contact me, I'm into audio & music production.
    Take care!
  •  
  • phreakhead 10 months ago
    What song is this?
  •  
  • Ryan Hartsock 9 months ago
    Beautiful, stunning piece.
  •  
  • Brennan L. 8 months ago
    It's like Animusic!

    Namely, this particular piece:

    video.google.com/videoplay?docid=2942922314315974986

    (Shame, it's not vimeo hi-def.)

    Really cool!
  •  
  • Dorian 5 months ago
    i like it!!!.... hope can do what u do soon!! is so inspiring!!!
  •  
  • Satya Meka plus 5 months ago
    Hey Eamae, how did you get that volumetric light in processing? did you use open gl additive blending?
  • Eamae Mirkin 5 months ago
    Good question. The short answer is that it's not actually volumetric. The colored point "lights" are just billboarded textures, with additive blending. Then the whole scene is wrapped in a giant sphere, and lit with point lights in the same positions as the billboards. At the time I was painfully new to open gl, so I chose to write my own lighting engine, rather than figure out how to use gl lighting. Basically, every vertex calculates it's color based on the distance from each light source, additively. This part happens on the processor though, not the graphics card, so it's not as fast.

    If you're interested real (well, virtually real) volumetric lighting, you should check out sunflow render engine:
    hipstersinc.com/p5sunflow/.
  • Satya Meka plus 5 months ago
    Great! I figured it wasn't real volumetric light, but was curious how you pulled it off.
  •  
  • Ryan Berkey 3 months ago
    Love this.
  •  
This conversation is missing your voice. Take five seconds to join Vimeo or log in.

Advertisement

Statistics

  •  
    plays
    likes
    comments
  • Total
    plays 3,393
    likes 63
    comments 19
  • Dec 22nd
    plays 2
    likes 0
    comments 0
  • Dec 21st
    plays 2
    likes 0
    comments 0
  • Dec 20th
    plays 2
    likes 0
    comments 0
  • Dec 19th
    plays 2
    likes 0
    comments 0
  • Dec 18th
    plays 2
    likes 0
    comments 0
  • Dec 17th
    plays 7
    likes 0
    comments 0
  • Dec 16th
    plays 2
    likes 0
    comments 0
  • Dec 15th
    plays 3
    likes 0
    comments 0
Previous Week

Downloads

Please join Vimeo or log in to download the original file. It only takes a few seconds.