Speech representation in Processing II on Vimeo

See all Show me

8 days ago

2 months ago

2 months ago

2 months ago

8. Speech representation in Processing II

3 months ago

4 months ago

4 months ago

4 months ago

4 months ago

4 months ago

4 months ago

5 months ago

Speech representation in Processing. Work in progress for an interactive installation based on para-linguistic elements in a conversation.

Credits

Tags

13 Likes

whitekross 3 months ago

nice, really like it
Kyle McDonald 3 months ago

It looks like... height corresponds to amplitude/volume and the jitteriness corresponds to the fricatives/noisy sounds? At first I thought the silences made the jitter, which gave me an image of words floating off in the wind...
Jori de Goede 3 months ago

You're almost right... Height corresponds to the frequency, the darkness of the lines to amplitude and the jitterness to the noisiness of the words to give the feeling of blowing the lines away.
Kyle McDonald 3 months ago

Wow -- frequency was my initial guess for height, but it was so smooth I ruled that out. What were you using for the pitch detection?
Jori de Goede 3 months ago

I used Max/MSP with a pitch detection external called Fiddle~. I use the OpenSoundControl protocol to send the data to Processing.
Alex Stanciu 2 months ago

That's really really cool. Does it work live? I'd have a blast with this and a microphone :)
Jori de Goede 2 months ago

Yeah it does. It all works in real-time.
vjdrmo 2 months ago

fantastic! i want to see what the final installation looks like

This conversation is missing your voice. Take five seconds to join Vimeo or log in.