Soundscapes

1
Soundscapes

• James Martin

2
Overview

• Problem Statement
• Proposed Solution
• Solution Created (Modules, Model, Pics)
• Testing
• Looking Back
• See It in Action
• QA

3
Problem Statement

• Create a music visualization program that renders
  the visual display in real time and reacts to the
  music that is playing.

4
Proposed Solution

• Processing - Platform
• Jsyn - Sound
• Jogl 3D Visuals in OpenGL
• L-Systems Data structure for Visuals

5
Solution Created

• Processing Platform
• Three Modules
• Interface
• Sound ESS
• Graphics Uses Spectrum Analysis Data

6
System Model
7
Interface Module

• Simple
• Cultural Clues
• Dragable
• Able to be hidden

8
Sound Module

• Uses ESS Plug-in for Processing
• Load and Play Music
• Spectrum Analysis
• Uses Fast Fourier Transform Algorithm
• Extracts Frequency Data from Waveform

9
Graphics Module

• Draws Images to screen
• Uses Data from Spectrum Analysis
• Look at Code?

10
Pictures
11
Pictures
12
Pictures
13
Pictures
14
Pictures
15
Pictures
16
Pictures
17
Pictures
18
Testing

• Interface Module
• Button Functionality
• Play and Stop work as described
• Dragability
• Dragable
• Stays intact
• Cannot be dragged off screen
• Concealability
• Interface can be hidden with any keystroke
• Interface can be shown with any keystroke
• Interface is not interactive when hidden

19
Testing

• Sound Module
• Song Playback
• Proper song plays
• Song plays to length (lt 251)
• Song plays smooth

20
Testing

• Graphics Module
• Visualizations
• Look as desired
• Play smooth

21
Testing

• System
• Interface Sound
• Buttons and sound playback are linked
• Sound Graphics
• Visualization matches beat
• Graphics and Interface
• Buttons and visualization are linked

22
Looking Back

• Conclusions
• Learn (Positive and Negative)
• Do the Same?
• Do Differently?
• Open Problems
• Extension(s)

23
Prototype

• Behold!