Jesper Bentzen's profile

Audio Perception Tools

Audio Perception Tools
A set of small applications that help enhance the perception of music by providing a personal approach to audio visualization.
Role: Concept, Direction, Design, Production · Client: Personal · Credits: Music: Cliff Martinez
Scope
While working on music videos I have developed a certain technique to memorize music and its finer details. The technique is based on a set of tools I programmed in Processing to help enhance my personal experience of the music. The first version of the tools allows for visualizing perception of space, marks, phases and tempo. The tools consists of recorders and players. First the user records alongside the audio using the mouse. Then the user plays the recorded input with audio for evaluation and study. This method helps memorize the characteristics of the music thus enhancing the perception.

The tools where used in development of Dark and Searchers.
Not available for distribution.
Space Recorder
Moving the mouse in relation to the center controls the size of the perceived space.
Space Player
The perceived space, represented by a 3d object, passes through the playhead, represented by a circle. The user is able to freely rotate, zoom and control the playback of the recording.
Mark Recorder
Pressing space creates a mark on the timeline representing a perceived significant event in the music.
Mark Player
The playhead passes the perceived marks on the timeline in relation to the music.
Tempo Recorder
Moving the mouse vertically controls the intensity of the perceived tempo.
Tempo Player
The playhead passes the perceived tempo on the timeline in relation to the music.
Phase Recorder
Moving the mouse vertically controls the intensity of the selected phase.
Phase Player
The playhead passes the perceived phases on the timeline in relation to the music. In this case blue represents steeldrums, green represents strings, red represents chimes and black represents bass.
Alternative Visualization
While developing the audio perception tools I created a small real-time application showing an object animated completely by the combined recordings of space, marks, tempo and phases. Space factors overall size, marks creates random orientation and opacity jumps, tempo controls rotation and phases controls the spread of the cones.
Sound Object
Audio Perception Tools
Published:

Audio Perception Tools

A set of small applications that help enhance the perception of music by providing a personal approach to audio visualization.

Published: