Sonic Moves connects sound to movement. It uses 3D body tracking from live video to control dynamic sound compositions, in real-time. It requires no special hardware or sensors and is truly plug and play.

Use Sonic Moves for:

Music and Art: An innovative tool for live music, installations, and experimental composition.

Education: A new way to play and learn music — intuitive, playful, accessible.

Health and Wellbeing: Body-interactive audio motivates activity and supports movement-based practice.

How it works

Using the built-in camera of your iPhone or iPad, Sonic Moves tracks body posture and movement in real-time. It uses this tracking data to interact with audio works which have been arranged specifically for this purpose.

The interactive sound pieces are made in Sonic Moves Creator. It includes a powerful audio engine with tools for sound and music creation. Nearly all parameters are directly connectable to the tracking input in an intuitive interface.

The compositions can be shared by their creators, and played by everyone with Sonic Moves Player. Whether in music, performance, sports or rehabilitation – Creators have full control over the distribution of their works.

Apps

Sonic Moves Player

iPhone & iPad

Sonic Moves Player lets everyone experience body-interactive sound works. It is basically the playback station for all compositions made with Sonic Moves Creator.
It is completely free to download and play.

Easy to use: Select a demo song, press start, move — and the music begins
Direct Expression: musical creativity accessible with no prior knowledge
Video Recorder for creating your own performance videos
Seamlessly connected: import compositions directly from the Creator or via link

Sonic Moves Creator

Mac & iPad

Music creation software meets body tracking – that's Sonic Moves Creator. Arrange sounds, software instruments, effects, filters and more, and connect them to real-time body tracking input. No programming required. You can export and share your creations with players as a single file.

Flat learning curve with a node-based workflow
DAW-like environment combined with a unique body controller interface
Built-in camera body tracking on iPad & Mac
OSC & MIDI out to control other apps
Integrated 3D audio mixer for spatial experiences

Learn more

Showroom

These are direct screen captures from an iPad Air, featuring music by Jakob Gruhl and movements by Tomoko Nakasato.