All work

Klangraum

A phone-first web app where you drag a map of 19 genres and 190 subgenres under a fixed needle, and Google's Lyria model generates the music live as you move.

Role
Exploratory tool research, interaction & UI design, prototyping, AI-assisted development
Team
Solo
Year
2025–26
Context
Thesis at HfG Schwäbisch Gmünd, then an independent rebuild
Tools
Google Lyria RealTime · Gemini · TypeScript · Lit · Web Audio · Canvas + Web Worker

The map

Genres are countries. An orange needle stays in the middle of the screen; you drag the map under it, and Google’s Lyria model plays whatever lies under the needle, generated live.

Music you steer while you listen, instead of describing it first.

Try it live in your browser, with sound

Klangraum on a phone: the needle deep inside Jazz, the status line reads Jazz 100%, with Blues, Country, Soul and Funk around it

One drag from Jazz across Soul into Funk (2× speed), and deep inside Jazz. Recorded from the app, interface in German.

Google Lyria RealTime · TypeScript · Lit · Web Audio

Eight prototypes

After comparing twelve AI music tools, I built eight approaches, among them text → music, letters → drums, body data → music, a live layer mixer and music as positions in space.

What stayed: the sound never stops, changes morph instead of cutting, and an open space needs landmarks.

Prototype with a text prompt field, duration options of 15, 30 and 60 seconds, and a Generate button
Rule-based prototype turning the text Hochschule fuer Gestaltung Schwaebisch Gmuend into a drum beat, with sliders for BPM, distortion and filters
Auditory Self prototype: a dashboard of daily heart rate, HRV and movement data next to a waveform labelled Calm

Three of the eight, in order.

From ring to map

The thesis version put genres in a ring around a fixed needle; dragging the ring changed the mix by distance. I moved to a map because exploring a landscape fits what the music should feel like: you travel through it, the sound stays at the centre, and how far you go decides how much it changes. In September 2026 I rebuilt it phone-first in five days with an AI coding agent: I wrote the briefs, judged the results and decided what stayed.

Exploring a landscape, not turning a dial: the distance you travel is the change you hear.

Thesis version: genre labels such as Folk, Soul, Rock and Latin arranged in a ring around a circular crosshair
Thesis version, winter 2025/26.

Claude Code · 121 commits

Borders, not distances

Every genre owns a territory. Deep inside you hear 100%, on a border 50/50, where three meet a third each.

The mix can be read off the map.

Klangraum on a phone: the needle sits on the border between Jazz and Soul, the status line reads Jazz 58% · Soul 42%, in the borderland of Jazz and Soul
Close to the border: Jazz 58% · Soul 42%.

The sound trails the finger

The orange needle shows where you are; a white ring shows what you hear. When you drag, the ring follows at limited speed: crossing a border deliberately takes eight seconds.

A fast swipe sounds like a DJ transition, not a skipping record.

Klangraum on a phone inside the Jazz territory: the needle between Jazz and Swing, the status line reads Jazz 63% · Swing 37%
The status line shows what you hear now, and where you're heading.

Neighbours share words

Every genre is described in one grammar: instruments, moods, era, tempo. Neighbours share blocks such as “Rhodes piano” and “warm”, and shared blocks stay active across a border. A script checks that every pair of neighbours shares some.

Crossing a border morphs the music instead of switching it.

One step deeper

Zooming only changes the scale. A double-tap enters a genre, the rest dims, and a back button leads out again.

Entering is a deliberate step, so you never lose your place.

Inside the Jazz territory: subgenres such as Cool Jazz, Swing, Bebop, Fusion and Latin Jazz, with a breadcrumb back to the main map
Inside Jazz: ten subgenres.

Map styles

I tried islands, contour lines, a political map and a halftone grid before colour fields of dots, whose size shows how pure a genre is.

Only the colour fields gave orientation. Rendering runs on a background thread, so dragging stays fluid on a phone.

The zoomed-out map: all 19 genres as colour fields of dots, from Ambient and Classical to Metal and Disco
All 19 genres, zoomed out.

Canvas · Web Worker

Recap

A working phone-first web app and a 73-page thesis (winter 2025/26) on timing and understandable musical interaction. Cutting mattered as much as building: a vector pad and a DJ mode, both fully built, were deleted because, as I noted then, “the map concept works best.” There is no formal user study yet.

What I learned: music and technology are still an open field to explore. As the technology keeps growing, the artist has to stay in the process. I want to push this forward, so that design makes room for the person, not only for the technology.

Keys

1
BMW · CES 2025
2
Klangraum
3
orca
4
Senzu
G
Show the layout grid
?
Open this list
←→↑↓
Move the map, the turn view or a picture once it has focus