Adaptive Music
Music That Responds to Visitors: Adaptive Sound in Galleries and Installations
By the Starchild Music team · October 19, 2026 · 5 min read
The short answer
Museum and gallery installations use adaptive music in two main ways: sensors track visitors and turn their movement into sound, or site-specific generative music is designed around the architecture so each visit sounds different. Projects like Music of Encounters at Munich's Pinakothek der Moderne and Brian Eno's audio installation for the Buonconsiglio castle show both approaches, and research from Sweden examines what makes them work for strangers walking in off the street.
In a game, the player holds a controller and knows they are in charge. In a gallery, nobody hands visitors a manual. They walk in, look around, and the music either notices them or it does not.
That makes installations a special test for adaptive music. The design has to work for people who have thirty seconds, no instructions and a friend waiting by the door. Here are three projects that approach the problem differently.
Music of Encounters in Munich
From June 5 to November 9, 2025, the Pinakothek der Moderne in Munich hosted Music of Encounters in its 25-meter-high rotunda. According to Ars Electronica Solutions, which designed the installation, a 3D tracking system captures visitors' movements in real time. Custom software then translates those movements into musical structures based on compositions by the Austrian composer Rupert Huber.
The sound was spread across 28 loudspeakers. The system responds to crowd size as well as individual motion: more visitors produce increasingly complex polyphonic soundscapes.
The page also describes the sonic environment as shifting with the time of day and human presence, and calls the result a "social sculpture, a shared process." The idea is that no one person plays it. The room does.
Eno at the Buonconsiglio: music built around the building
A second approach does not track visitors but is shaped by place. From August 19 to November 13, 2022, Brian Eno's Audio Installation for Buonconsiglio placed generative music works through a thirteenth-century castle in Trento, Italy. The cultural office of Trentino says the pieces were conceived on the basis of the spaces that host them, to "create a dynamic flow of sounds."
They were meant to interact with their surroundings and offer visitors a "unique and unrepeatable synaesthetic listening experience," layered over the museum's existing exhibits. This is adaptation to architecture rather than to bodies, and it connects to the idea in music that knows the room.
What researchers learned from video-controlled installations
Academic work sheds light on the design choices. At the NIME conference in Oslo in 2011, Anders Friberg and Anna Källblad presented three installations: Hoppsa Universum, CLOSE and Flying Carpet. They were choreographed sound and music installations controlled by visitors' movement, using overhead video cameras to register position and motion.
Their paper discusses narrativity, user control and technical limitations as the main considerations. Those three words are a useful checklist for any responsive installation.
Narrativity, control and limits
Narrativity asks what story the music tells over a visit. A piece that reacts to everything at once can feel like noise, so many designers shape a gentle arc, such as building in intensity as a crowd grows.
User control asks how much a visitor can steer. Too little and the music feels like a recording. Too much and it turns into a toy, and the work stops being music.
Technical limits ask what the sensors can actually see. Cameras and trackers have limited resolution, so a good design only promises responses that the technology can deliver reliably. A system that works only half the time teaches visitors to stop trying.
The musical design underneath
Whatever the sensors do, the music has to be composed so that any combination sounds acceptable. This is the same discipline we see in chance-music history: parts that fit with every neighbor, so no path through them goes wrong.
In Music of Encounters, the composer's material is fixed and the visitors choose among its possibilities. Huber is credited with the compositions, and the software translates movement into structures drawn from them. People shape the music; they do not write it.
What this suggests for listeners at home
Not everyone will stand in a rotunda. But the questions raised by installations apply to everyday listening too: does the music respond in a way I can understand, and can I leave it alone if I want to?
A listener hearing a song in different production styles, keys and voices is a quieter version of the same exchange. They act, the music answers, and the result is a performance of one song shaped by one person. For more on that idea, read humanistic adaptive music.
Designing for a stranger
A visitor arriving at an installation does not know the rules, so the response has to be legible fast. If you raise your arm and the sound changes within a moment, you understand. If nothing happens for ten seconds, you assume it is broken.
This is a design problem, not a technical one. The music has to answer in a way that feels connected to what the visitor did, even when the connection is subtle. Quick, clear feedback beats complex mapping.
It also helps when the response is pleasant even if the visitor does nothing. Many installations are built so that a quiet room still sounds like music, and activity adds to it.
The room as a clock
The Munich project suggests another idea. Ars Electronica Solutions describes the rotunda as an architectural instrument and a symbolic clock, with the sonic environment shifting by time of day as well as by human presence.
That means the music has two kinds of input, slow and fast. The slow input is the hour, which sets the mood. The fast input is the crowd, which sets the detail.
Combining slow and fast inputs is a good pattern for any adaptive music. The overall character changes gradually, while moment-to-moment events add small touches on top.
If you visit an installation like these, try standing still for a minute before you move. You will often hear the baseline the composer wrote, and then notice exactly what your presence adds to it.