Adaptive Music

Accessibility and Adaptive Music: Letting Every Listener Shape the Sound

By the Starchild Music team · October 21, 2026 · 5 min read

A pair of hands resting on a game controller glowing with soft rippling light, beside a mixing board whose sliders are set at different heights

The short answer

Adaptive music can be more accessible when listeners control it: separate volume for music, mono and spatial options, and tactile alternatives such as haptics. Guidelines from the Game Accessibility Guidelines and Xbox call for independent music volume, researchers have designed vibration-based music with Deaf collaborators, and a sound artist has built music meant to be felt through a game controller. The common thread is giving the listener a say, and involving disabled people in the design.

Music is designed for an imagined listener: someone with two working ears, a quiet room and a lot of patience. Real listeners are different. Some have hearing loss that affects certain frequencies. Some are Deaf. Some find several simultaneous sounds hard to separate, or distressing.

Adaptive music, which already assumes the sound can change, is well placed to serve them. The question is whether the listener is allowed to steer.

Start with the simplest control: volume

The Game Accessibility Guidelines recommend providing separate volume controls or mutes for effects, speech and background music. Their reasons are specific. For hearing, they note that loss "can affect certain frequencies more than others, so being able to control volume independently is essential."

For vision, being able to distinguish individual sounds matters when visual cues are harder to detect. For cognition, they say too many sources of information make it hard to focus, and mention auditory processing disorder, a condition in which simultaneous sounds can be "impossible to distinguish or even distressing."

What Xbox asks of developers

Xbox Accessibility Guideline 105 goes further. It asks games to provide adjustable volume and mute for at least these categories independently: music, voice-over, active sound effects, background or ambient effects, narration and voice chat.

The rationale is that background music and effects "add atmosphere but can drown out speech and assistive-tech audio for players with hearing loss or attention-related disabilities." Independent controls let players lower non-essential audio "without losing immersion," and, as the guideline notes, also help players who are easily distracted.

Feeling music: haptics and Deaf co-design

Some of the most interesting work moves music into touch. Sound artist and researcher Jesse Austin-Stewart built Music for PlayStation, which converts compositions into vibrations on the DualSense controller, so that d/Deaf, hard of hearing and hearing audiences can engage on equal terms. Sony Interactive Entertainment's blog says he designed tracks specifically to be felt.

Austin-Stewart told Sony that "agency is critical," and that advocates should stay involved in discussions and decision-making. The project was developed in collaboration with d/Deaf and hard-of-hearing artists.

Academic research points the same way. In Frontiers in Computer Science, Doga Cavdir describes designing wearable and multimodal haptic interfaces with a Deaf co-designer, building "a movement-based sound design practice and audio-tactile compositional vocabulary" and testing it in focus groups. The paper's conclusion is that tactile-based experiences can offer meaningful engagement, and that the participatory process was essential.

Where adaptive design helps

Because adaptive music is built from separate parts, it can offer choices that a flat recording cannot. A game or app could let a listener thin the arrangement, simplify the mix, or turn off the layer they find hard to hear. These are design options, not guarantees, and they work only if someone builds them in.

Xbox's guidelines list related options for audio generally: spatial audio so players can find direction by sound, and a mono downmix for people with single-sided hearing loss. For music, a mono-safe mix is a similar kind of courtesy.

Listener control in songs themselves

The same thinking applies to songs. A singer who cannot reach a high note benefits from changing the key. A runner who wants a gentler pace benefits from changing the tempo. Someone who hears a part of the range poorly may prefer a different arrangement or voice.

Controls like these are why we describe pitch, tempo and vocal controls as a listening tool, not just a production one. On Starchild, songs can be heard free in several production styles and voices, with pitch/key and tempo controls, before anyone licenses.

A short checklist for makers

If you build or release adaptive music, a few questions are worth asking early:

Can the music be turned down or off separately from speech and effects?
Is there a simpler mix for people who find dense arrangements hard to follow?
Does anything important depend only on hearing it, with no visual or tactile cue?
Were d/Deaf, hard-of-hearing, blind or neurodivergent people involved in testing, not just consulted at the end?

Involve people early

Both the Sony project and the Frontiers study stress working with the people they hope to serve. Austin-Stewart collaborated with d/Deaf and hard-of-hearing artists, and Cavdir built her practice with a Deaf co-designer. Neither treated disabled listeners as an afterthought.

This matters because assumptions are often wrong. A designer who has never felt music through vibration will not guess which frequencies or rhythms come through clearly. Those who use the technology know.

For makers of adaptive music, the lesson is to bring in testers at the start, when changes are cheap, rather than at the end, when the system is already built.

Predictability can be a kindness

Adaptive music that changes without warning can be unsettling. For listeners who find sound overwhelming, a sudden shift may be more than an annoyance. The Game Accessibility Guidelines' note about distress from simultaneous sounds is a reminder that comfort is part of access.

Good adaptive design offers ways to slow things down: smoother transitions, a fixed mix, or an option to turn off reactive changes. These choices cost little when planned early.

Giving people control over how much the music changes is a form of respect. It tells the listener that the music is there for them, not the other way around.

None of this needs special equipment to begin. A clear mix, honest controls and a willingness to listen to the people affected will take a project a long way.

Sources

Keep reading

Pitch, tempo and vocal controls, explained Humanistic adaptive music Stems, remix culture and listener control How it works