Role · Interactive music system: design, prototyping, composition
With · Sia & David OReilly
Platforms · Web · Interactive characters
Problem
SOULS is a collection of 10,000 interactive characters by Sia and David OReilly, each one alive with its own ambient music and responsive to its own emotional states. Ten thousand characters can't each get a composition, so instead of writing 10,000 soundtracks I designed the rules that generated them: a musical language of 21 recorded loops whose combinations, transpositions, and transitions give every character a distinct sonic identity.
Design decision
The vocabulary started in a notebook: 21 chords, all trichords, three notes each, labeled M, m, and Q for major, minor, and quartal. Overlap the right trichords and you get seventh chords, ninth chords, four-note quartal stacks: a vocabulary small enough to record as 21 ambient loops and large enough to reach extended harmony. Those loops, transposed and combined, are the raw material every character draws its identity from.
The notebook page: 21 trichords for SOULS, each labeled M, m, or Q (major, minor, quartal).
Design decision
The harder problem was making the transitions disappear, so a character could wander between harmonies without the listener hearing where one recording ends and another begins. The system grew out of an email thread with David in December 2021 about how to blend looped ambiences: a naive crossfade dips in loudness at the midpoint and announces every transition, so I designed a constant-power blend that keeps the combined energy level, and the ear hears one continuous texture changing color rather than two files trading places.
I sent David the idea as Sharpie sketches, then built it as a series of JavaScript and Web Audio interaction tests, extending the blend from two recordings to a whole family of chords spread along a single continuous control.
The December 2021 sketch I emailed David: a linear crossfade (labeled, in my handwriting, "normal, shitty crossfade") against the "constant power" curves that keep loudness level through the transition.
The cleaned-up version: overlapping volume envelopes for adjacent recordings along a single slider, so one continuous control moves through the whole set.
The six-way version: a whole family of chords spread along one control, each rising as its neighbor falls away.
Working the volume curves out on an index card before writing any code.
Design decision
The order of the chords mattered as much as the recordings. A control that wraps around needs a loop, and six diatonic triads sit on the circle as an open arc: pass the last one and the music jump-cuts back to the first. So I arranged all seven diatonic triads so that every neighboring pair already shares two of its three notes while the third moves by a single scale step, and the seventh chord, the diminished triad everyone else throws away, connects the end of the chain back to the beginning. Every position on the circle is a blend of two close relatives, so the harmony never lurches no matter where the character wanders.
Six chords on the circle leave an open arc: the loop doesn't close.
The diagram I sent David on December 6, 2021: all seven triads around the circle, each line connecting two chords that share two of their three notes. The b° closes the loop so the blend can wrap around with no seam.
Iteration
The first full set of loops didn't survive review. David flagged three chords as "too haunting," and my own verdict on the rest was that they were too bombastic and cinematic for characters meant to be lived with, so I re-recorded the entire set end to end before launch.
Outcome
The collection launched in July 2022, credited "music by Nathan Turczan," and reached #3 on Billboard's monthly ranking of top-selling digital collectibles in music, with coverage in Forbes and Designboom.