Musical Organization Across Media
The real-time music software Ableton Live provides clip-based sequencing for musical composition, mixing and playback of virtual audio instruments and custom effects. Its connection with the Visual Stage through Ableton Link establishes a shared tempo, quantization, and beat reference, supporting the coordination and synchronicity of sound and image in musical time. Ableton’s scenic clips correspond with the scenes of the Visual Stage to maintain a precise timing relationship between music and image.
This musical organization extends throughout other aspects of the production environment. A visual transition can articulate a musical gesture; a change of lighting can answer an instrumental articulation; movement through virtual space can develop alongside a musical passage. Rhythm, duration, counterpoint, and repetition become ways of composing across media.
Presets, paths, and cues provide prepared structures, while live controls allow the director to respond to performers and developing events in real-time. Precisely organized sequences can coexist alongside improvisation, making the audiovisual stage an instrument playable with the performance ensemble.
Composing the Acoustic World
FLUX:: Immersive’s SPAT Revolution, based on IRCAM’s seminal SPAT software, provides the studio’s compositional environment for designing 3D acoustical spaces inhabited by performers, music, and sounds originating from the Visual Stage, Ableton Live, and the remote performers’ feeds arriving through LiveToAir. Position, distance, movement, and reverberation establish how these sources relate within a shared acoustical space.
The correlated 3D panning system connects this acoustic composition with the visible scene. A performer’s voice or instrument can move with their image, while the virtual camera and listening perspective help organize the relationship between what the audience sees and hears.
SPAT Revolution produces a 16-channel, third-order Ambisonic mix, which is decoded to 5.1.4 for studio monitoring and 7.1.4 for Dolby Atmos broadcasting to home theater systems. A separate stereo binaural mix carries the spatial composition to Web-based audiences listening through headphones and provides a reference return for remote performers and studio headphones.
Acoustics are integral to the dramaturgy of the Telematic Theater. An intimate close-up voice, or its distant resonance, or an ensemble gathered within a common reverberant space can shape the emotional and perceptual character of a scene.