Immersive Sound: The Art and Science of Binaural and Multi-Channel Audio (Audio Engineering Society Presents)
Immersive Sound: The Art and Science of Binaural and Multi-Channel Audio provides a comprehensive guide to multi-channel and binaural sound theory and applications. With contributions from leading recording engineers, researchers, and industry experts, Immersive Sound includes an in-depth description of the physics and psychoacoustics of spatial audio as well as practical applications. Chapters include the history of 3D sound, binaural reproduction through headphones and loudspeakers, stereo, surround sound, height channels, object-based audio, sound field (ambisonics), wave field synthesis, and multi-channel mixing techniques. Knowledge of the development, theory, and practice of spatial and multi-channel sound is essential to those advancing the research and applications in the rapidly evolving fields of 3D sound recording, augmented and virtual reality, gaming, film sound, music production, and post-production.
Why Read This Book
You will get a rare blend of rigorous science and hands-on engineering: Immersive Sound explains the physics and psychoacoustics behind spatial audio while showing real production and research workflows. You will learn practical techniques for binaural rendering, ambisonics, wave‑field synthesis and object‑based mixing from both academic researchers and industry practitioners.
Who Will Benefit
Audio engineers, DSP and systems engineers, VR/AR developers, and researchers who want to design, evaluate, or produce spatial, binaural and multi‑channel audio systems.
Level: Intermediate — Prerequisites: Basic signal processing (Fourier transform, filters), familiarity with audio production tools/DAWs, and introductory acoustics or psychoacoustics concepts.
Key Takeaways
- Understand the physical and perceptual principles that underpin spatial hearing, HRTFs, and localization cues.
- Design and select appropriate reproduction methods (binaural, stereophonic, surround, ambisonics, wave‑field synthesis) for given applications.
- Implement practical binaural and Ambisonics workflows, including HRTF processing, encoding/decoding, and loudspeaker rendering strategies.
- Apply object‑based audio and multi‑channel mixing techniques for immersive formats and VR/AR environments.
- Evaluate and measure spatial audio systems, including objective metrics and perceptual testing methods.
- Compare tradeoffs between reproduction approaches and integrate them into real production pipelines and interactive engines.
Topics Covered
- Introduction and history of 3D and immersive audio
- Fundamentals of acoustics and spatial hearing (psychoacoustics)
- Head‑related transfer functions: measurement, modeling, and personalization
- Binaural reproduction over headphones and loudspeakers
- Stereo and conventional surround techniques
- Ambisonics and Higher‑Order Ambisonics (encoding, decoding, and applications)
- Wave Field Synthesis and large‑array loudspeaker rendering
- Object‑based audio workflows and immersive formats (e.g., Dolby Atmos, MPEG‑H)
- Multi‑channel mixing techniques and production practices
- Signal processing building blocks: spatial filters, panning law, and decoding matrices
- Measurement, calibration, and room/array equalization
- Perceptual evaluation and listening tests for spatial audio
- Applications: VR/AR, gaming, broadcast, and installation sound
- Tools, plugins and production pipelines
- Future trends and research directions in immersive audio
Languages, Platforms & Tools
How It Compares
Compared with Jens Blauert's Spatial Hearing (theory‑heavy psychoacoustics) and Ville Pulkki's Spatial Sound Reproduction (technical ambisonics focus), Immersive Sound is an AES‑edited collection that balances theory with practical production and engineering case studies.
