Analysis, Synthesis, and Perception of Musical Sounds: The Sound of Music (Modern Acoustics and Signal Processing)
This book contains a complete and accurate mathematical treatment of the sounds of music with an emphasis on musical timbre. The book spans the range from tutorial introduction to advanced research and application to speculative assessment of its various techniques. All the contributors use a generalized additive sine wave model for describing musical timbre which gives a conceptual unity, but is of sufficient utility to be adapted to many different tasks.
Why Read This Book
You will learn a unified, mathematically rigorous approach to musical timbre and sound synthesis centered on a generalized additive sine-wave model, with pathways from tutorial introductions to advanced research problems. The book links spectral analysis, statistical and adaptive signal processing, and psychoacoustics so you can both analyze real instruments and build perceptually convincing synthesis systems.
Who Will Benefit
Researchers, graduate students, and experienced audio/DSP engineers who want a deep, model-driven treatment of musical timbre, analysis–synthesis methods, and perceptual evaluation.
Level: Advanced — Prerequisites: Undergraduate-level signals and systems, familiarity with Fourier analysis/FFT, basic linear algebra and probability, and some programming experience (MATLAB/Python or C/C++).
Key Takeaways
- Apply the generalized additive sine-wave model to analyze, resynthesize, and transform musical sounds
- Implement and evaluate spectral analysis methods (FFT, high-resolution peak tracking, time–frequency representations and wavelets) for audio and speech
- Design analysis–synthesis pipelines for instrument modeling and realistic sound synthesis
- Use statistical and adaptive filtering techniques to improve parameter estimation and noise-robust analysis
- Relate physical/signal models to perceptual criteria so you can make synthesis choices that match human hearing
- Adapt musical-sound analysis methods to broader DSP tasks (spectral estimation, channel/noise modeling) used in communications and radar
Topics Covered
- Introduction and overview: musical timbre and the additive modeling paradigm
- Mathematical foundations: Fourier theory, sampling, and time–frequency basics
- Generalized additive sine-wave model: theory and parameterization
- Spectral analysis and peak tracking: FFT, high-resolution methods, and windowing
- Time–frequency representations and wavelets for musical signals
- Statistical signal processing: estimation, model selection, and noise modeling
- Adaptive filtering and recursive parameter estimation for audio signals
- Analysis–synthesis frameworks: sinusoidal resynthesis and phase handling
- Instrument-specific modeling: strings, winds, percussion, and voice
- Perception and psychoacoustics: timbre, pitch, masking, and evaluation methods
- Applications: sound transformation, coding, and transcription
- Evaluation, listening tests, and future directions in musical-sound research
Languages, Platforms & Tools
How It Compares
Covers similar ground to Curtis Roads' The Computer Music Tutorial and Udo Zölzer's Digital Audio Signal Processing, but emphasizes a unified additive-sinusoid model and deeper connections between mathematical analysis and perceptual evaluation.
