Search Spectral Audio Signal Processing
Book Index | Global Index
Would you like to be notified by email when Julius Orion Smith III publishes a new entry into his blog?
Least Squares Sinusoidal Parameter Estimation
There are many ways to define ``optimal'' in signal modeling. Perhaps
the most elementary case is least squares estimation. Every
estimator tries to measure one or more parameters of some underlying
signal model. In the case of sinusoidal parameter estimation,
the simplest model consists of a single complex sinusoidal component
in additive white noise:
 |
(5.9) |
where

is the complex amplitude of the
sinusoid,
and

is white
noise (defined in §
C.3). Given
measurements of

,

, we wish to estimate the
parameters

of this
sinusoid. In the method of
least squares, we minimize the sum of squared errors between the data
and our model. That is, we minimize
 |
(5.10) |
with respect to the parameter vector
where

denotes our signal model:
Note that the error signal

is
linear in

but
nonlinear in the parameter

. More significantly,

is
non-convex with respect to variations in

. Non-
convexity can make an optimization based on
gradient
descent very difficult, while
convex optimization problems can
generally be solved quite efficiently [
21,
84].
Subsections
Previous: Matlab for Computing Minimum Zero-Padding FactorsNext: Sinusoidal Amplitude Estimation
About the Author: Julius Orion Smith III
Julius Smith's background is in electrical engineering (BS Rice 1975, PhD Stanford 1983). He is presently Professor of Music and Associate Professor (by courtesy) of Electrical Engineering at
Stanford's Center for Computer Research in Music and Acoustics (CCRMA), teaching courses and pursuing research related to signal processing applied to music and audio systems. See
http://ccrma.stanford.edu/~jos/ for details.