Free Books    Mathematics of the DFT  

Sinusoids and Exponentials

This chapter provides an introduction to sinusoids, exponentials, complex sinusoids, and various associated terminology, such as exponential decay-time ``$ t_{60}$'', in-phase and quadrature sinusoidal components, analytic signals, positive and negative frequencies, and constructive and destructive interference. The fundamental importance of sinusoids in the analysis of linear time-invariant systems is introduced. We also look at circular motion expressed as the vector sum of in-phase and quadrature sinusoidal motions. Both continuous and discrete-time sinusoids are considered. In particular, a sampled complex sinusoid is generated by successive powers of any complex number $ z$.

Sinusoids

A sinusoid is any function having the following form:

$\displaystyle x(t) = A \sin(\omega t + \phi) $

where $ t$ is the independent (real) variable, and the fixed parameters $ A$, $ \omega$, and $ \phi$ are all real constants. In audio applications we typically have

\begin{eqnarray*} A &=& \mbox{peak amplitude (nonnegative)} \\ \omega &=& \mbox... ...s)}\\ \omega t + \phi &=& \mbox{instantaneous phase (radians).} \end{eqnarray*}

An example is plotted in Fig.4.1.

The term ``peak amplitude'' is often shortened to ``amplitude,'' e.g., ``the amplitude of the tone was measured to be 5 Pascals.'' Strictly speaking, however, the amplitude of a signal $ x$ is its instantaneous value $ x(t)$ at any time $ t$. The peak amplitude $ A$ satisfies $ \left\vert x(t)\right\vert\leq A$. The ``instantaneous magnitude'' or simply ``magnitude'' of a signal $ x(t)$ is given by $ \vert x(t)\vert$, and the peak magnitude is the same thing as the peak amplitude.

The ``phase'' of a sinusoid normally means the ``initial phase'', but in some contexts it might mean ``instantaneous phase'', so be careful. Another term for initial phase is phase offset.

Note that Hz is an abbreviation for Hertz which physically means cycles per second. You might also encounter the notation cps (or ``c.p.s.'') for cycles per second (still in use by physicists and formerly used by engineers as well).

Since the sine function is periodic with period $ 2\pi $, the initial phase $ \phi \pm 2\pi$ is indistinguishable from $ \phi$. As a result, we may restrict the range of $ \phi$ to any length $ 2\pi $ interval. When needed, we will choose

$\displaystyle -\pi \leq \phi < \pi, $

i.e., $ \phi\in[-\pi,\pi)$. You may also encounter the convention $ \phi\in[0,2\pi)$.

Note that the radian frequency $ \omega$ is equal to the time derivative of the instantaneous phase of the sinusoid:

$\displaystyle \frac{d}{dt} (\omega t + \phi) = \omega $

This is also how the instantaneous frequency is defined when the phase is time varying. Let

$\displaystyle \theta(t) \isdef \omega t + \phi(t) $

denote the instantaneous phase of a sinusoid with a time-varying phase-offset $ \phi(t)$. Then the instantaneous frequency is again given by the time derivative of the instantaneous phase:

$\displaystyle \frac{d}{dt} [\omega t + \phi(t)] = \omega + \frac{d}{dt} \phi(t) $

Example Sinusoids

Figure 4.1 plots the sinusoid $ A \sin(2\pi f t + \phi)$, for $ A=10$, $ f=2.5$, $ \phi=\pi/4$, and $ t\in[0,1]$. Study the plot to make sure you understand the effect of changing each parameter (amplitude, frequency, phase), and also note the definitions of ``peak-to-peak amplitude'' and ``zero crossings.''

Figure 4.1: An example sinusoid.
\includegraphics[width=\twidth]{eps/sine}

A ``tuning fork'' vibrates approximately sinusoidally. An ``A-440'' tuning fork oscillates at $ 440$ cycles per second. As a result, a tone recorded from an ideal A-440 tuning fork is a sinusoid at $ f=440$ Hz. The amplitude $ A$ determines how loud it is and depends on how hard we strike the tuning fork. The phase $ \phi$ is set by exactly when we strike the tuning fork (and on our choice of when time 0 is). If we record an A-440 tuning fork on an analog tape recorder, the electrical signal recorded on tape is of the form

$\displaystyle x(t) = A \sin(2\pi 440 t + \phi). $

As another example, the sinusoid at amplitude $ 1$ and phase $ \pi/2$ (90 degrees) is simply

$\displaystyle x(t) = \sin(\omega t + \pi/2) = \cos(\omega t). $

Thus, $ \cos(\omega t)$ is a sinusoid at phase 90-degrees, while $ \sin(\omega t)$ is a sinusoid at zero phase. Note, however, that we could just as well have defined $ \cos(\omega t)$ to be the zero-phase sinusoid rather than $ \sin(\omega t)$. It really doesn't matter, except to be consistent in any given usage. The concept of a ``sinusoidal signal'' is simply that it is equal to a sine or cosine function at some amplitude, frequency, and phase. It does not matter whether we choose $ \sin()$ or $ \cos()$ in the ``official'' definition of a sinusoid. You may encounter both definitions. Using $ \sin()$ is nice since ``sinusoid'' naturally generalizes $ \sin()$. However, using $ \cos()$ is nicer when defining a sinusoid to be the real part of a complex sinusoid (which we'll talk about in §4.3.11).

Why Sinusoids are Important

Sinusoids arise naturally in a variety of ways:

One reason for the importance of sinusoids is that they are fundamental in physics. Many physical systems that resonate or oscillate produce quasi-sinusoidal motion. See simple harmonic motion in any freshman physics text for an introduction to this topic. The canonical example is the mass-spring oscillator.4.1

Another reason sinusoids are important is that they are eigenfunctions of linear systems (which we'll say more about in §4.1.4). This means that they are important in the analysis of filters such as reverberators, equalizers, certain (but not all) ``audio effects'', etc.

Perhaps most importantly, from the point of view of computer music research, is that the human ear is a kind of spectrum analyzer. That is, the cochlea of the inner ear physically splits sound into its (quasi) sinusoidal components. This is accomplished by the basilar membrane in the inner ear: a sound wave injected at the oval window (which is connected via the bones of the middle ear to the ear drum), travels along the basilar membrane inside the coiled cochlea. The membrane starts out thick and stiff, and gradually becomes thinner and more compliant toward its apex (the helicotrema). A stiff membrane has a high resonance frequency while a thin, compliant membrane has a low resonance frequency (assuming comparable mass per unit length, or at least less of a difference in mass than in compliance). Thus, as the sound wave travels, each frequency in the sound resonates at a particular place along the basilar membrane. The highest audible frequencies resonate right at the entrance, while the lowest frequencies travel the farthest and resonate near the helicotrema. The membrane resonance effectively ``shorts out'' the signal energy at the resonant frequency, and it travels no further. Along the basilar membrane there are hair cells which ``feel'' the resonant vibration and transmit an increased firing rate along the auditory nerve to the brain. Thus, the ear is very literally a Fourier analyzer for sound, albeit nonlinear and using ``analysis'' parameters that are difficult to match exactly. Nevertheless, by looking at spectra (which display the amount of each sinusoidal frequency present in a sound), we are looking at a representation much more like what the brain receives when we hear.

In-Phase & Quadrature Sinusoidal Components

From the trig identity $ \sin(A+B)=\sin(A)\cos(B)+\cos(A)\sin(B)$, we have

\begin{eqnarray*} x(t) &\isdef & A \sin(\omega t + \phi) = A \sin(\phi + \omega ... ...omega t) \\ &\isdef & A_1 \cos(\omega t) + A_2 \sin(\omega t). \end{eqnarray*}

From this we may conclude that every sinusoid can be expressed as the sum of a sine function (phase zero) and a cosine function (phase $ \pi/2$). If the sine part is called the ``in-phase'' component, the cosine part can be called the ``phase-quadrature'' component. In general, ``phase quadrature'' means ``90 degrees out of phase,'' i.e., a relative phase shift of $ \pm\pi/2$.

It is also the case that every sum of an in-phase and quadrature component can be expressed as a single sinusoid at some amplitude and phase. The proof is obtained by working the previous derivation backwards.

Figure 4.2 illustrates in-phase and quadrature components overlaid. Note that they only differ by a relative $ 90$ degree phase shift.

Figure 4.2: In-phase and quadrature sinusoidal components.
\includegraphics{eps/quadrature}

Sinusoids at the Same Frequency

An important property of sinusoids at a particular frequency is that they are closed with respect to addition. In other words, if you take a sinusoid, make many copies of it, scale them all by different gains, delay them all by different time intervals, and add them up, you always get a sinusoid at the same original frequency. This is a nontrivial property. It obviously holds for any constant signal $ x(t)=c$ (which we may regard as a sinusoid at frequency $ f=0$), but it is not obvious for $ f\neq 0$ (see Fig.4.2 and think about the sum of the two waveforms shown being precisely a sinusoid).

Since every linear, time-invariant (LTI4.2) system (filter) operates by copying, scaling, delaying, and summing its input signal(s) to create its output signal(s), it follows that when a sinusoid at a particular frequency is input to an LTI system, a sinusoid at that same frequency always appears at the output. Only the amplitude and phase can be changed by the system. We say that sinusoids are eigenfunctions of LTI systems. Conversely, if the system is nonlinear or time-varying, new frequencies are created at the system output.

To prove this important invariance property of sinusoids, we may simply express all scaled and delayed sinusoids in the ``mix'' in terms of their in-phase and quadrature components and then add them up. Here are the details in the case of adding two sinusoids having the same frequency. Let $ x(t)$ be a general sinusoid at frequency $ \omega$:

$\displaystyle x(t) \isdef A\sin(\omega t+\phi) $

Now form $ y(t)$ as the sum of two copies of $ x(t)$ with arbitrary amplitudes and phase offsets:

\begin{eqnarray*} y(t) &\isdef & g_1 x(t-t_1) + g_2 x(t-t_2) \\ &=& g_1 A \sin[\omega (t-t_1) + \phi] + g_2 A \sin[\omega (t-t_2) + \phi] \end{eqnarray*}

Focusing on the first term, we have

\begin{eqnarray*} g_1 A \sin[\omega (t-t_1) + \phi] &=& g_1 A \sin[\omega t + (... ...omega t) \\ &\isdef & A_1 \cos(\omega t) + B_1 \sin(\omega t). \end{eqnarray*}

We similarly compute

$\displaystyle g_2 A \sin[\omega (t-t_2) + \phi] = A_2 \cos(\omega t) + B_2 \sin(\omega t) $

and add to obtain

$\displaystyle y(t) = (A_1+A_2) \cos(\omega t) + (B_1+B_2) \sin(\omega t). $

This result, consisting of one in-phase and one quadrature signal component, can now be converted to a single sinusoid at some amplitude and phase (and frequency $ \omega$), as discussed above.

Constructive and Destructive Interference

Sinusoidal signals are analogous to monochromatic laser light. You might have seen ``speckle'' associated with laser light, caused by destructive interference of multiple reflections of the light beam. In a room, the same thing happens with sinusoidal sound. For example, play a simple sinusoidal tone (e.g., ``A-440''--a sinusoid at frequency $ f=440$ Hz) and walk around the room with one ear plugged. If the room is reverberant you should be able to find places where the sound goes completely away due to destructive interference. In between such places (which we call ``nodes'' in the soundfield), there are ``antinodes'' at which the sound is louder by 6 dB (amplitude doubled--decibels (dB) are reviewed in Appendix F) due to constructive interference. In a diffuse reverberant soundfield,4.3the distance between nodes is on the order of a wavelength (the ``correlation distance'' within the random soundfield).

figure[htbp] \includegraphics{eps/combfilter}

The way reverberation produces nodes and antinodes for sinusoids in a room is illustrated by the simple comb filter, depicted in Fig.4.3.4.4

Since the comb filter is linear and time-invariant, its response to a sinusoid must be sinusoidal (see previous section). The feedforward path has gain $ 1$, and the delayed signal is scaled by $ 0.99$. With the delay set to one period, the sinusoid coming out of the delay line constructively interferes with the sinusoid from the feed-forward path, and the output amplitude is therefore $ 1+0.99=1.99$. In the opposite extreme case, with the delay set to half a period, the unit-amplitude sinusoid coming out of the delay line destructively interferes with the sinusoid from the feed-forward path, and the output amplitude therefore drops to $ \left\vert 1-0.99\right\vert=0.01$.

Consider a fixed delay of $ \tau$ seconds for the delay line in Fig.4.3. Constructive interference happens at all frequencies for which an exact integer number of periods fits in the delay line, i.e., $ f\tau=0,1,2,3,\ldots\,$, or $ f=n/\tau$, for $ n=0,1,2,3,\ldots\,$. On the other hand, destructive interference happens at all frequencies for which there is an odd number of half-periods, i.e., the number of periods in the delay line is an integer plus a half: $ f\tau = 1.5, 2.5, 3.5,$ etc., or, $ f = (n+1/2)/\tau$, for $ n=0,1,2,3,\ldots\,$. It is quick to verify that frequencies of constructive interference alternate with frequencies of destructive interference, and therefore the amplitude response of the comb filter (a plot of gain versus frequency) looks as shown in Fig.4.4.

Figure 4.4: Comb filter amplitude response when delay $ \tau =1$ sec.
\includegraphics[width=4in,height=2.0in]{eps/combfilterFR}

The amplitude response of a comb filter has a ``comb'' like shape, hence the name.4.5 It looks even more like a comb on a dB amplitude scale, as shown in Fig.4.5. A dB scale is more appropriate for audio applications, as discussed in Appendix F. Since the minimum gain is $ 1-0.99=0.01$, the nulls in the response reach down to $ -40$ dB; since the maximum gain is $ 1+0.99 \approx 2$, the maximum in dB is about 6 dB. If the feedforward gain were increased from $ 0.99$ to $ 1$, the nulls would extend, in principle, to minus infinity, corresponding to a gain of zero (complete cancellation). Negating the feedforward path would shift the curve left (or right) by 1/2 Hz, placing a minimum at dc4.6 instead of a peak.

Figure 4.5: Comb filter amplitude response in dB.
\includegraphics[width=4in,height=2.0in]{eps/combfilterFRDB}

Sinusoid Magnitude Spectra

A sinusoid's frequency content may be graphed in the frequency domain as shown in Fig.4.6.

figure[htbp] \includegraphics{eps/sinefd}

An example of a particular sinusoid graphed in Fig.4.6 is given by

$\displaystyle x(t) = \cos(\omega_x t) = \frac{1}{2}e^{j\omega_x t} + \frac{1}{2}e^{-j\omega_x t} $

where

$\displaystyle \omega_x = 2\pi 100. $

That is, this sinusoid has amplitude 1, frequency 100 Hz, and phase zero (or $ \pi/2$, if $ \sin(\omega_x t)$ is defined as the zero-phase case).

Figure 4.6 can be viewed as a graph of the magnitude spectrum of $ x(t)$, or its spectral magnitude representation [44]. Note that the spectrum consists of two components with amplitude $ 1/2$, one at frequency $ 100$ Hz and the other at frequency $ -100$ Hz.

Phase is not shown in Fig.4.6 at all. The phase of the components could be written simply as labels next to the magnitude arrows, or the magnitude arrows can be rotated ``into or out of the page'' by the appropriate phase angle, as illustrated in Fig.4.16.

Exponentials

The canonical form of an exponential function, as typically used in signal processing, is

$\displaystyle a(t) = A e^{-t/\tau}, \quad t\geq 0 $

where $ \tau$ is called the time constant of the exponential. $ A$ is the peak amplitude, as before. The time constant is the time it takes to decay by $ 1/e$, i.e.,

$\displaystyle \frac{a(\tau)}{a(0)} = \frac{1}{e}. $

A normalized exponential decay is depicted in Fig.4.7.

Figure 4.7: The decaying exponential $ Ae^{-t/\tau }$, normalized to unit amplitude ( $ e^{-t/\tau }$).
\includegraphics[width=0.8 \twidth]{eps/exponential}

Why Exponentials are Important

Exponential decay occurs naturally when a quantity is decaying at a rate which is proportional to how much is left. In nature, all linear resonators, such as musical instrument strings and woodwind bores, exhibit exponential decay in their response to a momentary excitation. As another example, reverberant energy in a room decays exponentially after the direct sound stops. Essentially all undriven oscillations decay exponentially (provided they are linear and time-invariant). Undriven means there is no ongoing source of driving energy. Examples of undriven oscillations include the vibrations of a tuning fork, struck or plucked strings, a marimba or xylophone bar, and so on. Examples of driven oscillations include horns, woodwinds, bowed strings, and voice. Driven oscillations must be periodic while undriven oscillations normally are not, except in idealized cases.

Exponential growth occurs when a quantity is increasing at a rate proportional to the current amount. Exponential growth is unstable since nothing can grow exponentially forever without running into some kind of limit. Note that a positive time constant corresponds to exponential decay, while a negative time constant corresponds to exponential growth. In signal processing, we almost always deal exclusively with exponential decay (positive time constants).

Exponential growth and decay are illustrated in Fig.4.8.

Figure 4.8: Growing and decaying exponentials.
\includegraphics[width=0.8\twidth]{eps/decaygrowth}

Audio Decay Time (T60)

In audio, a decay by $ 1/e$ (one time-constant) is not enough to become inaudible, unless the starting amplitude was extremely small. In architectural acoustics (which includes the design of concert halls [4]), a more commonly used measure of decay is ``$ t_{60}$'' (or T60), which is defined as the time to decay by $ 60$ dB.4.7That is, $ t_{60}$ is obtained by solving the equation

$\displaystyle \frac{a(t_{60})}{a(0)} = 10^{-60/20} = 0.001. $

Using the definition of the exponential $ a(t) = A e^{-t/\tau}$, we find

$\displaystyle \zbox {t_{60} = \ln(1000) \tau \approx 6.91 \tau} $

Thus, $ t_{60}$ is about seven time constants. See where $ t_{60}$ is marked on Fig.4.7 compared with $ \tau$.

Complex Sinusoids

Recall Euler's Identity,

$\displaystyle e^{j\theta} = \cos(\theta) + j\sin(\theta). $

Multiplying this equation by $ A \geq 0$ and setting $ \theta = \omega t + \phi$, where $ t$ is time in seconds, $ \omega$ is radian frequency, and $ \phi$ is a phase offset, we obtain what we call the complex sinusoid:

$\displaystyle s(t) \isdef A e^{j(\omega t+\phi)} = A \cos(\omega t+\phi) + jA\sin(\omega t+\phi) $

Thus, a complex sinusoid consists of an ``in-phase'' component for its real part, and a ``phase-quadrature'' component for its imaginary part. Since $ \sin^2(\theta) + \cos^2(\theta) = 1$, we have

$\displaystyle \left\vert s(t)\right\vert \isdef \sqrt{\mbox{re}^2\left\{s(t)\right\} + \mbox{im}^2\left\{s(t)\right\}} \equiv A. $

That is, the complex sinusoid has a constant modulus (i.e., a constant complex magnitude). (The symbol ``$ \equiv$'' means ``identically equal to,'' i.e., for all $ t$.) The instantaneous phase of the complex sinusoid is

$\displaystyle \angle s(t) = \omega t+\phi. $

The derivative of the instantaneous phase of the complex sinusoid gives its instantaneous frequency

$\displaystyle \frac{d}{dt}\angle s(t) = \omega = 2\pi f. $

Circular Motion

Since the modulus of the complex sinusoid is constant, it must lie on a circle in the complex plane. For example,

$\displaystyle x(t) = e^{j\omega t} $

traces out counter-clockwise circular motion along the unit circle in the complex plane as $ t$ increases, while

$\displaystyle \overline{x(t)} = e^{-j\omega t} $

gives clockwise circular motion.

We may call a complex sinusoid $ e^{j\omega t}$ a positive-frequency sinusoid when $ \omega>0$. Similarly, we may define a complex sinusoid of the form $ e^{-j\omega t}$, with $ \omega>0$, to be a negative-frequency sinusoid. Note that a positive- or negative-frequency sinusoid is necessarily complex.

Projection of Circular Motion

Interpreting the real and imaginary parts of the complex sinusoid,

\begin{eqnarray*} \mbox{re}\left\{e^{j\omega t}\right\} &=& \cos(\omega t) \\ \mbox{im}\left\{e^{j\omega t}\right\} &=& \sin(\omega t), \end{eqnarray*}

in the complex plane, we see that sinusoidal motion is the projection of circular motion onto any straight line. Thus, the sinusoidal motion $ \cos(\omega t)$ is the projection of the circular motion $ e^{j\omega t}$ onto the $ x$ (real-part) axis, while $ \sin(\omega t)$ is the projection of $ e^{j\omega t}$ onto the $ y$ (imaginary-part) axis.

Figure 4.9 shows a plot of a complex sinusoid versus time, along with its projections onto coordinate planes. This is a 3D plot showing the $ z$-plane versus time. The axes are the real part, imaginary part, and time. (Or we could have used magnitude and phase versus time.)

Figure 4.9: A complex sinusoid and its projections.
\includegraphics[scale=0.8]{eps/circle}

Note that the left projection (onto the $ z$ plane) is a circle, the lower projection (real-part vs. time) is a cosine, and the upper projection (imaginary-part vs. time) is a sine. A point traversing the plot projects to uniform circular motion in the $ z$ plane, and sinusoidal motion on the two other planes.

Positive and Negative Frequencies

In §2.9, we used Euler's Identity to show

\begin{eqnarray*} \cos(\theta) &= \frac{\displaystyle e^{j \theta} + e^{-j \thet... ...\theta) &= \frac{\displaystyle e^{j \theta} - e^{-j \theta}}{2j} \end{eqnarray*}

Setting $ \theta = \omega t + \phi$, we see that both sine and cosine (and hence all real sinusoids) consist of a sum of equal and opposite circular motion. Phrased differently, every real sinusoid consists of an equal contribution of positive and negative frequency components. This is true of all real signals. When we get to spectrum analysis, we will find that every real signal contains equal amounts of positive and negative frequencies, i.e., if $ X(\omega)$ denotes the spectrum of the real signal $ x(t)$, we will always have $ \vert X(-\omega)\vert = \vert X(\omega)\vert$.

Note that, mathematically, the complex sinusoid $ Ae^{j(\omega t + \phi)}$ is really simpler and more basic than the real sinusoid $ A\sin(\omega t + \phi)$ because $ e^{j\omega t}$ consists of one frequency $ \omega$ while $ \sin(\omega t)$ really consists of two frequencies $ \omega$ and $ -\omega$. We may think of a real sinusoid as being the sum of a positive-frequency and a negative-frequency complex sinusoid, so in that sense real sinusoids are ``twice as complicated'' as complex sinusoids. Complex sinusoids are also nicer because they have a constant modulus. ``Amplitude envelope detectors'' for complex sinusoids are trivial: just compute the square root of the sum of the squares of the real and imaginary parts to obtain the instantaneous peak amplitude at any time. Frequency demodulators are similarly trivial: just differentiate the phase of the complex sinusoid to obtain its instantaneous frequency. It should therefore come as no surprise that signal processing engineers often prefer to convert real sinusoids into complex sinusoids (by filtering out the negative-frequency component) before processing them further.

Plotting Complex Sinusoids versus Frequency

As discussed in the previous section, we regard the signal

$\displaystyle x(t) = A_x e^{j\omega_x t} $

as a positive-frequency sinusoid when $ \omega_x>0$. In a manner analogous to spectral magnitude plots (discussed in §4.1.6), we can plot this complex sinusoid over a frequency axis as a vertical line of length $ A_x$ at the point $ \omega=\omega_x$, as shown in Fig.4.10. Such a plot of amplitude versus frequency may be called a spectral plot, or spectral representation [44] of the (zero-phase) complex sinusoid.

figure[htbp] \includegraphics{eps/csplot} More generally, however, a complex sinusoid has both an amplitude and a phase (or, equivalently, a complex amplitude):

$\displaystyle x(t) = \left(A_x e^{j\theta_x}\right)e^{j\omega_x t} $

To accommodate the phase angle $ \theta_x$ in spectral plots, the plotted vector may be rotated by the angle $ \theta_x$ in the plane orthogonal to the frequency axis passing through $ \omega_x$, as done in Fig.4.16b below (p. [*]) for phase angles $ \theta_x=\pm \pi/2$.

Sinusoidal Amplitude Modulation (AM)

It is instructive to study the modulation of one sinusoid by another. In this section, we will look at sinusoidal Amplitude Modulation (AM). The general AM formula is given by

$\displaystyle x_\alpha(t) = [1+\alpha \cdot a_m(t)]\cdot A_c\sin(\omega_c t + \phi_c), $

where $ (A_c,\omega_c,\phi_c)$ are parameters of the sinusoidal carrier wave, $ \alpha\in[0,1]$ is called the modulation index (or AM index), and $ a_m(t)\in[-1,1]$ is the amplitude modulation signal. In AM radio broadcasts, $ a_m(t)$ is the audio signal being transmitted (usually bandlimited to less than 10 kHz), and $ \omega_c$ is the channel center frequency that one dials up on a radio receiver. The modulated signal $ x_\alpha(t)$ can be written as the sum of the unmodulated carrier wave plus the product of the carrier wave and the modulating wave:

$\displaystyle x_\alpha(t) = x_0(t) + \alpha \cdot a_m(t) \cdot A_c\sin(\omega_c t + \phi_c) \protect$ (4.1)

In the case of sinusoidal AM, we have

$\displaystyle a_m(t) = \sin(\omega_m t + \phi_m). \protect$ (4.2)

Periodic amplitude modulation of this nature is often called the tremolo effect when $ \omega_m<20\pi$ or so ($ <10$ Hz).

Let's analyze the second term of Eq.$ \,$(4.1) for the case of sinusoidal AM with $ \alpha =1$ and $ \phi_m=\phi_c=0$:

$\displaystyle x_m(t) \isdef \sin(\omega_m t)\sin(\omega_c t) \protect$ (4.3)

An example waveform is shown in Fig.4.11 for $ f_c=100$ Hz and $ f_m=10$ Hz. Such a signal may be produced on an analog synthesizer by feeding two differently tuned sinusoids to a ring modulator, which is simply a ``four-quadrant multiplier'' for analog signals.

Figure: Sinusoidal amplitude modulation as in Eq.$ \,$(4.3)--time waveform.
\includegraphics[width=3.5in]{eps/sineamtd}

When $ \omega_m$ is small (say less than $ 20\pi$ radians per second, or 10 Hz), the signal $ x_m(t)$ is heard as a ``beating sine wave'' with $ \omega_m/\pi=2f_m$ beats per second. The beat rate is twice the modulation frequency because both the positive and negative peaks of the modulating sinusoid cause an ``amplitude swell'' in $ x_m(t)$. (One period of modulation--$ 1/f_m$ seconds--is shown in Fig.4.11.) The sign inversion during the negative peaks is not normally audible.

Recall the trigonometric identity for a sum of angles:

$\displaystyle \cos(A+B) = \cos(A)\cos(B) - \sin(A)\sin(B) $

Subtracting this from $ \cos(A-B) = \cos(A)\cos(B) + \sin(A)\sin(B)$ leads to the identity

$\displaystyle \sin(A)\sin(B) = \frac{\cos(A-B) - \cos(A+B)}{2}. $

Setting $ A=\omega_m t$ and $ B=\omega_c t$ gives us an alternate form for our ``ring-modulator output signal'':

$\displaystyle x_m(t) \isdef \sin(\omega_m t)\sin(\omega_c t) = \frac{\cos[(\omega_m-\omega_c)t] - \cos[(\omega_m+\omega_c)t]}{2} \protect$ (4.4)

These two sinusoidal components at the sum and difference frequencies of the modulator and carrier are called side bands of the carrier wave at frequency $ \omega_c$ (since typically $ \omega_c\gg\omega_m>0$).

Equation (4.3) expresses $ x_m(t)$ as a ``beating sinusoid'', while Eq.$ \,$(4.4) expresses as it two unmodulated sinusoids at frequencies $ \omega_c\pm\omega_m$. Which case do we hear?

It turns out we hear $ x_m(t)$ as two separate tones (Eq.$ \,$(4.4)) whenever the side bands are resolved by the ear. As mentioned in §4.1.2, the ear performs a ``short time Fourier analysis'' of incoming sound (the basilar membrane in the cochlea acts as a mechanical filter bank). The resolution of this filterbank--its ability to discern two separate spectral peaks for two sinusoids closely spaced in frequency--is determined by the critical bandwidth of hearing [45,76,87]. A critical bandwidth is roughly 15-20% of the band's center-frequency, over most of the audio range [71]. Thus, the side bands in sinusoidal AM are heard as separate tones when they are both in the audio range and separated by at least one critical bandwidth. When they are well inside the same critical band, ``beating'' is heard. In between these extremes, near separation by a critical-band, the sensation is often described as ``roughness'' [29].

Example AM Spectra

Equation (4.4) can be used to write down the spectral representation of $ x_m(t)$ by inspection, as shown in Fig.4.12. In the example of Fig.4.12, we have $ f_c=100$ Hz and $ f_m=20$ Hz, where, as always, $ \omega=2\pi f$. For comparison, the spectral magnitude of an unmodulated $ 100$ Hz sinusoid is shown in Fig.4.6. Note in Fig.4.12 how each of the two sinusoidal components at $ \pm100$ Hz have been ``split'' into two ``side bands'', one $ 20$ Hz higher and the other $ 20$ Hz lower, that is, $ \pm100\pm20=\{-120,-80,80,120\}$. Note also how the amplitude of the split component is divided equally among its two side bands.

figure[htbp] \includegraphics{eps/sineamfd}

Recall that $ x_m(t)$ was defined as the second term of Eq.$ \,$(4.1). The first term is simply the original unmodulated signal. Therefore, we have effectively been considering AM with a ``very large'' modulation index. In the more general case of Eq.$ \,$(4.1) with $ a_m(t)$ given by Eq.$ \,$(4.2), the magnitude of the spectral representation appears as shown in Fig.4.13.

figure[htbp] \includegraphics{eps/sineamgfd}

Sinusoidal Frequency Modulation (FM)

Frequency Modulation (FM) is well known as the broadcast signal format for FM radio. It is also the basis of the first commercially successful method for digital sound synthesis. Invented by John Chowning [14], it was the method used in the the highly successful Yamaha DX-7 synthesizer, and later the Yamaha OPL chip series, which was used in all ``SoundBlaster compatible'' multimedia sound cards for many years. At the time of this writing, descendants of the OPL chips remain the dominant synthesis technology for ``ring tones'' in cellular telephones.

A general formula for frequency modulation of one sinusoid by another can be written as

$\displaystyle x(t) = A_c\cos[\omega_c t + \phi_c + A_m\sin(\omega_m t + \phi_m)], \protect$ (4.5)

where the parameters $ (A_c,\omega_c,\phi_c)$ describe the carrier sinusoid, while the parameters $ (A_m,\omega_m,\phi_m)$ specify the modulator sinusoid. Note that, strictly speaking, it is not the frequency of the carrier that is modulated sinusoidally, but rather the instantaneous phase of the carrier. Therefore, phase modulation would be a better term (which is in fact used). Potential confusion aside, any modulation of phase implies a modulation of frequency, and vice versa, since the instantaneous frequency is always defined as the time-derivative of the instantaneous phase. In this book, only phase modulation will be considered, and we will call it FM, following common practice.4.8

Figure 4.14 shows a unit generator patch diagram [42] for brass-like FM synthesis. For brass-like sounds, the modulation amount increases with the amplitude of the signal. In the patch, note that the amplitude envelope for the carrier oscillator is scaled and also used to control amplitude of the modulating oscillator.

figure[htbp] \includegraphics{eps/fmug}

It is well known that sinusoidal frequency-modulation of a sinusoid creates sinusoidal components that are uniformly spaced in frequency by multiples of the modulation frequency, with amplitudes given by the Bessel functions of the first kind [14]. As a special case, frequency-modulation of a sinusoid by itself generates a harmonic spectrum in which the $ k$th harmonic amplitude is proportional to $ J_k(\beta)$, where $ k$ is the order of the Bessel function and $ \beta $ is the FM index. We will derive this in the next section.4.9

Bessel Functions

The Bessel functions of the first kind may be defined as the coefficients $ J_k(\beta)$ in the two-sided Laurent expansion of the so-called generating function [84, p. 14],4.10

$\displaystyle e^{\frac{1}{2}\beta\left(z-\frac{1}{z}\right)} = \sum_{k=-\infty}^\infty J_k(\beta) z^k \protect$ (4.6)

where $ k$ is the integer order of the Bessel function, and $ \beta $ is its argument (which can be complex, but we will only consider real $ \beta $). Setting $ z=e^{j\omega_mt}$, where $ \omega_m$ will interpreted as the FM modulation frequency and $ t$ as time in seconds, we obtain

$\displaystyle x_m(t)\isdef e^{j\beta\sin(\omega_m t)} = \sum_{k=-\infty}^\infty J_k(\beta) e^{jk\omega_m t}. \protect$ (4.7)

The last expression can be interpreted as the Fourier superposition of the sinusoidal harmonics of $ \exp[j\beta\sin(\omega_m t)]$, i.e., an inverse Fourier series sum. In other words, $ J_k(\beta)$ is the amplitude of the $ k$th harmonic in the Fourier-series expansion of the periodic signal $ x_m(t)$.

Note that $ J_k(\beta)$ is real when $ \beta $ is real. This can be seen by viewing Eq.$ \,$(4.6) as the product of the series expansion for $ \exp[(\beta/2) z]$ times that for $ \exp[-(\beta/2)/z]$ (see footnote pertaining to Eq.$ \,$(4.6)).

Figure 4.15 illustrates the first eleven Bessel functions of the first kind for arguments up to $ \beta=30$. It can be seen in the figure that when the FM index $ \beta $ is zero, $ J_0(0)=1$ and $ J_k(0)=0$ for all $ k>0$. Since $ J_0(\beta)$ is the amplitude of the carrier frequency, there are no side bands when $ \beta=0$. As the FM index increases, the sidebands begin to grow while the carrier term diminishes. This is how FM synthesis produces an expanded, brighter bandwidth as the FM index is increased.

Figure 4.15: Bessel functions of the first kind for a range of orders $ k$ and argument $ \beta $.
\includegraphics[width=\twidth]{eps/bessel}

FM Spectra

Using the expansion in Eq.$ \,$(4.7), it is now easy to determine the spectrum of sinusoidal FM. Eliminating scaling and phase offsets for simplicity in Eq.$ \,$(4.5) yields

$\displaystyle x(t) = \cos[\omega_c t + \beta\sin(\omega_m t)], \protect$ (4.8)

where we have changed the modulator amplitude $ A_m$ to the more traditional symbol $ \beta $, called the FM index in FM sound synthesis contexts. Using phasor analysis (where phasors are defined below in §4.3.11),4.11i.e., expressing a real-valued FM signal as the real part of a more analytically tractable complex-valued FM signal, we obtain
$\displaystyle x(t) \isdef \cos[\omega_c t + \beta\sin(\omega_m t)]$ $\displaystyle =$ re$\displaystyle \left\{e^{j[\omega_c t + \beta\sin(\omega_m t)]}\right\}$  
  $\displaystyle =$ re$\displaystyle \left\{e^{j\omega_c t} e^{j\beta\sin(\omega_m t)}\right\}$  
  $\displaystyle =$ re$\displaystyle \left\{e^{j\omega_c t} \sum_{k=-\infty}^\infty J_k(\beta) e^{jk\omega_m t}\right\}$  
  $\displaystyle =$ re$\displaystyle \left\{\sum_{k=-\infty}^\infty J_k(\beta) e^{j(\omega_c+k\omega_m) t}\right\}$  
  $\displaystyle =$ $\displaystyle \sum_{k=-\infty}^\infty J_k(\beta) \cos[(\omega_c+k\omega_m) t]$ (4.9)

where we used the fact that $ J_k(\beta)$ is real when $ \beta $ is real. We can now see clearly that the sinusoidal FM spectrum consists of an infinite number of side-bands about the carrier frequency $ \omega_c$ (when $ \beta\neq 0$). The side bands occur at multiples of the modulating frequency $ \omega_m$ away from the carrier frequency $ \omega_c$.

Analytic Signals and Hilbert Transform Filters

A signal which has no negative-frequency components is called an analytic signal.4.12 Therefore, in continuous time, every analytic signal $ z(t)$ can be represented as

$\displaystyle z(t) = \frac{1}{2\pi}\int_0^{\infty} Z(\omega)e^{j\omega t}d\omega $

where $ Z(\omega)$ is the complex coefficient (setting the amplitude and phase) of the positive-frequency complex sinusoid $ \exp(j\omega t)$ at frequency $ \omega$.

Any real sinusoid $ A\cos(\omega t + \phi)$ may be converted to a positive-frequency complex sinusoid $ A\exp[j(\omega t + \phi)]$ by simply generating a phase-quadrature component $ A\sin(\omega t + \phi)$ to serve as the ``imaginary part'':

$\displaystyle A e^{j(\omega t + \phi)} = A\cos(\omega t + \phi) + j A\sin(\omega t + \phi) $

The phase-quadrature component can be generated from the in-phase component by a simple quarter-cycle time shift.4.13

For more complicated signals which are expressible as a sum of many sinusoids, a filter can be constructed which shifts each sinusoidal component by a quarter cycle. This is called a Hilbert transform filter. Let $ {\cal H}_t\{x\}$ denote the output at time $ t$ of the Hilbert-transform filter applied to the signal $ x$. Ideally, this filter has magnitude $ 1$ at all frequencies and introduces a phase shift of $ -\pi/2$ at each positive frequency and $ +\pi/2$ at each negative frequency. When a real signal $ x(t)$ and its Hilbert transform $ y(t) = {\cal H}_t\{x\}$ are used to form a new complex signal $ z(t) = x(t) + j y(t)$, the signal $ z(t)$ is the (complex) analytic signal corresponding to the real signal $ x(t)$. In other words, for any real signal $ x(t)$, the corresponding analytic signal $ z(t)=x(t) + j {\cal H}_t\{x\}$ has the property that all ``negative frequencies'' of $ x(t)$ have been ``filtered out.''

To see how this works, recall that these phase shifts can be impressed on a complex sinusoid by multiplying it by $ \exp(\pm j\pi/2) = \pm j$. Consider the positive and negative frequency components at the particular frequency $ \omega_0$:

\begin{eqnarray*} x_+(t) &\isdef & e^{j\omega_0 t} \\ x_-(t) &\isdef & e^{-j\omega_0 t} \end{eqnarray*}

Now let's apply a $ -90$ degrees phase shift to the positive-frequency component, and a $ +90$ degrees phase shift to the negative-frequency component:

\begin{eqnarray*} y_+(t) &=& e^{-j\pi/2} e^{j\omega_0 t} = -j e^{j\omega_0 t} \\ y_-(t) &=& e^{j\pi/2} e^{-j\omega_0 t} = j e^{-j\omega_0 t} \end{eqnarray*}

Adding them together gives

\begin{eqnarray*} z_+(t) &\isdef & x_+(t) + j y_+(t) = e^{j\omega_0 t} - j^2 e^{... ... x_-(t) + j y_-(t) = e^{-j\omega_0 t} + j^2 e^{-j\omega_0 t} = 0 \end{eqnarray*}

and sure enough, the negative frequency component is filtered out. (There is also a gain of 2 at positive frequencies.)

For a concrete example, let's start with the real sinusoid

$\displaystyle x(t)=2\cos(\omega_0 t) = e^{j\omega_0 t} + e^{-j\omega_0 t}. $

Applying the ideal phase shifts, the Hilbert transform is

\begin{eqnarray*} y(t) &=& e^{j\omega_0 t-j\pi/2} + e^{-j\omega_0 t + j\pi/2}\\ &=& -je^{j\omega_0 t} + je^{-j\omega_0 t} = 2\sin(\omega_0 t). \end{eqnarray*}

The analytic signal is then

$\displaystyle z(t) = x(t) + j y(t) = 2\cos(\omega_0 t) + j 2\sin(\omega_0 t) = 2 e^{j\omega_0 t}, $

by Euler's identity. Thus, in the sum $ x(t) + j y(t)$, the negative-frequency components of $ x(t)$ and $ jy(t)$ cancel out, leaving only the positive-frequency component. This happens for any real signal $ x(t)$, not just for sinusoids as in our example.

Figure 4.16: Creation of the analytic signal $ z(t)=e^{j\omega _0 t}$ from the real sinusoid $ x(t) = \cos(\omega_0 t)$ and the derived phase-quadrature sinusoid $ y(t) = \sin(\omega_0 t)$, viewed in the frequency domain. a) Spectrum of $ x$. b) Spectrum of $ y$. c) Spectrum of $ j y$. d) Spectrum of $ z = x + jy$.
\includegraphics[width=2.8in]{eps/sineFD}

Figure 4.16 illustrates what is going on in the frequency domain. At the top is a graph of the spectrum of the sinusoid $ \cos(\omega_0 t)$ consisting of impulses at frequencies $ \omega=\pm\omega_0$ and zero at all other frequencies (since $ \cos(\omega_0 t) = (1/2)\exp(j\omega_0 t) + (1/2)\exp(-j\omega_0 t)$). Each impulse amplitude is equal to $ 1/2$. (The amplitude of an impulse is its algebraic area.) Similarly, since $ \sin(\omega_0 t) = (1/2j)\exp(j\omega_0 t) - (1/2j)\exp(-j\omega_0 t) = -(j/2) \exp(j\omega_0 t) + (j/2)\exp(-j\omega_0 t)$, the spectrum of $ \sin(\omega_0 t)$ is an impulse of amplitude $ -j/2$ at $ \omega=\omega_0$ and amplitude $ +j/2$ at $ \omega=-\omega_0$. Multiplying $ y(t)$ by $ j$ results in $ j\sin(\omega_0 t) = (1/2)\exp(j\omega_0 t) - (1/2)\exp(-j\omega_0 t)$ which is shown in the third plot, Fig.4.16c. Finally, adding together the first and third plots, corresponding to $ z(t) = x(t) + j y(t)$, we see that the two positive-frequency impulses add in phase to give a unit impulse (corresponding to $ \exp(j\omega_0 t)$), and at frequency $ -\omega_0$, the two impulses, having opposite sign, cancel in the sum, thus creating an analytic signal $ z$, as shown in Fig.4.16d. This sequence of operations illustrates how the negative-frequency component $ \exp(-j\omega_0 t)$ gets filtered out by summing $ \cos(\omega_0 t)$ with $ j\sin(\omega_0 t)$ to produce the analytic signal $ \exp(j\omega_0 t)$ corresponding to the real signal $ \cos(\omega_0 t)$.

As a final example (and application), let $ x(t) = A(t)\cos(\omega t)$, where $ A(t)$ is a slowly varying amplitude envelope (slow compared with $ \omega$). This is an example of amplitude modulation applied to a sinusoid at ``carrier frequency'' $ \omega$ (which is where you tune your AM radio). The Hilbert transform is very close to $ y(t)\approx A(t)\sin(\omega t)$ (if $ A(t)$ were constant, this would be exact), and the analytic signal is $ z(t)\approx A(t)e^{j\omega t}$. Note that AM demodulation4.14is now nothing more than the absolute value. I.e., $ A(t) = \left\vert z(t)\right\vert$. Due to this simplicity, Hilbert transforms are sometimes used in making amplitude envelope followers for narrowband signals (i.e., signals with all energy centered about a single ``carrier'' frequency). AM demodulation is one application of a narrowband envelope follower.

Generalized Complex Sinusoids

We have defined sinusoids and extended the definition to include complex sinusoids. We now extend one more step by allowing for exponential amplitude envelopes:

$\displaystyle y(t) \isdef {\cal A}e^{st} $

where $ {\cal A}$ and $ s$ are complex, and further defined as

\begin{eqnarray*} {\cal A}&=& Ae^{j\phi} \\ s &=& \sigma + j\omega. \end{eqnarray*}

When $ \sigma=0$, we obtain

$\displaystyle y(t) \isdef {\cal A}e^{j\omega t} = A e^{j\phi} e^{j\omega t} = A e^{j(\omega t + \phi)} $

which is the complex sinusoid at amplitude $ A$, frequency $ \omega$, and phase $ \phi$. More generally, we have

\begin{eqnarray*} y(t) &\isdef & {\cal A}e^{st} \\ &\isdef & A e^{j\phi} e^{(\... ... t} \left[\cos(\omega t + \phi) + j\sin(\omega t + \phi)\right]. \end{eqnarray*}

Defining $ \tau = -1/\sigma$, we see that the generalized complex sinusoid is just the complex sinusoid we had before with an exponential envelope:

\begin{eqnarray*} \mbox{re}\left\{y(t)\right\} &=& A e^{- t/\tau} \cos(\omega t ... ...{im}\left\{y(t)\right\} &=& A e^{- t/\tau} \sin(\omega t + \phi) \end{eqnarray*}

Sampled Sinusoids

In discrete-time audio processing, such as we normally do on a computer, we work with samples of continuous-time signals. Let $ f_s$ denote the sampling rate in Hz. For audio, we typically have $ f_s>40$ kHz, since the audio band nominally extends to $ 20$ kHz. For compact discs (CDs), $ f_s= 44.1$ kHz, while for digital audio tape (DAT), $ f_s= 48$ kHz.

Let $ T\isdef 1/f_s$ denote the sampling interval in seconds. Then to convert from continuous to discrete time, we replace $ t$ by $ nT$, where $ n$ is an integer interpreted as the sample number.

The sampled generalized complex sinusoid is then

\begin{eqnarray*} y(nT) &\isdef & \left.{\cal A}\,e^{st}\right\vert _{t=nT}\\ ... ... \left[\cos(\omega nT + \phi) + j\sin(\omega nT + \phi)\right]. \end{eqnarray*}

Thus, the sampled case consists of a sampled complex sinusoid multiplied by a sampled exponential envelope $ \left[e^{\sigma T}\right]^n = e^{-nT/\tau}$.

Powers of z

Choose any two complex numbers $ z_0$ and $ z_1$, and form the sequence

$\displaystyle x(n) \isdef z_0 z_1^n, \quad n=0,1,2,3,\ldots\,. \protect$ (4.10)

What are the properties of this signal? Writing the complex numbers as

\begin{eqnarray*} z_0 &=& A e^{j\phi} \\ z_1 &=& e^{sT} = e^{(\sigma + j\omega)T}, \end{eqnarray*}

we see that the signal $ x(n)$ is always a discrete-time generalized (exponentially enveloped) complex sinusoid:

$\displaystyle x(n) = A e^{\sigma n T} e^{j(\omega n T + \phi)} $

Figure 4.17 shows a plot of a generalized (exponentially decaying, $ \sigma<0$) complex sinusoid versus time.

Figure 4.17: Exponentially decaying complex sinusoid and projections.
\includegraphics[scale=0.8]{eps/circledecaying}

Note that the left projection (onto the $ z$ plane) is a decaying spiral, the lower projection (real-part vs. time) is an exponentially decaying cosine, and the upper projection (imaginary-part vs. time) is an exponentially enveloped sine wave.

Phasor and Carrier Components of Sinusoids

If we restrict $ z_1$ in Eq.$ \,$(4.10) to have unit modulus, then $ \sigma=0$ and we obtain a discrete-time complex sinusoid.

$\displaystyle x(n) \isdef z_0 z_1^n = \left(Ae^{j\phi}\right) e^{j\omega n T} = A e^{j(\omega n T+\phi)}, \quad n=0,1,2,3,\ldots \protect$ (4.11)

where we have defined

\begin{eqnarray*} z_0 &\isdef & Ae^{j\phi}, \quad \hbox{and}\\ z_1 &\isdef & e^{j\omega T}. \end{eqnarray*}

Phasor

It is common terminology to call $ z_0 = Ae^{j\phi}$ the complex sinusoid's phasor, and $ z_1^n = e^{j\omega n T}$ its carrier wave.

For a real sinusoid,

$\displaystyle x_r(n) \isdef A \cos(\omega n T+\phi), $

the phasor is again defined as $ z_0 = Ae^{j\phi}$ and the carrier is $ z_1^n = e^{j\omega n T}$. However, in this case, the real sinusoid is recovered from its complex-sinusoid counterpart by taking the real part:

$\displaystyle x_r(n) =$   re$\displaystyle \left\{z_0z_1^n\right\} $

The phasor magnitude $ \left\vert z_0\right\vert=A$ is the amplitude of the sinusoid. The phasor angle $ \angle{z_0}=\phi$ is the phase of the sinusoid.

When working with complex sinusoids, as in Eq.$ \,$(4.11), the phasor representation $ Ae^{j\phi}$ of a sinusoid can be thought of as simply the complex amplitude of the sinusoid. I.e., it is the complex constant that multiplies the carrier term $ e^{j\omega nT}$.

Why Phasors are Important

Linear, time-invariant (LTI) systems can be said to perform only four operations on a signal: copying, scaling, delaying, and adding. As a result, each output is always a linear combination of delayed copies of the input signal(s). (A linear combination is simply a weighted sum, as discussed in §5.6.) In any linear combination of delayed copies of a complex sinusoid

$\displaystyle y(n) = \sum_{i=1}^N g_i x(n-d_i) $

where $ g_i$ is a weighting factor, $ d_i$ is the $ i$th delay, and

$\displaystyle x(n)\isdef e^{j\omega nT} $

is a complex sinusoid, the ``carrier term'' $ e^{j\omega nT}$ can be ``factored out'' of the linear combination:

\begin{eqnarray*} y(n) &=& \sum_{i=1}^N g_i e^{j[\omega (n-d_i)T]} = \sum_{i=1}... ...e^{-j \omega d_i T} = x(n) \sum_{i=1}^N g_i e^{-j \omega d_i T} \end{eqnarray*}

The operation of the LTI system on a complex sinusoid is thus reduced to a calculation involving only phasors, which are simply complex numbers.

Since every signal can be expressed as a linear combination of complex sinusoids, this analysis can be applied to any signal by expanding the signal into its weighted sum of complex sinusoids (i.e., by expressing it as an inverse Fourier transform).

Importance of Generalized Complex Sinusoids

As a preview of things to come, note that one signal $ y(\cdot)$4.15 is projected onto another signal $ x(\cdot)$ using an inner product. The inner product $ \left<y,x\right>$ computes the coefficient of projection4.16 of $ y$ onto $ x$. If $ x_k(n) = e^{j\omega_k n T}, n=0,1,2,\ldots,N-1$ (a sampled, unit-amplitude, zero-phase, complex sinusoid), then the inner product computes the Discrete Fourier Transform (DFT), provided the frequencies are chosen to be $ \omega_k = 2\pi k f_s/N$. For the DFT, the inner product is specifically

$\displaystyle \left<y,x_k\right> \isdef \sum_{n=0}^{N-1}y(n)\overline{x_k(n)} ... ...^{N-1}y(n)e^{-j 2\pi n k/N} \isdef \hbox{\sc DFT}_k(y) \isdef Y(\omega_k). $

Another case of importance is the Discrete Time Fourier Transform (DTFT), which is like the DFT except that the transform accepts an infinite number of samples instead of only $ N$. In this case, frequency is continuous, and

$\displaystyle \left<y,x_\omega\right> = \sum_{n=0}^\infty y(n) e^{-j \omega n T} \isdef \hbox{\sc DTFT}_\omega(y). $

The DTFT is what you get in the limit as the number of samples in the DFT approaches infinity. The lower limit of summation remains zero because we are assuming all signals are zero for negative time (such signals are said to be causal). This means we are working with unilateral Fourier transforms. There are also corresponding bilateral transforms for which the lower summation limit is $ -\infty$. The DTFT is discussed further in §B.1.

If, more generally, $ x(n) = z^n$ (a sampled complex sinusoid with exponential growth or decay), then the inner product becomes

$\displaystyle \left<y,x\right> = \sum_{n=0}^\infty y(n) z^{-n} $

and this is the definition of the $ z$ transform. It is a generalization of the DTFT: The DTFT equals the $ z$ transform evaluated on the unit circle in the $ z$ plane. In principle, the $ z$ transform can also be recovered from the DTFT by means of ``analytic continuation'' from the unit circle to the entire $ z$ plane (subject to mathematical disclaimers which are unnecessary in practical applications since they are always finite).

Why have a $ z$ transform when it seems to contain no more information than the DTFT? It is useful to generalize from the unit circle (where the DFT and DTFT live) to the entire complex plane (the $ z$ transform's domain) for a number of reasons. First, it allows transformation of growing functions of time such as growing exponentials; the only limitation on growth is that it cannot be faster than exponential. Secondly, the $ z$ transform has a deeper algebraic structure over the complex plane as a whole than it does only over the unit circle. For example, the $ z$ transform of any finite signal is simply a polynomial in $ z$. As such, it can be fully characterized (up to a constant scale factor) by its zeros in the $ z$ plane. Similarly, the $ z$ transform of an exponential can be characterized to within a scale factor by a single point in the $ z$ plane (the point which generates the exponential); since the $ z$ transform goes to infinity at that point, it is called a pole of the transform. More generally, the $ z$ transform of any generalized complex sinusoid is simply a pole located at the point which generates the sinusoid. Poles and zeros are used extensively in the analysis of recursive digital filters. On the most general level, every finite-order, linear, time-invariant, discrete-time system is fully specified (up to a scale factor) by its poles and zeros in the $ z$ plane. This topic will be taken up in detail in Book II [68].

In the continuous-time case, we have the Fourier transform which projects $ y$ onto the continuous-time sinusoids defined by $ x(t)=e^{j\omega t}$, and the appropriate inner product is

$\displaystyle \left<y,x\right> = \int_{0}^{\infty} y(t) e^{-j\omega t} dt \isdef Y(\omega). $

Finally, the Laplace transform is the continuous-time counterpart of the $ z$ transform, and it projects signals onto exponentially growing or decaying complex sinusoids:

$\displaystyle \left<y,x\right> = \int_{0}^{\infty} y(t) e^{-s t} dt \isdef Y(s) $

The Fourier transform equals the Laplace transform evaluated along the ``$ j\omega$ axis'' in the $ s$ plane, i.e., along the line $ s=j\omega$, for which $ \sigma=0$. Also, the Laplace transform is obtainable from the Fourier transform via analytic continuation. The usefulness of the Laplace transform relative to the Fourier transform is exactly analogous to that of the $ z$ transform outlined above.

Comparing Analog and Digital Complex Planes

In signal processing, it is customary to use $ s$ as the Laplace transform variable for continuous-time analysis, and $ z$ as the $ z$-transform variable for discrete-time analysis. In other words, for continuous-time systems, the frequency domain is the ``$ s$ plane'', while for discrete-time systems, the frequency domain is the ``$ z$ plane.'' However, both are simply complex planes.

Figure 4.18: Generalized complex sinusoids represented by points in the $ s$ plane.
\includegraphics[width=4.5in]{eps/splane}

Figure 4.19: Sampled generalized complex sinusoids represented by points in the $ z$ plane.
\includegraphics[width=\twidth]{eps/zplane}

Figure 4.18 illustrates the various sinusoids $ e^{st}$ represented by points in the $ s$ plane. The frequency axis is $ s=j\omega$, called the ``$ j\omega$ axis,'' and points along it correspond to complex sinusoids, with dc at $ s=0$ ( $ e^{j0t}\equiv 1$). The upper-half plane corresponds to positive frequencies (counterclockwise circular or corkscrew motion) while the lower-half plane corresponds to negative frequencies (clockwise motion). In the left-half plane we have decaying (stable) exponential envelopes, while in the right-half plane we have growing (unstable) exponential envelopes. Along the real axis ($ s=\sigma$), we have pure exponentials. Every point in the $ s$ plane corresponds to a generalized complex sinusoid, $ x(t) = {\cal A}e^{st}, t\geq 0$, with special cases including complex sinusoids $ {\cal A}e^{j\omega t}$, real exponentials $ A e^{\sigma t}$, and the constant function $ x(t)=1$ (dc).

Figure 4.19 shows examples of various sinusoids $ z^n=(e^{sT})^n$ represented by points in the $ z$ plane. The frequency axis is the ``unit circle'' $ z=e^{j\omega T}$, and points along it correspond to sampled complex sinusoids, with dc at $ z=1$ ( $ 1^n = [e^{j0T}]^n = 1$). While the frequency axis is unbounded in the $ s$ plane, it is finite (confined to the unit circle) in the $ z$ plane, which is natural because the sampling rate is finite in the discrete-time case. As in the $ s$ plane, the upper-half plane corresponds to positive frequencies while the lower-half plane corresponds to negative frequencies. Inside the unit circle, we have decaying (stable) exponential envelopes, while outside the unit circle, we have growing (unstable) exponential envelopes. Along the positive real axis ( re$ \left\{z\right\}>0, \;$   im$ \left\{z\right\}=0$), we have pure exponentials, but along the negative real axis ( re$ \left\{z\right\}<0, \;$   im$ \left\{z\right\}=0$), we have exponentially enveloped sampled sinusoids at frequency $ f_s/2$ (exponentially enveloped alternating sequences). The negative real axis in the $ z$ plane is normally a place where all signal $ z$ transforms should be zero, and all system responses should be highly attenuated, since there should never be any energy at exactly half the sampling rate (where amplitude and phase are ambiguously linked). Every point in the $ z$ plane can be said to correspond to sampled generalized complex sinusoids of the form $ x(n) = {\cal A}z^n = {\cal A}[e^{sT}]^n, n\geq 0$, with special cases being sampled complex sinusoids $ {\cal A}e^{j\omega nT}$, sampled real exponentials $ A e^{\sigma nT}$, and the constant sequence $ x=[1,1,1,\ldots]$ (dc).

In summary, the exponentially enveloped (``generalized'') complex sinusoid is the fundamental signal upon which other signals are ``projected'' in order to compute a Laplace transform in the continuous-time case, or a $ z$ transform in the discrete-time case. As a special case, if the exponential envelope is eliminated (set to $ 1$), leaving only a complex sinusoid, then the projection reduces to the Fourier transform in the continuous-time case, and either the DFT (finite length) or DTFT (infinite length) in the discrete-time case. Finally, there are still other variations, such as short-time Fourier transforms (STFT) and wavelet transforms, which utilize further modifications such as projecting onto windowed complex sinusoids.

Sinusoid Problems

See http://ccrma.stanford.edu/~jos/mdftp/Sinusoid_Problems.html

Next Section:
Geometric Signal Theory
Previous Section:
Proof of Euler's Identity