Entropy of a Probability Distribution
The entropy of a probability density function (PDF)
is
defined as [48]
![]() |
(D.29) |
where




![]() |
(D.30) |
The term
![$ \lg[1/p(x)]$](http://www.dsprelated.com/josimages_new/sasp2/img2797.png)


Next Section:
Example: Random Bit String
Previous Section:
Binomial Distribution
The entropy of a probability density function (PDF)
is
defined as [48]
![]() |
(D.29) |
![]() |
(D.30) |