DSPRelated.com
Books

Probability, Statistics, and Random Signals

Boncelet, Charles 2016

Probability, Statistics, and Random Signals offers a comprehensive treatment of probability, giving equal treatment to discrete and continuous probability. The topic of statistics is presented as the application of probability to data analysis, not as a cookbook of statistical recipes. This student-friendly text features accessible descriptions and highly engaging exercises on topics like gambling, the birthday paradox, and financial decision-making.


Why Read This Book

You should read this book if you want a clear, student-friendly bridge from core probability to practical statistical signal processing: you will learn probability concepts with equal emphasis on discrete and continuous cases and see statistics presented as applied data analysis rather than a cookbook. You will also get hands-on intuition for random signals, spectral analysis, and filtering through engaging examples (e.g., gambling, the birthday paradox, financial decisions) that illuminate DSP, communications, and radar problems.

Who Will Benefit

Undergraduate or graduate electrical engineers, DSP and communications engineers, and students who need a rigorous yet accessible introduction to probability and statistical analysis of random signals.

Level: Intermediate — Prerequisites: Single-variable calculus, basic linear algebra, and introductory signals & systems; some familiarity with complex numbers and basic programming (MATLAB or Python) is helpful but not strictly required.

Get This Book

Key Takeaways

  • Compute and manipulate probabilities, PMFs, PDFs, CDFs, and common distributions for both discrete and continuous random variables.
  • Model and analyze random processes—assess stationarity and ergodicity, compute autocorrelation, cross-correlation, and power spectral density (PSD).
  • Apply FFT-based spectral analysis and practical PSD estimation methods to analyze real signals.
  • Design and evaluate linear estimators and filters (including Wiener filtering concepts) for noise reduction and signal estimation.
  • Perform statistical inference for signals: point and interval estimation, and hypothesis testing relevant to detection and communications problems.

Topics Covered

  1. 1. Introduction and Motivation — Probability as the Foundation for Signal Analysis
  2. 2. Discrete Probability: Events, Combinatorics, and Distributions
  3. 3. Continuous Probability: Densities, Transformations, and Common Families
  4. 4. Joint, Conditional, and Multivariate Distributions
  5. 5. Random Variables and Transform Methods (MGFs, Characteristic Functions)
  6. 6. Stochastic Processes: Definitions, Stationarity, and Ergodicity
  7. 7. Second-Order Analysis: Autocorrelation, Cross-Correlation, and PSD
  8. 8. Spectral Analysis and the FFT: Practical Estimation Techniques
  9. 9. Linear Systems Driven by Random Signals
  10. 10. Statistical Estimation: Estimators, Bias, Variance, and Confidence
  11. 11. Detection and Hypothesis Testing for Signals
  12. 12. Linear Estimation and Wiener Filtering; Introduction to Adaptive Filters
  13. 13. Applications: Audio/Speech, Radar, and Communications Examples

Languages, Platforms & Tools

MATLABPython (NumPy/SciPy)MATLAB/OctaveNumPy/SciPy (Python)FFT and spectral-estimation routines (Welch, periodogram)

How It Compares

More conversational and example-driven than classical theory texts like Papoulis or Peebles, and less narrowly focused on detection/estimation theory than Steven Kay's books — a friendly bridge from fundamentals to applied statistical signal processing.

Related Books

Alan V. Oppenheim, Alan S. ...