Home Page Icon
Home Page
Table of Contents for
Title Page
Close
Title Page
by Umberto Spagnolini
Statistical Signal Processing in Engineering
Cover
Title Page
List of Figures
List of Tables
Preface
List of Abbreviations
How to Use the Book
About the Companion Website
Prerequisites
Why are there so many matrixes in this book?
1 Manipulations on Matrixes
1.1 Matrix Properties
1.2 Eigen‐Decompositions
1.3 Eigenvectors in Everyday Life
1.4 Derivative Rules
1.5 Quadratic Forms
1.6 Diagonalization of a Quadratic Form
1.7 Rayleigh Quotient
1.8 Basics of Optimization
Appendix A: Arithmetic vs. Geometric Mean
2 Linear Algebraic Systems
2.1 Problem Definition and Vector Spaces
2.2 Rotations
2.3 Projection Matrixes and Data‐Filtering
2.4 Singular Value Decomposition (SVD) and Subspaces
2.5 QR and Cholesky Factorization
2.6 Power Method for Leading Eigenvectors
2.7 Least Squares Solution of Overdetermined Linear Equations
2.8 Efficient Implementation of the LS Solution
2.9 Iterative Methods
3 Random Variables in Brief
3.1 Probability Density Function (pdf), Moments, and Other Useful Properties
3.2 Convexity and Jensen Inequality
3.3 Uncorrelatedness and Statistical Independence
3.4 Real‐Valued Gaussian Random Variables
3.5 Conditional pdf for Real‐Valued Gaussian Random Variables
3.6 Conditional pdf in Additive Noise Model
3.7 Complex Gaussian Random Variables
3.8 Sum of Square of Gaussians: Chi‐Square
3.9 Order Statistics for N rvs
4 Random Processes and Linear Systems
4.1 Moment Characterizations and Stationarity
4.2 Random Processes and Linear Systems
4.3 Complex‐Valued Random Processes
4.4 Pole‐Zero and Rational Spectra (Discrete‐Time)
4.5 Gaussian Random Process (Discrete‐Time)
4.6 Measuring Moments in Stochastic Processes
Appendix A: Transforms for Continuous‐Time Signals
Appendix B: Transforms for Discrete‐Time Signals
5 Models and Applications
5.1 Linear Regression Model
5.2 Linear Filtering Model
5.3 MIMO systems and Interference Models
5.4 Sinusoidal Signal
5.5 Irregular Sampling and Interpolation
5.6 Wavefield Sensing System
6 Estimation Theory
6.1 Historical Notes
6.2 Non‐Bayesian vs. Bayesian
6.3 Performance Metrics and Bounds
6.4 Statistics and Sufficient Statistics
6.5 MVU and BLU Estimators
6.6 BLUE for Linear Models
6.7 Example: BLUE of the Mean Value of Gaussian rvs
7 Parameter Estimation
7.1 Maximum Likelihood Estimation (MLE)
7.2 MLE for Gaussian Model
7.3 Other Noise Models
7.4 MLE and Nuisance Parameters
7.5 MLE for Continuous‐Time Signals
7.6 MLE for Circular Complex Gaussian
7.7 Estimation in Phase/Frequency Modulations
7.8 Least Squares (LS) Estimation
7.9 Robust Estimation
8 Cramér–Rao Bound
8.1 Cramér–Rao Bound and Fisher Information Matrix
8.2 Interpretation of CRB and Remarks
8.3 CRB and Variable Transformations
8.4 FIM for Gaussian Parametric Model
Appendix A: Proof of CRB
Appendix B: FIM for Gaussian Model
Appendix C: Some Derivatives for MLE and CRB Computations
9 MLE and CRB for Some Selected Cases
9.1 Linear Regressions
9.2 Frequency Estimation
9.3 Estimation of Complex Sinusoid
9.4 Time of Delay Estimation
9.5 Estimation of Max for Uniform pdf
9.6 Estimation of Occurrence Probability for Binary pdf
9.7 How to Optimize Histograms?
9.8 Logistic Regression
10 Numerical Analysis and Montecarlo Simulations
10.1 System Identification and Channel Estimation
10.2 Frequency Estimation
10.3 Time of Delay Estimation
10.4 Doppler‐Radar System by Frequency Estimation
11 Bayesian Estimation
11.1 Additive Linear Model with Gaussian Noise
11.2 Bayesian Estimation in Gaussian Settings
11.3 LMMSE Estimation and Orthogonality
11.4 Bayesian CRB
11.5 Mixing Bayesian and Non‐Bayesian
11.6 Expectation‐Maximization (EM)
Appendix Gaussian Mixture pdf
12 Optimal Filtering
12.1 Wiener Filter
12.2 MMSE Deconvolution (or Equalization)
12.3 Linear Prediction
12.4 LS Linear Prediction
12.5 Linear Prediction and AR Processes
12.6 Levinson Recursion and Lattice Predictors
13 Bayesian Tracking and Kalman Filter
13.1 Bayesian Tracking of State in Dynamic Systems
13.2 Kalman Filter (KF)
13.3 Identification of Time‐Varying Filters in Wireless Communication
13.4 Extended Kalman Filter (EKF) for Non‐Linear Dynamic Systems
13.5 Position Tracking by Multi‐Lateration
13.6 Non‐Gaussian Pdf and Particle Filters
14 Spectral Analysis
14.1 Periodogram
14.2 Parametric Spectral Analysis
14.3 AR Spectral Analysis
14.4 MA Spectral Analysis
14.5 ARMA Spectral Analysis
Appendix A: Which Sample Estimate of the Autocorrelation to Use?
Appendix B: Eigenvectors and Eigenvalues of Correlation Matrix
Appendix C: Property of Monic Polynomial
Appendix D: Variance of Pole in AR(1)
15 Adaptive Filtering
15.1 Adaptive Interference Cancellation
15.2 Adaptive Equalization in Communication Systems
15.3 Steepest Descent MSE Minimization
15.4 From Iterative to Adaptive Filters
15.5 LMS Algorithm and Stochastic Gradient
15.6 Convergence Analysis of LMS Algorithm
15.7 Learning Curve of LMS
15.8 NLMS Updating and Non‐Stationarity
15.9 Numerical Example: Adaptive Identification
15.10 RLS Algorithm
15.11 Exponentially‐Weighted RLS
15.12 LMS vs. RLS
Appendix A: Convergence in Mean Square
16 Line Spectrum Analysis
Why Line Spectrum Analysis?
16.1 Model Definition
16.2 Maximum Likelihood and Cramér–Rao Bounds
16.3 High‐Resolution Methods
17 Equalization in Communication Engineering
17.1 Linear Equalization
17.2 Non‐Linear Equalization
17.3 MIMO Linear Equalization
17.4 MIMO–DFE Equalization
18 2D Signals and Physical Filters
18.1 2D Sinusoids
18.2 2D Filtering
18.3 Diffusion Filtering
18.4 Laplace Equation and Exponential Filtering
18.5 Wavefield Propagation
Appendix A: Properties of 2D Signals
Appendix B: Properties of 2D Fourier Transform
Appendix C: Finite Difference Method for PDE‐Diffusion
19 Array Processing
19.1 Narrowband Model
19.2 Beamforming and Signal Estimation
19.3 DoA Estimation
20 Multichannel Time of Delay Estimation
20.1 Model Definition for ToD
20.2 High Resolution Method for ToD (L = 1)
20.3 Difference of ToD (DToD) Estimation
20.4 Numerical Performance Analysis of DToD
20.5 Wavefront Estimation: Non‐Parametric Method (L = 1)
20.6 Parametric ToD Estimation and Wideband Beamforming
Appendix A: Properties of the Sample Correlations
Appendix B: How to Delay a Discrete‐Time Signal?
Appendix C: Wavefront Estimation for 2D Arrays
21 Tomography
21.1 X‐ray Tomography
21.2 Algebraic Reconstruction Tomography (ART)
21.3 Reconstruction From Projections: Fourier Method
21.4 Traveltime Tomography
21.5 Internet (Network) Tomography
22 Cooperative Estimation
22.1 Consensus and Cooperation
22.2 Distributed Estimation for Arbitrary Linear Models (p>1)
22.3 Distributed Synchronization
Appendix Basics of Undirected Graphs
23 Classification and Clustering
23.1 Historical Notes
23.2 Classification
23.3 Classification of Signals in Additive Gaussian Noise
23.4 Bayesian Classification
23.5 Pattern Recognition and Machine Learning
23.6 Clustering
References
Index
End User License Agreement
Search in book...
Toggle Font Controls
Playlists
Add To
Create new playlist
Name your new playlist
Playlist description (optional)
Cancel
Create playlist
Sign In
Email address
Password
Forgot Password?
Create account
Login
or
Continue with Facebook
Continue with Google
Sign Up
Full Name
Email address
Confirm Email Address
Password
Login
Create account
or
Continue with Facebook
Continue with Google
Prev
Previous Chapter
Table of Contents
Next
Next Chapter
Copyright
Statistical Signal Processing in Engineering
Umberto Spagnolini
Politecnico di Milano
Italy
Add Highlight
No Comment
..................Content has been hidden....................
You can't read the all page of ebook, please click
here
login for view all page.
Day Mode
Cloud Mode
Night Mode
Reset