June 2025

Introduction to Random Signals in Electrical Engineering

Random signals are stochastic processes that model unpredictable electrical phenomena and noise in communication systems.

Key Applications in EE:
- Communication Systems: Channel modeling, noise analysis
- Signal Processing: Filtering, detection, estimation theory
- Control Systems: System identification, adaptive control
- Circuit Analysis: Thermal noise, shot noise modeling
- Antenna Systems: Random electromagnetic fields
- Digital Signal Processing: Quantization noise, aliasing effects

Why Stochastic Processes Matter:
- Real-world signals contain unpredictable components
- Noise is fundamental limitation in all electronic systems
- Statistical models enable optimal system design
- Foundation for modern wireless communications

Mathematical Framework for Random Signals

Stochastic Process Definition: A random signal \(X(t)\) is a stochastic process where each \(t\) represents time and \(X(t)\) is a random variable representing signal amplitude.

Key Statistical Characterizations:
- Mean (DC Component): \(\mu_X(t) = E[X(t)]\)
- Autocorrelation Function: \(R_X(t_1,t_2) = E[X(t_1)X(t_2)]\)
- Power Spectral Density: \(S_X(\omega) = \mathcal{F}[R_X(\tau)]\)

For WSS Signals:
\[R_X(\tau) = E[X(t)X(t+\tau)]\\ S_X(\omega) = \int_{-\infty}^{\infty} R_X(\tau) e^{-j\omega\tau} d\tau\]

The total average power is: \(P = R_X(0) = \frac{1}{2\pi}\int_{-\infty}^{\infty} S_X(\omega) d\omega\)

Noise Models in Electronic Systems

White Noise Process:
- Autocorrelation: \(R_n(\tau) = \frac{N_0}{2}\delta(\tau)\)
- Power Spectral Density: \(S_n(\omega) = \frac{N_0}{2}\) (constant)
- Physical Origin: Thermal noise in resistors, shot noise in diodes

Colored Noise (Filtered White Noise): When white noise passes through LTI system with impulse response \(h(t)\):
\[S_y(\omega) = |H(\omega)|^2 S_n(\omega)\]

Thermal Noise in Resistors: Where \(k\) = Boltzmann constant, \(T\) = temperature, \(R\) = resistance, \(B\) = bandwidth
\[\overline{v_n^2} = 4kTRB\]

Example: Communication Channel Modeling

##    time transmitted       noise   received
## 1 0.000   -1.000000  0.22763554 -0.7723645
## 2 0.001   -0.809017 -0.55425783 -1.3632748
## 3 0.002   -0.309017  1.11420761  0.8051906
## 4 0.003    0.309017  0.45459846  0.7636155
## 5 0.004    0.809017  0.06347036  0.8724874
## 6 0.005    1.000000  0.19555091  1.1955509
## 7 0.006    0.809017  0.48032973  1.2893467
## 8 0.007    0.309017  0.06352144  0.3725384

System Model: \(r(t) = s(t) + n(t)\)

- Signal-to-Noise Ratio (SNR): \(\frac{P_s}{P_n} = \frac{\text{var}(s)}{\text{var}(n)}\)

Signal and Noise Visualization

## 
## Signal-to-Noise Ratio: 0.11 dB

Autocorrelation and Power Spectral Density

3D Visualization: Spectrogram Analysis

Optimal Filtering: Wiener Filter Design

Applications in Modern Communication Systems

Digital Communication Systems:
- Channel Capacity: \(C = B \log_2(1 + \text{SNR})\) \(bits/second\)
- Bit Error Rate (BER): Function of SNR and modulation
- Equalization: Compensating for random channel distortions

Radar and Sonar Systems:
- Detection Theory: Optimal receivers for signals with noise
- Matched Filtering: Maximizing SNR at decision point
- Doppler Processing: Random target motion modeling

Wireless Communications:
- Fading Channels: Rayleigh and Rician fading models
- MIMO Systems: Spatial diversity in random environments
- Adaptive Algorithms: Learning unknown channel parameters

Signal Processing Applications:
- Adaptive Filtering: Least Mean Squares and Recursive Least Squares algorithms
- Spectral Estimation: Parametric and non-parametric methods
- Array Processing: Beamforming in random interference

Conclusions and Engineering Implications

Key Engineering Insights:
- Random signals are fundamental to all electronic systems.
- Statistical characterization enables optimal design.
- Power spectral density determines bandwidth requirements.
- SNR analysis sets performance limits.

Design Methodologies:
- Noise analysis in circuit design and system planning.
- Statistical signal processing for detection and estimation.
- Adaptive systems that learn from random environments.
- Robust design accounting for statistical variations.

Future Directions:
- Machine Learning integration with classical signal processing.
- Internet of Things (IoT) with low-power random signal processing.
- Software-Defined Radio (SDR) with adaptive algorithms.

Practical Impact: Understanding random signal theory enables engineers to design systems that perform optimally in the presence of noise and uncertainty.