Oppenheim & Willsky — Signals and Systems (2nd ed.)
Continuous-time signals & systems
Signals & Systems — Classification
Memory, causality, stability, invertibility; continuous vs discrete; energy and power signals
O&W §1
CT LTI Systems & Convolution
Convolution integral, impulse response, BIBO stability, causality from h(t)
O&W §2
Fourier Series (CT)
Orthogonality, synthesis and analysis equations, Gibbs phenomenon, Parseval's theorem
O&W §3
Continuous-Time Fourier Transform
CTFT pair, convolution theorem, Parseval, duality; spectrum of standard signals
O&W §4
Frequency Response of CT LTI Systems
H(jω), ideal filters, first- and second-order system frequency response
O&W §3–4
Sampling Theorem
Nyquist rate, aliasing, reconstruction; the bridge from CT to DT
O&W §7
Laplace & Z-transforms (system perspective)
Laplace Transform & Transfer Functions
Region of convergence, poles and zeros, partial fractions, system stability from pole locations
O&W §9
Block Diagrams & System Interconnections
Series, parallel, feedback; unilateral Laplace for IVPs; signal flow graphs
O&W §9–10
Z-Transform
ROC, poles and zeros, inverse Z-transform; DT system stability
O&W §10
Abbott — Understanding Analysis (Springer UTM, 2nd ed.)
The Real Numbers
Axiom of completeness, Archimedean property, uncountability of ℝ
Abbott §1
Sequences & Series
Convergence, Cauchy sequences, monotone convergence, infinite series
Abbott §2
Basic Topology of ℝ
Open and closed sets, compactness, connectedness — the real line version before Armstrong's general treatment
Abbott §3
Functional Limits & Continuity
ε–δ definition, uniform continuity, extreme value and intermediate value theorems
Abbott §4
The Derivative
Rigorous definition, mean value theorem, L'Hôpital's rule
Abbott §5
Sequences & Series of Functions
Pointwise vs uniform convergence; power series; Taylor series with rigorous remainder
Abbott §6
The Riemann Integral
Darboux definition, integrability criteria, fundamental theorem of calculus
Abbott §7
Blitzstein & Hwang — Introduction to Probability (CRC Press) · Stat 110 Harvard lectures (YouTube)
Counting & Naive Probability
Multiplication rule, permutations, combinations; birthday problem
B&H §1
Conditional Probability & Bayes
P(A|B), law of total probability, Bayes' theorem
B&H §2
Random Variables & Distributions
PMF, CDF, Bernoulli, Binomial, Geometric, Poisson
B&H §3–4
Expectation & Variance
E[X], linearity of expectation, LOTUS, Var(X)
B&H §4–5
Continuous Distributions
PDF, Uniform, Normal, Exponential, Beta, Gamma
B&H §5–8
Joint Distributions & Independence
Joint PDF/PMF, marginals, covariance, correlation
B&H §7
Law of Large Numbers & Central Limit Theorem
Convergence in probability; normal approximation
B&H §10
Markov Chains
Transition matrices, stationary distributions, PageRank
B&H §11
Proakis & Salehi — Communication Systems Engineering (2nd ed.) · Haykin — Communication Systems
Foundations
Channel Models & Noise
AWGN channel, SNR, noise power spectral density; thermal noise and N₀/2
Proakis §3
Analog Modulation
AM, DSB-SC, SSB, FM, PM; bandwidth and power tradeoffs; coherent vs envelope detection
Proakis §3
Digital communications
Digital Modulation — BPSK, QPSK, QAM
Signal constellations, decision regions, BER vs Eb/N₀; matched filter receiver
Proakis §5
Spread Spectrum — DSSS & FHSS
PN sequences, processing gain, jamming margin; CDMA; GPS L1 C/A signal structure
Proakis §9
Channel Coding & Shannon Capacity
Shannon's theorem, capacity–bandwidth tradeoff; Hamming codes; convolutional codes and Viterbi
Proakis §8
RF propagation & link budgets
Antenna Fundamentals
Gain, directivity, effective aperture, beam pattern; dipole and patch antennas for GNSS receivers
Proakis §2 · Balanis §1–2
Link Budget & Friis Equation
EIRP, path loss, receiver sensitivity, C/N₀; computing GPS received power from 20,200 km
Proakis §2
Multipath & Ionospheric Effects
Rayleigh fading, Doppler shift, ionospheric delay model; how these degrade GNSS pseudorange
Proakis §13 · Kaplan §7
Oppenheim & Schafer — Discrete-Time Signal Processing · Kay — Statistical Signal Processing · Kaplan & Hegarty — Understanding GPS/GNSS
Discrete-time signals & systems
Sampling & Reconstruction
Nyquist theorem, aliasing, reconstruction from samples
Oppenheim §1
Convolution & LTI Systems
Impulse response, linearity, time-invariance, BIBO stability
Oppenheim §2
Z-Transform
Region of convergence, poles and zeros, inverse Z-transform
Oppenheim §3
Discrete Fourier Transform & FFT
DFT as sampled spectrum; FFT algorithm; spectral leakage and windowing
Oppenheim §8
Statistical signal processing
Estimation Theory
MVUE, Cramér–Rao bound, maximum likelihood estimation, bias vs variance
Kay Vol.1 §1–3
Detection Theory
Hypothesis testing, Neyman–Pearson, ROC curves, matched filter
Kay Vol.2 §1–3
Wiener Filter
Optimal linear filter for stationary processes; MMSE estimation
Kay Vol.1 §12
Kalman filtering — the core target
Linear Kalman Filter
State-space model, predict–update cycle, optimal gain, covariance propagation
Kay · Welch & Bishop tutorial
Extended & Unscented Kalman Filter
Linearisation for nonlinear systems; UKF sigma-point approach; orbit determination
Kay · Crassidis & Junkins
Particle Filters
Sequential Monte Carlo; non-Gaussian state estimation; tracking highly nonlinear dynamics
Arulampalam et al. tutorial
Navigation & PNT
GNSS Architecture & Signal Structure
GPS/Galileo/GLONASS signal design; pseudorange, carrier phase, satellite geometry (DOP)
Kaplan & Hegarty §1–4
Spoofing, Jamming & Resilient PNT
Threat taxonomy; detection algorithms; alternative and complementary positioning (IMU, eLoran, LEO PNT)
Kaplan §9 · CISA advisories
Orbit Determination & SSA
Batch least squares, sequential estimation, conjunction analysis — Thomson dynamics + Kalman estimation combined
Vallado · Crassidis & Junkins
Prince — Understanding Deep Learning (MIT Press, 2024) · free PDF at udlbook.github.io
Foundations
Supervised Learning
Input–output mappings, loss functions, empirical risk minimisation
Prince §2
Shallow Neural Networks
One hidden layer, activation functions, universal approximation
Prince §3
Deep Neural Networks
Composing layers, depth vs width, piecewise linear regions
Prince §4
Loss Functions
MSE, cross-entropy, maximum likelihood perspective
Prince §5
Training
Gradient Descent & Backpropagation
SGD, mini-batch, chain rule through computation graphs
Prince §6
Gradients & Initialisation
Vanishing/exploding gradients, He/Xavier init, batch norm
Prince §7
Measuring Performance
Bias–variance tradeoff, train/val/test split, double descent
Prince §8
Regularisation
L1/L2, dropout, data augmentation, early stopping
Prince §9
Architectures
Convolutional Networks
Convolution, pooling, receptive field, translation equivariance
Prince §10
Residual Networks
Skip connections, batch norm, modern CNN architectures
Prince §11
Transformers
Self-attention, multi-head attention, positional encoding, encoder–decoder
Prince §12
Graph Neural Networks
Message passing, node/edge/graph classification, relational inductive bias
Prince §13
Generative models
Unsupervised Learning
Clustering, dimensionality reduction, self-supervised pretraining
Prince §14
Generative Adversarial Networks
Minimax game, training instability, mode collapse, Wasserstein GAN
Prince §15
Normalizing Flows
Bijective mappings, change-of-variables formula, exact likelihood
Prince §16
Variational Autoencoders
Latent variable models, ELBO, reparameterisation trick
Prince §17
Diffusion Models
Forward noising process, denoising score matching, DDPM
Prince §18
Reinforcement learning
Reinforcement Learning
MDP, policy/value functions, Q-learning, policy gradient, RLHF
Prince §19