Stochastic Processes Course
Fall 1399
Instructor: Shahrokh Farahmand
TA: Amir Andalib
Office/Email: 4th Floor of EE Building, Room 431/
[email protected]Office Hours: Saturdays and Mondays 10:30 -12:30
Class Time: Saturdays, Mondays, and Wednesdays 9:00 – 10:30
Class Location: Online via LMS
Textbooks:
1) “Probability and Random Processes with Applications to Signal Processing,” by Henry Stark and John
Woods, 3rd Edition, 2002.
2) “Probability, Random Variables, and Stochastic Processes,” by Athanasios Papoulis and S.
Unnikrishna Pillai, 4th Edition, 2002.
Grading:
1) Final Exam: 5 / 20
2) Midterm Exam: 3 / 20
3) Homework: 4 /20
4) Thursday Quizzes: 8 / 20 (At least 8 Quizzes)
Syllabus:
1) Introduction to probability
Probability space and Kolmogorov axioms
Joint and conditional probabilities
Bayes’ theorem
Bernoulli, Binomial, and Poisson distributions
2) Random variables (RVs)
CDF / PDF
Important densities
Continuous, discrete, mixed RVs
Condition/joint distributions
3) Properties of RVs
Functions of RVs
Expectation and moments
Independent and uncorrelated RVs
Jointly Gaussian RVs
Schwarz, Markov, Chebyshev inequalities
Moment generating function, characteristic function
Chernoff bound
4) Random vectors
Joint CDF/PDF
Expectations and covariance matrices
Properties of covariance matrices
Multi-dimensional Gaussian
Characteristic functions of random vectors
5) Random sequences (RSs)
Definitions
Autocorrelation functions
RSs and LTI systems
Stationarity/Wide sense stationarity
Power spectral density
Markov random sequences /Markov chains
Vector random sequences
Convergence of RSs
Martingales and their convergence
6) Random processes (RPs)
Definitions
Autocorrelation functions
Poisson counting processes
Wiener processes or Brownian motion
Markov random processes
Continuous-time LTI systems and RPs
Stationarity/Wide sense stationarity
Power spectral density
Periodic and cyclostationary processes
Vector processes and state equations
7) Advanced topics
Ergodicity
Karhunen-Loeve (KL) expansion
Representation of bandlimited and periodic processes