Communications and Knowledge Engineering
Institute of Engineering
Paschimanchal Campus
Lamachour , Pokhara
Er. Santosh Kumar Baral
Er. Suraj Basant Tulachan
1.Objectives of Course
2. Course Outline
3. Marking Scheme
4.References
◦ Fundamentals and elements of Digital
Communication System
◦ Concepts of Digital Transmitters, Modulation and
Transmission through band limited channels
◦ Concepts on Random Processes
◦ Concepts and properties of Random Wireless
Channels
◦ Concepts on Information sources and source coding
Theories
◦ Digital Transmission through AWGN channel
◦ Detection and Estimation of signals, optimum
receivers, Rake Receivers, Equalization
◦ Current Trends in Communication System
◦ Principles and performance requirements for a real
world Communication System
◦ Course Code:
◦ Credit Hours: 4
◦ Lecture Hours: 60 Hrs
◦ Attendance : 80% minimum
◦ Class Activity:
Group Activity
Lecture
Presentation of Technical Papers (once a month)
By Lecturer
By Student
Home Assignments (carry certain internal Marks)
Internal Assessments (40 Marks divided)
External Exam (60 Marks)
1. Entropy and Mutual Information
2. Rate Distortion Theory
3. Souce Coding and Information Theory
4. Channel Characterization
5. Detection and Estimation of signal through
Gaussian, Releigh and Ricial Channels
6. Digital Modulation Schemes
1. BPSK, QPSK,TCM,GMSK
7. Digital Transmission of Signal over
1. Band Limited Channels
2. Fading Channels
8. Digital Receiver Techniques
1. Equalizers
2. Rake Receivers
3. Optimum Receivers
Definitions:
◦ probability, union, intersection, Axioms of probability, joint
events and joint probabilities, conditional probabilities, Baye’s
Theorem, Statistic independence, Random variables Discrete
Random variables, Finite Random variable, continuous Random
Variable
Useful Discrete Random Variables
◦ Bernouli Random Variable, Geometric Random variable,
Binomial Random variable, Pascal Random variable, Discrete
Uniform Random variable, Poisson Random Variable
Probability Mass Function(PMF), Cumulative
Distribution Function (CDF), Probability Density
Function(PDF)
Multiple Random Variables, Conditional Probability
Distribution Function,
Functions of Random Variables
Statistical Averages of Random Variables
Variance
Standard Deviations
Covariance
Correlation
Characteristic Functions
Useful Continuous Random Variables
Uniform Random Variable
Erlang Random Variable
Gaussian Random Variable
Chi-Square Distributed Random variable
Rayleigh Random Variable
Rician Random Variable
Nakagami m-distributed Random Variable
Multivariate Gaussian Distribution
◦ Upper Bounds on the Tail Probability
◦ Central Limit Theorem
◦ Sum of Random Variables and Central Limit Theorem
Stochastic Process
Definition,
Stationary Stochastic Process
Averages of stochastic Process
Power Density Spectrum
LTI Response to a Random Input Signal
Cyclostationary Process
Basic Digital Communication System
Information Sources
Source Entropy
Joint and Conditional Entropy
◦ Average Mutual Information
◦ Properties of Mutual Information
◦ Relationship between Entropy and Mutual Information
◦ Conditional Mutual Information
◦ Entropy Rate
◦ The Asymptotic Equipartition Property (AEP)
◦ Differential Entropy
◦ AEP for Random Variables
Properties of Differential Entropy, Relative Entropy and
Mutual Information
◦ Source Coding
Source Coding Theorem
Variable Length coding
Huffman Coding Algorithm
Lampel Ziv Algorithm
◦ Channel Coding
Channel Capacity
Modeling channels
Rate Distortion Theory
Calculation of Rate Distortion Function for Binary and
Gaussian Source
Coding for Analog Source-Optimum Quantization
Quantization
Scalar quatization
Vector quantization
Optimum Receiver For Signals With AWGN
Matched Filter
Optimum Detector
Maximum Liklihood Sequence Detector
Signal Parameter Estimation
Carrier Recovery and Symbol Synchronization
Carrier Phase Estimation
◦ MLE Carrier Phase Estimation
◦ Phase Locked Loop (PLL)
◦ Effect of Additive Noise on Phase Estimate
◦ Decision Directed Loops (DLL)
◦ Decision Feedback PLL (DFPLL)
◦ Non Decision Directed Loops
◦ Squarring Loops
◦ Costas Loop
◦ MLE Timing Estimation
Symbol Timing Estimation
◦ Maximum Likelihood Timing Estimation
Signal Design for Band Limited Channel
◦ Nyquist Pulse Shaping criteria
◦ Representation of Band Pass Signals and Systems
◦ Representation of White Noise
◦ Correlation Demodulator
◦ Matched Filter Demodulation
◦ Optimum Detector
◦ MLE Sequence Detection
1. John G Proakis , Digital Communications, Fifth Edition, Tata
MCGraw-Hill companies, Inc-2008
2. John G Proakis and Masoud Salehi, Communication System
Engineering, Second Edition, Prentice Hall- 2002
