CS4514 – ADVANCED MACHINE LEARNING Department of CSE 2024-2025

CS4514 ADVANCED MACHINE LEARNING LTPC

2 02 3
COURSE OBJECTIVES:
• To understand the basic concepts of machine learning and probability theory.
• To learn the supervised learning and their applications.
• To understand unsupervised learning like clustering and EM algorithms.
• To understand the theoretical and practical aspects of probabilistic graphical models.
• To learn other learning aspects such as reinforcement learning, representation learning, deep
learning, neural networks and other technologies.

UNIT – I INTRODUCTION
6
Machine Learning – Types of Machine Learning – Supervised Learning – Unsupervised Learning –
Basic Concepts in Machine Learning – Machine Learning Process – Weight Space – Testing Machine
Learning Algorithms – A Brief Review of Probability Theory –Turning Data into Probabilities – The
Bias-Variance Trade-off, FIND–S Algorithm, Candidate Elimination Algorithm.

UNIT – II SUPERVISED LEARNING

6
Linear Models for Regression – Linear Basis Function Models – The CO2 189 Bias-Variance
Decomposition – Bayesian Linear Regression – Common Regression Algorithms – Simple Linear
Regression – Multiple Linear Regression – Linear Models for Classification – Discriminant Functions
– Probabilistic Generative Models – Probabilistic Discriminative Models – Laplace Approximation –
Bayesian Logistic Regression – Common Classification Algorithms – k-Nearest Neighbors – Decision
Trees – Random Forest model – Support Vector Machines

UNIT – III UNSUPERVISED LEARNING

6
Mixture Models and EM – K-Means Clustering – Dirichlet Process Mixture Models – Spectral
Clustering – Hierarchical Clustering – The Curse of Dimensionality – Dimensionality Reduction –
Principal Component Analysis – Latent Variable Models (LVM) – Latent Dirichlet Allocation (LDA)

UNIT – IV GRAPHICAL MODELS

6
Bayesian Networks – Conditional Independence – Naive Bayes Classifiers – Markov Chain Monte
Carlo Methods – Sampling – Proposal Distribution – Markov Random Fields – Hidden Markov
Model.

UNIT – V ADVANCED LEARNING

6
Reinforcement Learning – Representation Learning – Neural Networks – Active Learning – Ensemble
Learning – Bootstrap Aggregation – Boosting – Gradient Boosting Machines – Deep Learning.

TOTAL: 30 PERIODS
TEXT BOOKS
1. Ethem Alpaydin, “Introduction to Machine Learning”, MIT Press, Fourth Edition, 2020.
2. Stephen Marsland, ―Machine Learning – An Algorithmic Perspective‖, Second Edition, Chapman
and Hall/CRC Machine Learning and Pattern Recognition Series, 2014.
REFERENCE BOOKS
1. Christopher Bishop, “Pattern Recognition and Machine Learning”, Springer, 2006.
2. Kevin P. Murphy, “Machine Learning: A Probabilistic Perspective”, MIT Press, 2012.
3. Tom Mitchell, “Machine Learning”, McGraw-Hill, 2017.
4. Trevor Hastie, Robert Tibshirani, Jerome Friedman, “The Elements of Statistical Learning”,
Second Edition, Springer, 2008.

Corresponding Lab, with code (If any): CS4514- ADVANCED MACHINE LEARNING LAB

St. Joseph’s Institute of Technology 1

 CS4514 – ADVANCED MACHINE LEARNING Department of CSE 2024-2025

Course Prerequisites: -
COURSE OUTCOMES
Upon the completion of this course, the student will be able to

CO1 Gain knowledge about basic concepts of machine learning techniques and
terminology.
CO2 Develop predictive model based on both input and output data.
CO3 Ability to understand the unsupervised learning algorithm and
dimensionality reduction techniques
CO4 Design systems that use the appropriate graphical models of machine
learning
CO5 Ability to address the problem of learning control strategies for autonomous
agents.

MAPPING BETWEEN CO AND PO, PSO WITH CORRELATION LEVEL 1/2/3

PSO3

PSO4
PO12

PSO2
PO10
PO11

PSO1
PO1
PO2
PO3
PO4
PO5

PO9
PO8
PO7
PO6

Cos
C212.1 2 2 3 2 2 3 - 1 - - - 1 3 3 3 3
C212.2 2 2 3 2 2 3 - 1 - - - 1 3 3 3 3
C212.3 2 2 3 2 2 3 - 1 - - - 1 3 3 3 3
C212.4 2 2 3 2 2 3 - 1 - - - 1 3 3 3 3
C212.5 2 2 3 2 2 3 - 1 - - - 1 3 3 3 3
RELATION BETWEEN COURSE CONTENT WITH COs
UNIT I INTRODUCTION

Knowledg No. of Books

S. No. Course Content e level Hrs to be Referred
handled
1 Machine Learning, Types of Machine BL1 1 T1
Learning
2 Supervised Learning, Unsupervised Learning BL2 1 T1
3 Basic Concepts in Machine Learning BL2 1 T1
4 Machine Learning Process, Weight Space, BL2, 1 T1
Testing Machine Learning Algorithms BL4
5 A Brief Review of Probability Theory BL2, 1 T1
BL4
6 Turning Data into Probabilities BL2 1 T1
7 The Bias-Variance Trade-off BL2 1 T1
8 FIND–S Algorithm BL2, 1 T1
BL5
9 Candidate Elimination Algorithm BL2, 1 T1
BL6

UNIT II SUPERVISED LEARNING

St. Joseph’s Institute of Technology 2

CS4514 – ADVANCED MACHINE LEARNING Department of CSE 2024-2025

Knowledg No. of Books

S. No. Course Content e level Hrs to be Referred
handled
1 Linear Models for Regression, Linear Basis BL2 1 T1
Function Models
2 The Bias-Variance Decomposition, Bayesian BL2 1 T1
Linear Regression
3 Common Regression Algorithms, Simple BL2 1 T1
Linear Regression
4 Multiple Linear Regression BL3,BL4 1 T1
BL2 1 T1
5 Linear Models for Classification
6 Discriminant Functions, Probabilistic BL2 1 T1
Generative Models
7 Probabilistic Discriminative Models, Laplace BL2 1 T1
Approximation
8 Bayesian Logistic Regression BL4 1 T1
9 Common Classification Algorithms BL2 1 T1
10 k-Nearest Neighbors BL5 1 T1
Decision Trees, Random Forest 1 T1
11 BL2,
model
BL4
Support Vector Machines 1 T1
12 BL5
UNIT III UNSUPERVISED LEARNING
No. of Hrs
Knowledg to be Books
S. No. Course Content e level Referred
handled
1 Mixture Models and EM BL2 1 T1
2 K-Means Clustering BL2, 1 T1
BL4
3 Dirichlet Process Mixture Models BL2, 1 T1
BL4
4 Spectral Clustering, Hierarchical Clustering BL2, 1 T1
BL4
5 The Curse of Dimensionality BL5 1 T1
6 Dimensionality Reduction BL4 1 T1
7 Principal Component Analysis BL4 1 T1
8 Latent Variable Models (LVM) BL5 1 T1
9 Latent Dirichlet Allocation (LDA) BL5 1 T1

UNIT IV GRAPHICAL MODELS

No. of
Knowledg Books
S. No. Course Content Hrs to be
e level Referred
handled
1 Bayesian Networks BL1,BL2 1 T2
2 Conditional Independence BL2 1 T2
3 Naive Bayes Classifiers BL3 1 T2
4 Markov Chain Monte Carlo Methods BL2, 1 T2
BL4
5 Sampling BL2 1 T2
6 Proposal Distribution BL2 1 T2
Markov Random Fields 1 T2
7 BL5
8 Hidden Markov Model. BL6 1 T2
St. Joseph’s Institute of Technology 3
CS4514 – ADVANCED MACHINE LEARNING Department of CSE 2024-2025

UNIT V ADVANCED LEARNING

No. of
Knowledg Hrs to be Books
S. No. Course Content e level Referred
handled
1 Reinforcement Learning, Representation BL2 1 T2
Learning
2 Neural Networks BL2 1 T2
3 Active Learning BL2 1 T2
4 Ensemble Learning BL5 1 T2
5 Bootstrap Aggregation BL4 1 T2
6 Boosting BL2 1 T2
1 T2
7 Gradient Boosting Machines BL2
8 Deep Learning BL2 1 T2

BL - Bloom’s Taxonomy Levels (1- Remembering, 2- Understanding, 3 - Applying, 4 -

Analyzing, 5 - Evaluating, 6 - Creating

St. Joseph’s Institute of Technology 4