Department of Computer Science & Engineering (SB-ET)
III B. Tech -I Semester
MACHINE LEARNING
SUBJECT CODE: 22PCOAM16
AcademicYear : 2023-2024
by
Dr. M.Gokilavani
GNITC
05/19/2025 1
Department of CSE (SB-ET)
22PCOAM16 MACHINE LEARNING
UNIT – I
Syllabus
Learning - Types of Machine Learning - Supervised Learning - The
Brain and the Neuron - Design a Learning System - Perspectives and
Issues in Machine Learning - Concept Learning Task - Concept
Learning as Search - Finding a Maximally Specific Hypothesis -
Version Spaces and the Candidate Elimination Algorithm - Linear
Discriminants: Perceptron - Linear Separability - Linear
Regression.
05/19/2025 Department of CSE (SB-ET) 2
UNIT - I LECTURE - 01
TEXTBOOK:
• Stephen Marsland, Machine Learning - An Algorithmic Perspective, Second Edition,
Chapman and Hall/CRC.
• Machine Learning and Pattern Recognition Series, 2014.
REFERENCES:
• Tom M Mitchell, Machine Learning, First Edition, McGraw Hill Education, 2013.
• Ethem Alpaydin, Introduction to Machine Learning 3e (Adaptive Computation and
Machine
No of Hours Required: 13
05/19/2025 3
Department of CSE (SB-ET)
UNIT - I What is Learning? LECTURE - 01
• Machine learning is a subset of AI, which enables the machine to
automatically learn from data, improve performance from past
experiences, and make predictions.
• Machine learning contains a set of algorithms that work on a huge
amount of data.
• Data is fed to these algorithms to train them, and on the basis of
training, they build the model & perform a specific task.
05/19/2025 Department of CSE (SB-ET) 4
UNIT - I LECTURE - 01
How does machine learning work?
• Machine learning algorithms are molded on a training dataset to
create a model.
• As new input data is introduced to the trained ML algorithm, it uses
the develop model to make a prediction.
• The prediction is checked for accuracy.
• Based on its accuracy, the ML algorithm is either deployed or trained
repeatedly with an augmented training dataset until the desired
accuracy is achieved.
05/19/2025 Department of CSE (SB-ET) 5
UNIT - I LECTURE - 01
05/19/2025 Department of CSE (SB-ET) 6
UNIT - I Types of Machine Learning LECTURE - 01
• Machine Learning Algorithms can be trained in many ways, with each
method having its pros and cons. Based on these methods and ways of
learning, machine learning is broadly categorized into four main types:
05/19/2025 Department of CSE (SB-ET) 7
UNIT - I Supervised Learning LECTURE - 01
• Supervised learning is defined as when a model gets trained on
a “Labelled Dataset”.
• Labelled datasets have both input and output parameters.
• In Supervised Learning algorithms learn to map points between
inputs and correct outputs.
• It has both training and validation datasets labelled.
05/19/2025 Department of CSE (SB-ET) 8
UNIT - I Eg: Supervised Learning LECTURE - 01
05/19/2025 Department of CSE (SB-ET) 9
UNIT - I LECTURE - 01
Supervised Learning
There are two main categories of supervised learning that are mentioned
below:
• Classification
• Regression
05/19/2025 Department of CSE (SB-ET) 10
UNIT - I Classification LECTURE - 01
• Classification deals with predicting categorical target variables, which represent discrete
classes or labels.
• For instance, classifying emails as spam or not spam, or predicting whether a patient has a high
risk of heart disease.
• Classification algorithms learn to map the input features to one of the predefined classes.
Here are some classification algorithms:
• Logistic Regression
• Support Vector Machine
• Random Forest
• Decision Tre
• K-Nearest Neighbors (KNN)
• Naive Bayes
05/19/2025 Department of CSE (SB-ET) 11
UNIT - I Regression LECTURE - 01
• Regression, on the other hand, deals with predicting continuous target variables,
which represent numerical values.
• For example, predicting the price of a house based on its size, location, and amenities,
or forecasting the sales of a product.
• Regression algorithms learn to map the input features to a continuous numerical value.
Here are some regression algorithms:
• Linear Regression
• Polynomial Regression
• Ridge Regression
• Lasso Regression
• Decision tree
• Random Forest
05/19/2025 Department of CSE (SB-ET) 12
UNIT - I LECTURE - 01
Advantages of Supervised Machine Learning
• Supervised Learning models can have high accuracy as they are
trained on labelled data.
• The process of decision-making in supervised learning models is often
interpretable.
• It can often be used in pre-trained models which saves time and
resources when developing new models from scratch.
05/19/2025 Department of CSE (SB-ET) 13
UNIT - I LECTURE - 01
Disadvantages of Supervised Machine Learning
• It has limitations in knowing patterns and may struggle with unseen or
unexpected patterns that are not present in the training data.
• It can be time-consuming and costly as it relies on labeled data only.
• It may lead to poor generalizations based on new data.
05/19/2025 Department of CSE (SB-ET) 14
UNIT - I LECTURE - 01
Applications of Supervised Learning
• Medical diagnosis: Detect diseases and other medical conditions.
• Fraud detection: Identify fraudulent transactions.
• Autonomous vehicles: Recognize and respond to objects in the
environment.
• Email spam detection: Classify emails as spam or not spam.
• Quality control in manufacturing: Inspect products for defects.
• Credit scoring: Assess the risk of a borrower defaulting on a loan.
• Gaming: Recognize characters, analyze player behavior, and create NPCs.
05/19/2025 Department of CSE (SB-ET) 15
UNIT - I Unsupervised Learning LECTURE - 01
• Unsupervised learning is a type of machine learning technique in
which an algorithm discovers patterns and relationships
using unlabeled data.
• The primary goal of Unsupervised learning is often to discover hidden
patterns, similarities, or clusters within the data, which can then be
used for various purposes, such as data exploration, visualization,
dimensionality reduction, and more.
05/19/2025 Department of CSE (SB-ET) 16
UNIT - I Eg: Unsupervised Learning LECTURE - 01
05/19/2025 Department of CSE (SB-ET) 17
UNIT - I LECTURE - 01
Unsupervised Learning
There are two main categories of unsupervised learning that are
mentioned below:
• Clustering
• Association
05/19/2025 Department of CSE (SB-ET) 18
UNIT - I Clustering LECTURE - 01
• Clustering is the process of grouping data points into clusters based
on their similarity.
• This technique is useful for identifying patterns and relationships in
data without the need for labeled examples.
Here are some clustering algorithms:
• K-Means Clustering algorithm
• Mean-shift algorithm
• DBSCAN Algorithm
• Principal Component Analysis
• Independent Component Analysis
05/19/2025 Department of CSE (SB-ET) 19
UNIT - I Association LECTURE - 01
• Association rule learning is a technique for discovering relationships
between items in a dataset.
• It identifies rules that indicate the presence of one item implies the
presence of another item with a specific probability.
Here are some association rule learning algorithms:
• Apriori Algorithm
• Eclat
• FP-growth Algorithm
05/19/2025 Department of CSE (SB-ET) 20
UNIT - I LECTURE - 01
Advantages of Unsupervised Learning
• It helps to discover hidden patterns and various relationships between
the data.
• Used for tasks such as customer segmentation, anomaly
detection, and data exploration.
• It does not require labeled data and reduces the effort of data labeling.
05/19/2025 Department of CSE (SB-ET) 21
UNIT - I LECTURE - 01
Disadvantages of Unsupervised Learning
• Without using labels, it may be difficult to predict the quality of the
model’s output.
• Cluster Interpretability may not be clear and may not have meaningful
interpretations.
• It has techniques such as auto encoders and dimensionality reduction
that can be used to extract meaningful features from raw data.
05/19/2025 Department of CSE (SB-ET) 22
UNIT - I LECTURE - 01
Application of Unsupervised Learning
• Clustering: Group similar data points into clusters.
• Anomaly detection: Identify outliers or anomalies in data.
• Dimensionality reduction: Reduce the dimensionality of data while
preserving its essential information.
• Exploratory data analysis (EDA): Explore data and gain insights
before defining specific tasks.
05/19/2025 Department of CSE (SB-ET) 23
UNIT - I Reinforcement Learning LECTURE - 01
• Reinforcement machine learning algorithm is a learning method that
interacts with the environment by producing actions and discovering
errors.
• Trial, error, and delay are the most relevant characteristics of
reinforcement learning.
• In this technique, the model keeps on increasing its performance using
Reward Feedback to learn the behavior or pattern.
05/19/2025 Department of CSE (SB-ET) 24
UNIT - I Types of Reinforcement Learning LECTURE - 01
There are two main types of reinforcement learning:
• Positive reinforcement
• Rewards the agent for taking a desired action.
• Encourages the agent to repeat the behavior.
• Examples: Giving a treat to a dog for sitting, providing a point in a game
for a correct answer.
• Negative reinforcement
• Removes an undesirable stimulus to encourage a desired behavior.
• Discourages the agent from repeating the behavior.
• Examples: Turning off a loud buzzer when a lever is pressed, avoiding a
penalty by completing a task.
05/19/2025 Department of CSE (SB-ET) 25
UNIT - I LECTURE - 01
Advantages of Reinforcement Learning
• It has autonomous decision-making that is well-suited for tasks and
that can learn to make a sequence of decisions, like robotics and game-
playing.
• This technique is preferred to achieve long-term results that are very
difficult to achieve.
• It is used to solve a complex problems that cannot be solved by
conventional techniques.
05/19/2025 Department of CSE (SB-ET) 26
UNIT - I LECTURE - 01
Disadvantages of Reinforcement Learning
• Training Reinforcement Learning agents can be computationally
expensive and time-consuming.
• Reinforcement learning is not preferable to solving simple problems.
• It needs a lot of data and a lot of computation, which makes it
impractical and costly.
05/19/2025 Department of CSE (SB-ET) 27
UNIT - I LECTURE - 01
Applications of Reinforcement Learning
• Game Playing: RL can teach agents to play games, even complex
ones.
• Robotics: RL can teach robots to perform tasks autonomously.
• Autonomous Vehicles: RL can help self-driving cars navigate and
make decisions.
05/19/2025 Department of CSE (SB-ET) 28
UNIT - I Semi-Supervised Learning LECTURE - 01
Supervised + Unsupervised Learning
• Semi-Supervised learning is a machine learning algorithm that works
between the supervised and unsupervised learning so it uses
both labelled and unlabelled data.
• It’s particularly useful when obtaining labeled data is costly, time-
consuming, or resource-intensive.
05/19/2025 Department of CSE (SB-ET) 29
UNIT - I Semi-Supervised Learning LECTURE - 01
05/19/2025 Department of CSE (SB-ET) 30
UNIT - I LECTURE - 01
Types of Semi-Supervised Learning Methods
• Graph-based semi-supervised learning
• Label propagation
• Co-training
• Self-training
• Generative adversarial networks (GANs)
05/19/2025 Department of CSE (SB-ET) 31
UNIT - I LECTURE - 01
Advantages of Semi- Supervised Learning
• It leads to better generalization as compared to supervised
learning, as it takes both labeled and unlabeled data.
• Can be applied to a wide range of data.
05/19/2025 Department of CSE (SB-ET) 32
UNIT - I LECTURE - 01
Disadvantages of Semi- Supervised Learning
• Semi-supervised methods can be more complex to implement
compared to other approaches.
• It still requires some labeled data that might not always be available
or easy to obtain.
• The unlabeled data can impact the model performance accordingly.
05/19/2025 Department of CSE (SB-ET) 33
UNIT - I LECTURE - 01
Applications of Semi-Supervised Learning
• Image Classification and Object Recognition
• Natural Language Processing (NLP)
• Speech Recognition
• Recommendation Systems
• Healthcare and Medical Imaging
05/19/2025 Department of CSE (SB-ET) 34
UNIT - I LECTURE - 01
Topics to be covered in next session 2
• The Brain and the Neuron
Thank you!!!
05/19/2025 Department of CSE (SB-ET) 35
