Introduction to

Soft Computing
Nandana Prabhu
 Introduction
Concept of Computing:

•f is mapping function or formal method or algorithm to solve a problem

19/06/2025 Soft computing 2
 Introduction
Characteristics of Computing:
• The method or algorithm should provide precise solution.
• Control action should be unambiguous and accurate.
• Easy to model mathematically.

19/06/2025 Soft computing 3

 Introduction
Hard Computing: (In 1996, L. A Zadek)
• Result is precise
• Control action should be unambiguous
• Can be modelled mathematically /using an algorithm

• Eg: Area of triangle, roots of equation

• Searching and sorting techniques
• Solving computational geometry problems(Route to reach a destination
,Given a set of pair of points, finding the closest)

19/06/2025 Soft computing 4

 Introduction
Earlier computational methods could model and precisely analyze
only relatively simple systems.
But today the scenario is different. In the fields of medicine
,biology, humanities , management services these methods are
intractable to conventional and analytical methods
In todays world, we have
➢ huge volumes of data generated

➢ various technologies, supported by internet service

Which put forth various challenges to provide solutions to real

time applications

19/06/2025 Soft computing 5

•
 Introduction
Soft Computing
It refers to a collection of computational techniques in computer
science, artificial intelligence, machine learning and some
engineering disciplines ,that attempt to model and analyze very
complex systems .

Origin of Soft computing: Prof. Lotfi Zadeh

Paper on Fuzzy sets-1965
Paper on Analysis of complex systems and decision processes-1973
Report on possibility theory and soft data analysis -1979
(paper1981)
22/05/2025 IQAC Meeting _External 6
 Introduction

Lotfi A. Zadeh – “Father of Soft Computing”

“Soft Computing is an emerging approach to computing which parallel the
remarkable ability of the human mind to reason and learn in an environment
of uncertainty and imprecision”. – Lotfi A. Zadeh
19/06/2025
• Softcomputig 7
 Introduction
Soft Computing
It refers to a collection of computational techniques which are
tolerant to imprecision , uncertainty ,partial truth and
approximation to achieve tractability, robustness and low cost
solution.
Soft Computing is the fusion of methodologies designed to model
and enable solutions to real world problems, which are not
modeled or too difficult to model mathematically.

The role model for soft computing is human mind.

Softcomputig
22/05/2025 8
 Introduction
The AIM of SC are :
Exploit the tolerance for imprecision, uncertainty, partial truth and
approximation to achieve tractability, robustness and low cost
solution i.e.
Approximation : here the model features are similar to the real ones, but not the
same.
Uncertainty : here we are not sure that the features of the model are the same
as that of the entity (belief).
Imprecision : here the model features (quantities) are not the same as that of
the real ones,but close to them.

Softcomputig
19/06/2025 9
 Introduction
Properties of soft computing:
• It is used to solve real life problems (decision making,
management etc.)
• It is very flexible and not rigid.
• It is soft because it can be redesigned according to the
requirement of the problem.
• It is adaptive in changing environment and can learn to do better
• It is cost effective.

Softcomputig
19/06/2025 10
 Introduction
Characteristics of Soft Computing:
• It does not require any mathematical modeling for problem solving
• Solutions may not be precise
• Algorithms are adaptive
• it can adjust to the change of dynamic environment.
• Uses methodologies that are inspired by human intelligence and nervous
system, genetics, evolution processes, particles swarming etc.

Softcomputig
22/06/2025 11
 Introduction
The principal constituents of SC are :
➢ Fuzzy Logic

➢ Neural Networks

➢ Machine Learning

➢ Deep learning

➢ Evolutionary Computation

➢ Genetic Algorithm

➢ Genetic programming

➢ Swarm Intelligence

➢ Probabilistic Reasoning

Softcomputig
22/06/2025 12

•
 Introduction
The three main components of SC are :

➢ Fuzzy Logic - for knowledge representation via fuzzy If – Then rules

➢ Neural Networks- for learning and adaptation

➢ Genetic Algorithm - for evolutionary computation

In principle, the constituent methodologies in Soft computing are complementary

rather than competitive.

Softcomputig
22/06/2025 13
 Introduction
Handwritten character recognition:
(Neural Networks)

Image source: Lecture Dr Debasis Semanta,

NPTEL course: Introduction to Softcomputing
Softcomputig
22/06/2025 14
 Introduction
Eg: Bank with maximum returns on Deposits:
(Evolutionary Algorithms)

Image source: Lecture Dr Debasis Semanta,

NPTEL course: Introduction to Softcomputing
Softcomputig
22/06/2025 15
 Introduction
Eg: Robot find the route to reach destination:
(Fuzzy logic based Control design)

Image source: Lecture Dr Debasis Semanta,

NPTEL course: Introduction to Softcomputing
Softcomputig
22/06/2025 16
 Introduction
Eg: Watermark detection and extraction

Softcomputig
22/06/2025 17
 Introduction
Eg: Text summarization::Machine learning and probabilistic reasoning

Summary
Soft computing is the use
of approximate
calculations to provide
imprecise but usable
solutions to complex
computational problems.

22/05/2025 IQAC Meeting _External 18

 Introduction
:
Soft Computing
How a student learns from teacher:
This ia how brain works
Based on this the artificial network is used to solve problems

How the world choses the best

Genetic algorithm is based on this phenomenon
Population is synonymous to Population
Choosing is the best is synonymous to optimal solution

Softcomputig
22/06/2025 19
 Introduction
Computing paridygm shift:

Softcomputig
22/06/2025 20
 Sardcomputng and Softcomputing

• Hard Computing Soft Computing

It uses precisely stated analytical It is tolerant to imprecision,

model. uncertainty, partial truth and
approximation.
It is based on binary logic and crisp It is based on fuzzy logic and
systems. probabilistic reasoning.
It has features such as precision and It has features such as approximation
categoricity. and dispositionality.
It is deterministic in nature. It is stochastic in nature.

It can work with exact input data. It can work with ambiguous and noisy
data.
It performs sequential computation. It performs parallel computation.

It produces precise outcome. It produces approximate outcome.

Source Lecture video of Dr Debasis Semanta,

NPTEL
22/06/2025 Soft Computing 21
 Introduction
Other Characteristics of Soft Computing:
•Human Expertise
•Biologically inspired computing models
•New optimization techniques
•Numerical Computation
•New application domains
•Model free learning
•Intensive Computation
•Fault tolerance
•Goal driven Characteristics
•Real worls application
Neuro fuzzy and soft computing by Jang pg7-8

Softcomputig
22/06/2025 22
 Introduction
Other applications:
• Handwritten Script Recognition using Soft Computing:
• It is one of the demanding parts of computer science.
• It can translate multilingual documents and sort the various scripts
accordingly.
• Block –level technique concept is used by the system to recognize the script
from several script document given. To classify the script according to their
features, it uses Discrete Cosine Transform (DCT) and Discrete Wavelet
Transform (DWT) together.

22/05/2025 IQAC Meeting _External 23

 Introduction
Other applications:
Use of Soft Computing in Automotive Systems and Manufacturing:
• Automobile industry has also adapted soft computing to solve some of
themajor problems.
• Classic control methods is built in vehicles using the Fuzzy logic techniques.
• It takes the example of human behavior, which is described in the forms of
rule – “If-Then “statements.
• The logic controller then converts the sensor inputs into fuzzy variables that
are then defined according to these rules. Fuzzy logic techniques are used in
engine control, automatic transmissions, antiskid steering, etc.

22/05/2025 24
 Introduction
Other applications:
Soft Computing Techniques in Power System Analysis:
Soft computing uses the method of Artificial Neural Network (ANN) to
predict any instability in the voltage of the power system. Using the ANN,
the pending voltage instability can be predicted.
The methods which are deployed here, are very low in cost.

22/05/2025 Softcomputing 25
 Introduction
Other applications:
Soft Computing in Investment and Trading:
• The data present in the finance field is in opulence and traditional computing
is not able to handle and process that kind of data.
• There are various approaches done through soft computing techniques that
help to handle noisy data.
• Pattern recognition technique is used to analyse the pattern or behaviour
of the data and time series is used to predict future trading points..

22/06/2025 SC 26
 Conclusion
Computing
Hard computing and Soft computing
Field of Soft computing:
• Evolving rapidly
• New techniques and applications are constantly being proposed

• The underlying driving force is to construct highly automated ,intelligent machines

for better tomorrow

Softcomputig
22/06/2025 27
 References
References:
• Neuro-fuzzy and soft computing, J.S.R. Jang, C. T. Sun and E. Mizutani,
Prentice Hall of India, 2004
• Principles of Soft Computing, S.N. Sivanandam, S. N. Deepa, Wiley, 3rd ,
2019
• Neural Networks, Fuzzy Logic and Genetic Algorithms , S Rajashekaran, G A
Vijayalakshmi Pai

07/06/2025 SC 28
 Introduction

Softcomputig
22/06/2025 29
 Introduction

Softcomputig
22/06/2025 30
 Hard Computing Vs Soft Computing

Source Lecture video of Dr Debasis Semanta,

Soft computig NPTEL
22/06/2025 31
 Soft Computing Vs Hard Computing

Source Lecture video of Dr Debasis Semanta, NPTEL

Softcomputig
22/06/2025 32
 Neural Networks

22/06/2025 Soft Computing 33

 Introduction
Neural networks:

➢ It is composed of large number of highly interconnected processing

elements(neurons) working in unison to solve specific problems
➢ It is an information processing model that is inspired by the way biological neuron
system such as brain ,process information
➢ Is a processing device ,either algorithm or actual hardware ,whose design was
inspired by design and functioning of brains and components thereof
➢ They learn by example, which makes them very flexible and powerful
➢ Well suited for real world applications as they have fast response and
computational time because of their parallel architecture

SC
22/06/2025 34
 Neural networks
Advantages of Neural networks:

Adaptive learning: it is endowed with the ability to learn how to do tasks

based on data given for training or initial experience

Self Organization: Can create its own organization or representation of the

information it receives during learning time

Real time operation: may be carried out in parallel

Fault tolerance via redundant information coding: Partial destruction of NN

leads to corresponding degradation of performance. However, some network
capabilities may be retained even
Softafter major network damage
computing
22/06/2025 35
 Neural networks
Applications of Neural networks:
➢ Handwriting
➢ Air traffic control
➢ Machinery control
➢ Medical diagnosis
➢ Fraud detection
➢ River water levels
➢ voice recognition
➢ Weather prediction
➢ Employee hiring
➢ Retail inventory optimization
Soft computing
22/05/2025 36
 Fuzzy Logic

22/06/2025 Soft Computing 37

 Fuzzy Logic:

Fuzzy Logic:
➢ In the real world there exists much fuzzy knowledge, that is, knowledge which
is vague, imprecise, uncertain, ambiguous, inexact, or probabilistic in nature.
➢ Human thinking and reasoning frequently involves fuzzy information.
➢ The classical computing system involves two valued logic (true/false, 1/0,
yes/no).
➢ This system sometimes may not be able to answer some questions as human
does, as they do not have complete true answer.
➢ The computing system is not just expected to give answers like human but
also describe the reality level calculated with the imprecision and uncertainty
of the facts and rules applied.

22/05/2025 Soft computing 38

 Fuzzy Logic
Fuzzy Logic:
Lofti Zadeh observed that the classical computing system was not capable to
handle subjective data representation or unclear human ideas.
In 1965, he introduced fuzzy set theory as the extension of classical set theory
where elements have degrees of memberships.
It allows to determine the distinctions among the data that is neither true nor
false. It is like process of human thinking like very hot, hot, warm, little warm,
cold, too cold.
In classical system, 1 represents absolute truth value and 0 represents absolute
false value. But in the fuzzy system, there is no logic for absolute truth and
absolute false value. But in fuzzy logic, there is intermediate value too present
which is partially true and partially false. i.e multivalued
22/06/2025
Soft computing
39
 Fuzzy Logic
Fuzzy Logic::
• Fuzzy Logic (FL) is a method of reasoning that resembles human
reasoning.
• The approach of FL imitates the way of decision making in humans that
involves all intermediate possibilities between digital values YES and NO
• It is an organized method for dealing with imprecise data.
• The data are considered as Fuzzy set

22/05/2025
Soft computing
40
 Fuzzy Logic
Characteristics of Fuzzy Logic::

1. It is flexible and easy to implement.

2. It helps to represent the human logic.
3. It is highly suitable method for uncertain or approximate learning.
4. It views inference as a process of propagating elastic constraints.
5. It allows you to build nonlinear functions of arbitrary complexity

22/06/2025
Soft computing
41
 Fuzzy Logic
When not to use Fuzzy Logic::

1. If it is inconvenient to map an input space to an output space.

2. When the problem can be solved using common sense.
3. When many controllers can do the fine job, without the use of fuzzy logic

22/062025
Soft computing
42
 Fuzzy Logic
Advantages of Fuzzy Logic::
• Its structure is easy and understandable.
• It is used for commercial and practical purposes.
• It helps to control machines and consumer products.
• It offers acceptable reasoning. It may not offer accurate reasoning.
• In data mining it helps you to deal with uncertainty.
• It is mostly robust as no precise inputs are required.
• It can be programmed to in the situation when feedback sensor stops working.
• Performance of the system can be modified or altered by using inexpensive
sensors to keep the overall system cost and complexity low.
• It provides a most effective solution to complex issues.
22/05/2025
Soft computing
43
 Fuzzy Logic
Disadvantages of Fuzzy Logic:
• The results of the system may not be widely accepted as the fuzzy logic is
not always accurate.
• It does not have the capability of machine learning as-well-as neural network
type pattern recognition.
• Extensive testing with the hardware is needed for validation and verification
of a fuzzy knowledge-based system.
• It is difficult task to set exact, fuzzy rules and membership functions.

22/06/2025
Soft computing
44
 Boolean Algebra Vs Fuzzy logic

Similarity:
Boolean logic results are returned bt FL operations, when all fuzzy membershios are
restricted to 0 and 1

Dissimilarity:
It is permissive of natural language processing and more like human thinking
It is based on degrees of truth
It allows partial membership
It is multivalued logic that allows intermediate values to be defined

22/06/2025
SC 45
 Fuzzy Logic

22/06/2025
SC 46
 Fuzzy Logic

• Applications:
• Automotive Systems: Automatic Gearboxes, Four-Wheel Steering, Vehicle
environment control.
• Consumer Electronic Goods: Photocopiers, Still and video cameras,
television.
• Domestic Goods: Refrigerators, Vacuum cleaners, Washing Machines.
Environment Control: Air conditioners, Humidifiers.

22/06/2025
SC 47
 Fuzzy Logic

• FL is a problem solving control system methodology based that lends itself to

implementation in systems ranging from simple small embedded
microcontrollers to large, networked , multichannel PC or workstation-based
data acquisition and control systems.
• It can be implemented in hardware, software or combination of both
• It provides a way to arrive at a definite conclusion based upon vague,
ambiguous

22/06/2025
Soft computing
48
 Genetic Algorithm

22/06/2025 Soft Computing 49

 Genetic Algorithms

Introduction:
Genetic Algorithms initiated and developed in the early 1970’s by John Holland
are unorthodox search and optimization algorithms, which mimic some of the
process of natural evolution.
Gas are adaptive computational procedures modelled on the mechanics of
natural genetic systems.
They express their ability by efficiently exploiting the historical information to
speculate on new offspring with expected improved performance.

22/06/2025
SC 50
 Genetic Algorithms
Genetic Algorithm:

Genetic Algorithms is reminiscent of reproduction in which the genes of two

parents combine to form those of their children
This method is very effective at finding optimal or near optimal solution to a wide
variety of problems because it does not impose many limitations required by
traditional methods
It is an iterative process with only 3 basic operations:
➢ Selection
➢ Crossover
➢ Mutation
Moreover they use only payoff function(fitness) and probabilistic transition ruls
for moving to next iteration.
22/06/2025
SC 51
 Genetic Algorithms
Benefits:
• Easy to understand.
• We always get an answer and the answer gets better with time.
• Good for noisy environment.
• Flexible in forming building blocks for hybrid application.
• Has substantial history and range of use.
• Supports multi-objective optimization.
• Modular, separate from application.
• Inherently parallel and easily distributed
• Easy to exploit for previous or alternate solutions
22/05/2025
Soft computing
52
 Genetic Algorithms

Applications:
Scheduling: manufacturing, resource allocation
Design : Semiconductor layout, communication networks
Robotics: Trajectory planning
Signal processing: Filtering

22/06/2025
Soft computing
53
 Genetic Algorithms
How is it different from Normal optimization and search:

• It works with coding of the parameter set, not with the

parameter themselves
• It works simultaneously with multiple points, not a single point
• It searches via sampling (a blind search) using only the payoff
information
• It searches using stochastic operations ,not deterministic rules

22/06/2025
SC 54
 Integration of NN, FL and GAs:

They are soft computing methods which have been inspired by biological
computational processes and nature’s problem solving strategies..

NNs are highly simplified models of human nervous system which mimic our
ability to adapt to circumstances and learn from past experience.

Fuzzy logic systems address the imprecision or vagueness in the input output
descriptions of systems using fuzzy sets. Fuzzy sts have no crisp boundaries and
provide a gradual transition between membership and non member ship of
elements in asset

GAs inspired by the process of biological evolution, are adaptive search and
optimization algorithms
22/05/2025
SC 55
 Integration of NN, FL and GAs:

➢ Each have their own right and merit

➢ Attempts have been made to synergize the 3 different
technologies.
➢ The objective is to overcome the weakness by strength of other
by appropriately integrating them.
➢ Hybridization should only be performed for investigating better
methods of solving

22/05/2025
Soft computing
56
 Hybrid systems
Introduction:
NN, FL and GA are three distinct methodologies each with its own
advantages and disadvantages.
Therefore, it is appropriate that hybridization of the technologies
is attempted to overcome the weaknesses of one with the
strengths of the other.

22/06/2025
Soft computing
57
 Hybrid systems:

Hybrid systems are those for which more than on technology is

applied to solve the problem

They have been classified as:

➢ Sequential Hybrid systems

➢ Auxillary Hybrid systems

➢ Embedded Hybrid systems

22/06/2025
Soft computing
58
 Hybrid systems
Sequential Hybrid systems:
• Make use of technologies in a pipeline like fashion
• One technologies output becomes input to another
• One of the weakest form of hybridization
Input Output

A B

• Eg. A GA processor which obtains the optimal parameters for

different instances of a problem and hands over the
preprocessed data to a NN for further processing
22/06/2025
Soft computing
59
 Hybrid systems
Auxillary Hybrid systems:
• One technology calls the other as subroutine to process or
manipulate information needed by it.
• The second one processes this information and hands it over
for further use Output
Input
A

B
• Neuro genetic system in which an NN employs a GA to optimize
Its structural parameters i.e. parameters which defines its .
architecture
21/06/2025
SC 60
 Introduction
Embedded Hybrid systems:
The technologies participating are integrated in such a manner
that they appear intertwined.
The fusion is such that no technology can be used without other
for solving the problem
Input
Output
A B

NN- FL hybrid system may have an NN which receives fuzzy inputs,

processes it and extracts fuzzy outputs as well
22/06/2025
SC 61
 NN _Fuzzy Hybrid systems:
Introduction :
Most researched form
Both represent two distinct technologies to deal with uncertainty.
Each have their own merits and demerits
Two ways:
• NNs with fuzzy capabilities, thereby increasing the networks
expressiveness and flexibility to adopt to uncertain
environments.
• To apply neuronal learning capabilities to fuzzy systems to
make the fuzzy systems more adaptive to changing
environments
22/06/2025
SC 62
 NN _Fuzzy Hybrid systems
NN _Fuzzy Hybrid systems by processing data samples:
• NN-Fuzzy combines the Advantages of fuzzy systems, which deal
with explicit knowledge that can be explained And understood
and neural networks, which deal with implicit knowledge of the
expert and automatically generate additional fuzzy rules and
membership functions to meet certain specifications
• It helps to reduce design time and costs
• On the other hand, Fuzzy logic enhances the generalization
capability of a NN system by providing more reliable output when
extrapolation is needed beyond the limits of training data.

22/05/2025
SC 62
 NN _Fuzzy Hybrid systems
Is a fuzzy system which uses learning algorithm derive from NN to
determine its parameters
It refers to combination of fuzzy set theory and neural networks
having advantages of both such as:
1. Can handle any kind of information (numeric, logical, lingual)
2. Can manage imprecise, partial, vague or imperfect information
3. Can resolve conflict by collaboration and aggregation
4. Has self learning self organizing and self tuning capabilities
5. Doesnt need prior knowledge of relationship of data
6. Can mimic human decision making process
7. Makes computation fast by fuzzy number operations
22/06/2025
Soft computing
64
 NN _Genetic Hybrid syatems
NN _Genetic Hybrid :
GAs is applied to NN in several ways,
topology optimization:
Is used to select a topology(number of hidden layers,no of hdden
nodes interconnection pattern)
genetic training : learning of an ANN is formulated as a weight
optimization problem,usually using the inverse MSE as a fitness
measure
control parameter optimization: Control parameters such as
learning rate, momentum rate, tolerance level can be optimized
using Gas
22/06/2025
Soft computing
65
 NN_Genetic Hybrid systems:

1. The parameters of neural networks are encoded by genetic algorithms as a

string of properties of the network, that is, chromosomes. A large population
of chromosomes is generated, which represent the many possible parameter
sets for the given neural network.
2. Genetic Algorithm- Neural Network, or GANN, has the ability to locate the
neighborhood of the optimal solution quickly, compared to other
conventional search strategies
.

22/06/2025
Soft computing
66
 Fuzzy Genetic Hybrid systems
Fuzzy Genetic Hybrid systems
The optimization capabilities of GAs are
.used to develop the best set of rules to be used by fuzzy inference
engine
.To optimize the choice of membership function

22/06/2025
Soft computing
67
 References
• Neuro-fuzzy and soft computing, J.S.R. Jang, C. T. Sun and E. Mizutani,
Prentice Hall of India, 2004
• Principles of Soft Computing, S.N. Sivanandam, S. N. Deepa, Wiley, 3rd ,
2019 (Chapter 1)
• Neural Networks, Fuzzy Logic and Genetic Algorithms , S Rajashekaran, G A
Vijayalakshmi Pai ( Chapter 10)
• Introduction to ANN by Zurada, Jaico publications (Chapter 1)
• NPTEL Online course ”I ntroduction to SC” by Dr Debasis Samanta ,IIT
Kharagpur

07/06/2025 SC 68