LECTURE NOTES ON
SOFT COMPUTING
BY
RAYEES AHAMAD
([email protected])
Text Book:Neuro Fuzzy and Soft
Computing by J.S.R.Jang and
C.T.Sun,Prentice Hall.
Reference Books:Fuzzy logic with
Engg App,Timothy J Ross,Wiley Pub.
Soft Computing and Its application,Vol
1 K.S.Ray,Apple Academic Press.
First Course on Fuzzy Theory
and App.K.H.Lee,Spinger.
Fuzzy Set theory and its
app,H.Z.Zimmermann,spinger
Science
WHAT IS COMPUTING ?
Computing is any activity that uses
computers to manage, process, and
communicate information. It includes
development of both hardware and
software. Computing is a critical,
integral component of modern
industrial technology. Major computing
disciplines include
computer engineering,
software engineering,
The idea behind soft computing is to model cognitive
behavior of human mind.
Soft computing is foundation of conceptual intelligence
in machines.
Unlike hard computing , Soft computing is tolerant of
imprecision, uncertainty, partial truth, and
approximation.
Soft Computing
“The essence of soft computing
is that unlike the traditional,
hard computing, soft computing
is aimed at an accommodation
with the pervasive imprecision
of the real world. Thus, the
guiding principle of soft
computing is to exploit the
tolerance for imprecision,
uncertainty, and partial truth to
achieve tractability, robustness,
low solution cost, and better
rapport with reality”
- Lotfi Zadeh
COMPONENTS OF SOFT COMPUTING
Soft Computing is a field that currently
includes
Fuzzy Logic
Neural Networks
Probabilistic Reasoning(Genetic Algorithms, BBN),
and
Other related methodologies
Case-Based Reasoning
Soft Computing combines knowledge,
techniques, and methodologies from the
Fuzzy Logic - Kai
Sets with fuzzy boundaries
A = Set of tall people
Crisp set A Fuzzy set A
1.0 1.0
.9
.5 Membership
function
170 Heights 170 180 Heights
(cm) (cm)
Fuzzy Set Theory - Kai
Fuzzy set theory provides a systematic calculus
to deal with imprecise or incomplete information
Fuzzy if-then rules are used in fuzzy inference
systems
If <1> is tall and <1> is athletic then <1> is good
basketball player.
A A’ B B’ T-norm C
w
Z
X Y
Neural Networks -
Kai
Pattern matching technique where input
patterns are matched with a specific
output pattern. Modeled after the neurons
in the brain.
Network architecture
Weights on the links
x1
y1
x2 y2
Case-Based Reasoning
- Bill
A methodology of
solving new problems
by adapting the
solutions of previous
similar problems
Models the way
experts reason using
their experience
Genetic Algorithms
An optimization technique
10010110 10010110
01100010 Elitism 01100010
10100100 10100100
10011001 10011101
01111101 Selection Crossover Mutation 01111001
... ...
... ...
... ...
... ...
Current Next
generation generation
Other Techniques - Bill
Bayesian belief networks
represent and reason with probabilistic
knowledge
Decision Trees
classification using tree structure
Least-squares estimator
statistical regression
Hybrid approaches
use multiple techniques
Soft Computing is a Hybrid Method
Neural
Character
x1 y1 dog Animal? Knowledge
x2
Recognizer y2
dag base
dog
How does SC Relate to Other Fields
What is AI?
“AI is the study of agents that exist in an environment and
perceive and act.” (S. Russell and P. Norvig)
“AI is the art of making computers do smart things.” (Waldrop)
“AI is a programming style, where programs operate on data
according to rules in order to accomplish goals.” (W. A. Taylor)
“AI is the activity of providing such machines as computers with
the ability to display behavior that would be regarded as
intelligent if it were observed in humans.” (R. McLoed)
How does SC Relate to Other Fields
What is AI? (Jang)
The long term goal of AI research is the
Broad creation and understanding of machine
Definition intelligence
Conventional AI research focuses on an
Narrow
attempt to mimic human intelligent behavior
Definition
by expressing it in symbolic rules
How does SC Relate to Other Fields
What is an Expert System (ES)?
Questions
Inference
Responses Engine
User
KB
rules
Knowledge facts
Acquisition
Knowledge
Engineer
How does SC relate to other fields?
automatic
symbolic
Machine improvement
manipulation
AI with
Learning experience
Soft Computing
Cognitive
Psychology Statistics
Study of the mind Probability
(not possibility)
uncertainty and imprecision
AI: predicate logic and
symbol manipulation
User
techniques
Inference Global
Question Engine Database
User Interface
Explanation
Facility
Response KB:•Fact
•rules
Knowledge
Knowledge Acquisition
Engineer
Human Expert Systems
Expert
Soft Computing Characteristics
Human Expertise (if-then rules, cases,
conventional knowledge representations)
Biologically inspired computing models (NN)
New optimization techniques (GA, simulated annealing)
Model-free learning (NN, CBR)
Fault tolerance (deletion of neuron, rule, or case)
Real-world applications (large scale with uncertainties)
• Soft Computing is an approach for constructing
systems which are
−computationally intelligent,
−possess human like expertise in particular domain,
−can adapt to the changing environment and can learn
to do better
−can explain their decisions
Hard Computing Soft Computing
Conventional computing requires Soft computing is tolerant
a of
precisely stated analytical model. imprecision.
Often requires a lot of computation time. Can solve some real world problems in
reasonably less time.
Not suited for real world problems for Suitable for real world problems.
which ideal model is not present.
It requires full truth Can work with partial truth
It is precise and accurate Imprecise.
High cost for solution Low cost for solution
PREMISES OF SOFT
COMPUTING
•The real world problems are
pervasively imprecise and uncertain
• Precision and certainty carry a cost
• Some problems may not even have
any precise solution
GUIDING PRINCIPLE OF SOFT
COMPUTING
The guiding principle of soft computing is:
• Exploit the tolerance for imprecision,
uncertainty, partial truth, and
approximation to achieve non-conventional
solutions, tractability (easily handled,
managed, or controlled), robustness and
low costs.
HARD COMPUTING
•Premises and guiding principles of Hard
Computing are
- Precision, Certainty, and Rigor.
•Many contemporary problems do not lend
themselves to precise solutions such as
-Recognition problems (handwriting,
speech, objects, images, texts)
-Mobile robot coordination,
forecasting, combinatorial problems
etc.
- Reasoning on natural languages
The man is about eighty to eighty five
years old(pure imprecision)
The man is very old(imprecision
and vagueness)
The man is probably from
India(uncertainty)
IMPLICATIONS OF SOFT
COMPUTING
•Soft computing employs ANN, EC, FL etc, in a
complementary rather than a competitive way.
•One example of a particularly effective
combination is "neurofuzzy systems.”
•Such systems are becoming increasingly
visible
as consumer products ranging from air
conditioners and washing machines to
photocopiers, camcorders and many industrial
applications.
SOFT COMPUTING:
CURRENT APPLICATIONS
• Handwriting recognition
• Automotive systems and manufacturing
• Image processing and data compression
• Architecture
• Decision-support systems
• Data Mining
• Power systems
• Control Systems
ANY QUESTION ?
THANKS
