Well Posed Learning Problems
Lecture # 2
21st February, 2012
(Chapter 1)
What is learning
Any computer program that improves its performance at some
task through experience
A computer program is said to learn from experience E with
respect to some class of tasks T and performance measure P, if its
performance at tasks in T, as measured by P, improves with
experience E
Lecture #2 2
Well Posed Learning Problem
To have a well defined learning problem, we must identify 3
features
The class of tasks
The measure of performance to be improved
The source of experience
Lecture #2 3
Well Posed Learning Problem - Example
Task T : Recognizing handwritten words
Performance measure P : Percentage of correctly classified
words
Training experience E : A database of handwritten words with
known classifications
Lecture #2 4
Well Posed Learning Problem - Example
Task T : Playing checkers
Performance measure P : Percentage of games won against
opponents
Training experience E : Playing practice games against itself
Lecture #2 5
Well Posed Learning Problem - Example
Task T : Classify patient as healthy or sick
Performance measure P : Percentage of correctly classified
patients
Training experience E : Classified patient records e.g
<<T1, BP1>, H>, <<T2,
BP1>, S>
Learning: Find the target function V i.e. acquire the concepts H and
S from a subset of all possible experience
Lecture #2 6