ITSC-6111: Algorithms and
Data Structures for Artificial
Intelligence
LECTURE 1 Introduction to AI
Beakal Gizachew
Based on slides by Roman Garnett and Chapter 1 of Heaton (Artificial Intelligence for Humans Volume 1)
Textbook Reference
Today
What is artificial intelligence?
What can AI do?
What is this course?
Sci-Fi AI?
What is AI?
The science of making machines that:
Think like people Think rationally
Act like people Act rationally
Rational Decisions
We’ll use the term rational in a very specific, technical way:
Rational: maximally achieving pre-defined goals
Rationality only concerns what decisions are made
(not the thought process behind them)
Goals are expressed in terms of the utility of outcomes
Being rational means maximizing
your expected utility
Maximize Your
Expected Utility
Problems with Humans
How many
dots?
What About the Brain?
Brains (human minds) are very good at
making rational decisions, but not perfect
Brains aren’t as modular as software, so
hard to reverse engineer!
“Brains are to intelligence as wings are to
flight”
Lessons learned from the brain: memory
and simulation are key to decision making
A (Short) History of AI
1940-1950: Early days
1943: McCulloch & Pitts: Boolean circuit model of brain
1950: Turing's “Computing Machinery and Intelligence”
1950—70: Excitement: Look, Ma, no hands!
1950s: Early AI programs, including Samuel's checkers program,
Newell & Simon's Logic Theorist, Gelernter's Geometry Engine
1956: Dartmouth meeting: “Artificial Intelligence” adopted
1965: Robinson's complete algorithm for logical reasoning
1970—90: Knowledge-based approaches
1969—79: Early development of knowledge-based systems
1980—88: Expert systems industry booms
1988—93: Expert systems industry busts: “AI Winter”
1990—: Statistical approaches
Resurgence of probability, focus on uncertainty
General increase in technical depth
Agents and learning systems… “AI Spring”?
2000—: Where are we now?
What Can AI Do?
Quiz: Which of the following can be done at present?
Play a decent game of table tennis?
Play a decent game of Jeopardy?
Drive safely along a curving mountain road?
Drive safely along the Loop?
Buy a week's worth of groceries on the web?
Buy a week's worth of groceries at Schnucks?
Discover and prove a new mathematical theorem?
Converse successfully with another person for an hour?
Perform a surgical operation?
Put away the dishes and fold the laundry?
Translate spoken Chinese into spoken English in real time?
Write an intentionally funny story?
Natural Language
Speech technologies (e.g. Siri)
Automatic speech recognition (ASR)
Text-to-speech synthesis (TTS)
Dialog systems
Demo: NLP – ASR tvsample.avi
Natural Language
Speech technologies (e.g. Siri/Cortana)
Automatic speech recognition (ASR)
Text-to-speech synthesis (TTS)
Dialog systems
Language processing technologies
Question answering
Machine translation
Web search
Text classification, spam filtering, etc…
Machine Translation?
Vision (Perception)
Object and face recognition
Scene segmentation
Image classification
Demo1: VISION – lec_1_t2_video.flv
Images from Erik Sudderth (left), wikipedia (right)
Demo2: VISION – lec_1_obj_rec_0.mpg
Robotics
Robotics
Part mech. eng.
Part AI
Reality much
harder than
simulations!
Technologies
Vehicles
Rescue
Soccer!
Lots of automation…
In this class:
We ignore mechanical aspects
Methods for planning
Methods for control
Images from UC Berkeley, Boston Dynamics, RoboCup, Google
Logic
Logical systems
Theorem provers
NASA fault diagnosis
Question answering
Methods:
Deduction systems
Constraint satisfaction
Satisfiability solvers (huge advances!)
Image from Bart Selman
Game Playing
Classic Moment: May, '97: Deep Blue vs. Kasparov
First match won against world champion
“Intelligent creative” play
200 million board positions per second
Humans understood 99.9 of Deep Blue's moves
Can do about the same now with a PC cluster
Open question:
How does human cognition deal with the
search space explosion of chess?
Or: how can humans compete with computers at all??
1996: Kasparov Beats Deep Blue
“I could feel --- I could smell --- a new kind of intelligence across the table.”
1997: Deep Blue Beats Kasparov
“Deep Blue hasn't proven anything.”
Huge game-playing advances recently, e.g. in Go!
Text from Bart Selman, image from IBM’s Deep Blue pages
Decision Making
Applied AI involves many kinds of automation
Scheduling, e.g. airline routing, military
Route planning, e.g. Google maps
Medical diagnosis
Web search engines
Spam classifiers
Automated help desks
Fraud detection
Product recommendations
… Lots more!
Designing Rational Agents
An agent is an entity that perceives and acts.
A rational agent selects actions that maximize its
(expected) utility.
Characteristics of the percepts, environment, and
action space dictate techniques for selecting
rational actions
This course is about:
General AI techniques for a variety of problem
Environment
types Sensors
Agent
Percepts
Learning to recognize when and how a new
problem can be solved with an existing ?
technique
Actuators
Actions
Modeling Input and Output
Pac-Man as an Agent
Agent Environment
Sensors Percepts
?
Actuators Actions
Pac-Man is a registered trademark of Namco-Bandai Games, used here for educational purposes Demo1: pacman-l1.mp4 or L1D2
Machine Learning Models
Data classification
Regression analysis
Clustering
Time Series
Classification
Example: Credit
scoring
Differentiating
between low-
risk and high-risk
customers from
their income and
savings Discriminant: IF income > θ1 AND savings > θ2
THEN low-risk ELSE high-risk
Model 26
Classification: Applications
Aka Pattern recognition
Face recognition: Pose, lighting, occlusion (glasses, beard), make-
up, hair style
Character recognition: Different handwriting styles.
Speech recognition: Temporal dependency.
Use of a dictionary or the syntax of the language.
Sensor fusion: Combine multiple modalities; eg, visual (lip image) and
acoustic for speech
Medical diagnosis: From symptoms to illnesses
Web Advertizing: Predict if a user clicks on an ad on the Internet.
27
Face Recognition
Training examples of a person
Test images
AT&T Laboratories, Cambridge UK 28
http://www.uk.research.att.com/facedatabase.html
Regression
Example: Price of a used car
x : car attributes y = wx+w0
y : price
y = g (x | θ )
g ( ) model,
θ parameters
29
Regression Applications
Navigating a car: Angle of the steering wheel
(CMU NavLab)
Kinematics
(x,y)
of a robot arm
α = g (x,y)
1 1
α2= g2(x,y)
α2
α1
30
Time Series
Encode the Data
Financial Analysis Normalize (Sliding Window)
Reading
• Chapter 1 of Heaton (Artificial Intelligence for
Humans Volume 1)
32
Resources: Datasets
UCI Repository: http://www.ics.uci.edu/~mlearn/MLRepository.html
UCI KDD Archive: http://kdd.ics.uci.edu/summary.data.application.html
Statlib: http://lib.stat.cmu.edu/
Delve: http://www.cs.utoronto.ca/~delve/