Class of Computer Vision

Le Ngoc Huan, PhD, Department of Mechatronics

EIU - 2017
N.Huan Le
Class of Image Processing

CHAPTER 1
Introduction
3 Periods

Department of Mechatronics

EIU - 2017
N.Huan Le
 Class Rules

1. Class attendance: 10% (if a student absent more

than 3 times, the attendance score is zero)
2. Projects: 30%
3. Grand Project: 20%
4. Final exam: 40% (Students will allow to use their
documents while doing the exam. Time for final
exam: 75 minutes)

 2017 – Department of Mechatronics N.Huan Le

 References

1. Textbook: Rafael C. Gonzalez, Richard E. Woods, Digital

image processing, Prentice Hall, 2002
2. Reference: Lương Mạnh Bá, Nguyễn Thanh Thủy, Nhập
môn xử lý ảnh số, NXB Khoa Học Kỹ Thuật, 1999

N.Huan Le
 Outcomes
• LO1. Understand the basic components and
applications of a computer vision system.
• LO2. Use the techniques for image enhencement.
• LO3. Use morphological processing techniques.
• LO4. Use segmentation techniques in object detection.
• LO5. Write basic image processing programs by using
high-level programming language like VC++ / C#.
• LO6. Combine basic techniques for a project of
detecting defects.
• LO7. Function on multi-disciplinary teams.

N.Huan Le
 Chapter outcomes
• Understanding overview of digital image
processing
• What is the scope of this class ?
• Where is image processing in computer vision
field ?

N.Huan Le
 Contents

• This lecture will cover:

– What is a digital image? What is digital image
processing?
– History of digital image processing
– State of the art examples of digital image
processing
– Key stages in digital image processing
– Components of an Image Processing System

N.Huan Le
 What is a Digital Image?
• A digital image is a representation of a two-
dimensional image as a finite set of digital values,
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

called picture elements or pixels

N.Huan Le
 What is a Digital Image?
(cont…)
• Pixel values typically represent gray levels, colours,
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

heights, opacities etc.

• Remember digitization implies that a digital image
is an approximation of a real scene.

1 pixel

N.Huan Le
 What is a Digital Image?
(cont…)
• Common image formats include:
– 1 sample per point (B&W or Grayscale)
– 3 samples per point (Red, Green, and Blue)

• For most of this course we will focus on grey-scale

images

N.Huan Le
 What is Digital Image
Processing?

• Digital image processing focuses on two

major tasks:
– Improvement of pictorial information for
human interpretation
– Processing of image data for storage,
transmission and representation for
autonomous machine perception

N.Huan Le
 What is DIP? (cont…)

• The continuum from image processing to

computer vision can be broken up into low-,
mid- and high-level processes
Low Level Process Mid Level Process High Level Process
Input: Image Input: Image Input: Attributes
Output: Image Output: Attributes Output: Understanding
Examples: Noise Examples: Object Examples: Scene
removal, image recognition, understanding,
sharpening segmentation autonomous navigation

In this course we will

stop here
N.Huan Le
 History of DIP

• Early 1920s: One of the first

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

applications of digital imaging

was in the news-
paper industry Early digital image

• Mid to late 1920s:

Improvements to the
Bartlane system resulted
in higher quality images

Improved
digital image Early 15 tone digital
image
N.Huan Le
 History of DIP (cont…)

• 1960s: Improvements in computing

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

technology and the onset of the space race

led to a surge of work in digital image
processing

A picture of the moon taken

by the Ranger 7 probe
minutes before landing
N.Huan Le
 History of DIP (cont…)

• 1970s: Digital image processing begins to

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

be used in medical applications

Typical head slice CAT

image

N.Huan Le
 History of DIP (cont…)

• 1980s - Today: The use of digital image

processing techniques has exploded and they
are now used for all kinds of tasks in all kinds of
areas
– Image enhancement/restoration
– Artistic effects
– Medical visualisation
– Industrial inspection
– Law enforcement
– Human computer interfaces

N.Huan Le
 Examples: Image
Enhancement
• One of the most common uses of DIP
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

techniques: improve quality, remove noise

etc

N.Huan Le
 Examples: The Hubble
Telescope
• Launched in 1990 the Hubble
telescope can take images of
very distant objects
• However, an incorrect mirror
made many of Hubble’s
images useless
• Image processing
techniques were
used to fix this

N.Huan Le
 Examples: Artistic Effects

• Artistic effects are

used to make
images more
visually appealing,
to add special
effects and to make
composite images

N.Huan Le
 Examples: Medicine
• Take slice from MRI scan of canine heart,
and find boundaries between types of tissue
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

– Image with gray levels representing tissue

density
– Use a suitable filter to highlight edges

Original MRI Image of a Dog Heart Edge Detection Image

N.Huan Le
 Examples: GIS

• Geographic Information Systems

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

– Digital image processing techniques are used

extensively to manipulate satellite imagery
– Terrain classification
– Meteorology

N.Huan Le
 Examples: GIS (cont…)

• Night-Time Lights of
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

the World data set

– Global inventory of
human settlement
– Not hard to imagine
the kind of analysis
that might be done
using this data

N.Huan Le
 Examples: Industrial
Inspection
• Human operators are
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

expensive, slow and

unreliable
• Make machines do the
job instead
• Industrial vision
systems are used in all
kinds of industries
• Can we trust them?

N.Huan Le
 Examples: PCB Inspection
• Printed Circuit Board (PCB) inspection
– Machine inspection: determine that all
components are present and that all solder
joints are acceptable
– Both conventional imaging and x-ray imaging
are used

N.Huan Le
 Examples: Law Enforcement

• Image processing
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

techniques are used

extensively by law
enforcers:
– Number plate
recognition for speed
cameras/automated toll
systems.
– Fingerprint recognition.
– Enhancement of CCTV
images.

N.Huan Le
 Examples: HCI
• Try to make human
computer interfaces more
natural:
– Face recognition.
– Gesture recognition.
• Does anyone remember
the user interface from
“Minority Report”?
• These tasks can be
extremely difficult.

N.Huan Le
 Key Stages in DIP

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
N.Huan Le
 Key Stages in DIP:
Image Aquisition
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
N.Huan Le
 Key Stages in DIP:
Image Enhancement
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
N.Huan Le
 Key Stages in DIP:
Image Restoration
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
N.Huan Le
 Key Stages in DIP:
Morphological Processing
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
N.Huan Le
 Key Stages in DIP:
Segmentation
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
N.Huan Le
 Key Stages in DIP:
Object Recognition
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
N.Huan Le
 Key Stages in DIP:
Representation &
Description
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
N.Huan Le
 Key Stages in DIP:
Image Compression
Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
N.Huan Le
 Key Stages in DIP:
Colour Image Processing
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
N.Huan Le
 Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Fundamental Steps in DIP

N.Huan Le
 Fundamental Steps in DIP

• Image acquisition: Chapter 2

• Image enhancement: Chapters 3, 4(skip)
• Image restoration: Chapter 5(skip)
• Color image processing: Chapter 6
• Wavelets: Chapter 7(skip)
• Compression: Chapter 8(skip)
• Morphological processing: Chapter 9
• Image segmentation: Chapter 10
• Representation and description: Chapter
11
• Object recognition: Chapter 12(skip)
N.Huan Le
 Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Processing System
Components of an Image

N.Huan Le
Components
of an Image
Processing
System

N.Huan Le
N.Huan Le