PLT 425
VISION SYSTEM
CHAPTER 1:
INTRODUCTION TO MACHINE VISION
From Wikipedia: Machine vision (MV) is the technology and
methods used to provide imaging-based automatic
inspection and analysis for such applications as automatic
inspection, process control, and robot guidance in industry.
“The scope of MV is broad”.
1
INTRODUCTION
A machine vision system recovers useful information
about a scene from its 2-dimensional projections.
The goal of machine vision is to create a model of the
real world from images.
2
FIELDS THAT DEAL WITH IMAGES
Image
Images are two-dimensional projections of the three-dimensional
world.
Image Processing
Enhancement or manipulation of the image – the result of which is
usually another image.
Computer Vision
Analysis and understanding of image content.
Video Processing
Similar with image processing, but processing of multiple
images/frames. Combined with computer vision, end result is
normally extracted information.
3
3 PRINCIPAL USES FOR IMAGE PROCESSING
Improvement of pictorial information for human
interpretation
Do you have example in mind?
Compression of image data for storage and transmission
Processing of image data for autonomous machine
perception to enable object representation, detection,
classification and tracking
Which is why we learn this course.
4
FUNDAMENTAL STEPS & COMPONENTS OF
MACHINE VISION SYSTEMS
• The first stage of any vision system is the image
acquisition stage.
Image acquisition • The action of retrieving an image from some source,
usually a hardware-based source for processing.
• To create a digital image, it requires 2 process:
Image sampling and quantization.
• Improves image for human and computer
consumption, highlight / extract relevant feature
• Remove noises, deblurred etc
Image processing • Color Conversion
• Segmentation and representations
• Extract features such a edge, regions, surfaces
etc.
• Measurement analysis - measure features on the
object
• Image classification refers to the labelling of
Classification images into one of a number of predefined
categories
5
Example: Face Recognition Workflow
6
Example: Face Recognition Workflow
7
Machine vision system is a sensor used in the robots for viewing and
recognizing an object with the help of a computer.
It is mostly used in the industrial robots for inspection purposes.
8
Source: http://www.roboticsbible.com/machine-vision-system.html
APPLICATIONS OF MACHINE VISION SYSTEMS
Law enforcement
Medical imaging
Remote sensing
Satellite image processing
Industrial inspection
Robot control
And so other many applications
9
LAW ENFORCEMENT
How to extract features that can be used to differentiate among
different images?
10
LAW ENFORCEMENT
Example: Face Recognition System
11
LAW ENFORCEMENT
Example: Automated license plate recognition
12
MEDICAL IMAGING
Comprises different imaging
modalities and processes of
image human body for diagnostic
and treatment purposes.
Allowing doctors to find disease
earlier and improve patient
outcomes.
How to process/ analyze the
image to help diagnosis or
treatment?
Types of image modalities:
– Ultra Sound (US)
– Magnetic Resonance Imaging
(MRI)
– Computer Tomography (CT)
– X-Rays
13
14
REMOTE SENSING
The use of satellite- or aircraft-
based sensor technologies to
detect and classify objects on
Earth
Example: Weather observation
and prediction
– Multispectral image of Hurricane
Andrew from satellites using sensors
in the visible and infrared bands
New York (from Landast-5 TM)
15
REMOTE SENSING
Example: Palm Mapping Using Drones
16
SATELLITE IMAGE PROCESSING
Infrared image of hurricane Irma
17
INDUSTRIAL INSPECTION
Vision sensor detects torn
label
Monitor bottle overfill and
underfill
18
INDUSTRIAL INSPECTION
Inspecting date/code and
label quality
19
ROBOT CONTROL
Unmanned operations -
autonomous vehicle driving
How to detect and track target?
How to avoid obstacles?
Mars Rover: An example of an
unmanned land-based vehicle. Notice
the stereo cameras mounted on top of
the Rover.
20
OTHERS
21
ADVANTAGES OF MACHINE VISION SYSTEMS
Cutting out defective goods
Making better use of raw materials
Cutting the cost of quality control
Enabling real-time process monitoring
Improving employment conditions
22
