IMAGE PROCESSING

Le Thanh Ha, Ph.D

Assoc. Prof. at University of Engineering and Technology,
Vietnam National University
[email protected]; [email protected]; 0983 692 592
 Human visual system

• What is the shape?

• What color is it?
• Do you like it?

9/15/2022 Le Thanh Ha, Lab of HMI 2

 Content
2. Fundamental of Digital Images
- Electromagetic Spectrum of Light & Image Formation in human
eyes.
- Human Visual Perception
- Spatial Frequency Resolution
- Temporal Frequency Resolution

9/15/2022 Le Thanh Ha, Dr., Lab. of HMI 3

 Light

c
= • : wavelength
f
• c: speed of light (2.998x108m/s)
• f: frequency

9/15/2022 Le Thanh Ha, Lab of HMI 4

 Isaac Newton prism

• Sunlight consists of continuous spectrum of

colors ranging from violet to red

9/15/2022 Le Thanh Ha, Lab of HMI 5

 Light and Electromagnetic Spectrum

9/15/2022 Le Thanh Ha, Lab of HMI 6

 Light properties
• Light is a particular type of EM radiation:
– Can be presented by frequency or wavelength
– Natural white light (include all frequencies) comes from the sun (S. I.
Newton’s glass prism)
– When an object is radiated by while light:
• Object absorbs some ranges of light’s frequency and reflects the others
• Human eyes perceive the reflected light and assume it as the object’s color.
• Eg: green objects reflect ligth with wavelengths primarily in [500,570] nm range and
absorb most of the energy at other wavelengths.

Why we still perceive scene around even thought there is no sun?

9/15/2022 Le Thanh Ha, Lab of HMI 7

 Light properties
• Light that is advoid of color is called monochromatic light (ML).
– Intensity of ML varies from black to gray, and white → gray level, or just
intensity.

• Color light:
– Luminance: amount of energy perceived.
– Chrominance:
• Frequencies of wavelight
• Hue
• Purity

9/15/2022 Le Thanh Ha, Lab of HMI 8

 Light properties

• Frequency (hue, color)

• Luminance (sum of area under the freq. curve)
• Purity: (ED-EW)/ ED

9/15/2022 Lê Thanh Hà 9
 Human Visual Perception
• Human perception encompasses both the physiological and
psychological aspects.
• We will focus more on physiological aspects, which are more
easily quantifiable and hence, analyzed.
 Human Visual Perception
• Why study visual perception?
– Image processing algorithms are designed based on how our visual
system works.
– In image compression, we need to know what information is not
perceptually important and can be ignored.
– In image enhancement, we need to know what types of operations
that are likely to improve an image visually.
 The Human Visual System
• The human visual system consists of two primary components
– the eye and the brain, which are connected by the optic
nerve.
– Eye – receiving sensor (camera, scanner).
– Brain – information processing unit (computer system).
– Optic nerve – connection cable (physical wire).
 How eye looks

9/15/2022 Le Thanh Ha, Lab of HMI 13

 Thu Human Visual System

9/15/2022 Le Thanh Ha, Lab of HMI 14

 The Human Visual System
• This is how human visual system works:
– Light energy is focused by the lens of the eye into sensors and retina.
– The sensors respond to the light by an electrochemical reaction that
sends an electrical signal to the brain (through the optic nerve).
– The brain uses the signals to create neurological patterns that we
perceive as images.
 The Human Visual System
• The visible light is an electromagnetic wave with wavelength
range of about 380 to 825 nanometers.
– However, response above 700 nanometers is minimal.
• We cannot “see” many parts of the electromagnetic spectrum.
 The Human Visual System
• The visible spectrum can be divided into three bands:
– Blue (400 to 500 nm).
– Green (500 to 600 nm).
– Red (600 to 700 nm).
• The sensors are distributed across retina.
 The Human Visual System
• There are two types of sensors: rods and cones.
• Rods:
– For night vision.
– See only brightness (gray level) and not color.
– Distributed across retina.
– Medium and low level resolution.
 The Human Visual System
• Cones:
– For daylight vision.
– Sensitive to color.
– Concentrated in the central region of eye.
– High resolution capability (differentiate small changes).
 The Human Visual System

9/15/2022 Le Thanh Ha, Lab of HMI 20

 The Human Visual System
• Blind spot:
– No sensors.
– Place for optic nerve.
– We do not perceive it as a blind spot because the brain fills in the
missing visual information.
• Why does an object should be in center field of vision in order
to perceive it in fine detail?
– This is where the cones are concentrated.
 The Human Visual System
• Cones have higher resolution than rods because they have
individual nerves tied to each sensor.
• Rods have multiple sensors tied to each nerve.
• Rods react even in low light but see only a single spectral band.
They cannot distinguish color.
The Human Visual System
 The Human Visual System
• There are three types of cones. Each responding to different
wavelengths of light energy.
• The colors that we perceive are the combined result of the
response of the three cones.
The Human Visual System
 Other species’ Visual Systems
• Eagle: Best resolution (6 times than human)
• Owl: Largest visual field (360o)
• Ants: Ultraviolet sensing
• Rattle snake: Infra red sensing
• Dogs: Color blind

9/15/2022 Le Thanh Ha, Lab of HMI 26

 Số hóa (Thu nhận hình ảnh)
• Thu nhận hình ảnh bằng thiết bị số bản chất là số hóa năng
lượng ánh sáng theo các trục:
– Không gian
– Thời gian
– Cường độ
– Phổ ánh sáng

9/15/2022 Lê Thanh Hà - Phòng TN Tương tác người máy 27

 Độ phân giải
• Độ phân giải không gian
• Độ phân giải thời gian
• Độ phân giải bức xạ
• Độ phân giải phổ

9/15/2022 Lê Thanh Hà - Phòng TN Tương tác người máy 28

 Độ phân giải không gian
• Kích thước ảnh (VGA, Half-
HD, HD, 2K, 4K, …)

• Mega pixels (2M Pixels,

12M Pixels, …)

• Kích thược thực tế mà một

điểm ảnh có thể biểu diễn
(1m, 10m, 500m, 1km,
10km, …)

9/15/2022 Lê Thanh Hà - Phòng TN Tương tác người máy 29

Độ phân giải thời gian
• Số frame trong một
giây (fps): 15fps,
24fps, 30fps, 60fps,
…
• Khoảng thời gian
chụp giữa 2 ảnh (1
ngày, 2 ngày, 16 ngày,
…)

9/15/2022 Lê Thanh Hà - Phòng TN Tương tác người máy 30

 Độ phân giải phổ
• Ảnh đen trắng
• Ảnh màu
• Ảnh đa phổ
• Ảnh siêu phổ

9/15/2022 Lê Thanh Hà - Phòng TN Tương tác người máy 31

 Độ phân giải bức xạ
• Ảnh nhị phân
• Ảnh 8 bit
• Ảnh 10 bit
• Ảnh 24 bit
• Số bit được sử
dụng để biểu
diễn 1 điểm
ảnh.

9/15/2022 Lê Thanh Hà - Phòng TN Tương tác người máy 32