CSE3018 Content Based Image and
Video Retrieval
Dr.S.Geetha
Professor
School of Computing Science and Engineering
VIT University, Chennai Campus, Chennai
AB1-205 – [email protected]
Some facts about human visual
perception
• We are driven by a desire to make meanings
• (We all seem to 'see things' in inkblots, flames, stains, clouds
and so on.)
• • Human visual perception is self-learning
• − If you are an European, it is hard to recognize Japanese and
Chinese faces
• − We are looking for the known objects in the picture
Some facts about our visual
perception
• We are looking for the known objects in the
picture
Some facts about our visual
perception
• Cultural and environmental factors affects the
way we see things
• Are these stairs goes up or down?
• • Arabs would read this (right to left) as a set
of stairs going down
• Is left line shorter than the right
• •Left?: outside corner of a building
• • Right: inside corner of a room
• Inside corner may appear to be nearer
• (and therefore larger)
Some facts about our visual
perception
• Brightness adaptation and
discrimination
• − Range of light intensity levels to
which human visual system can
adapt: order of 1010
• − Subjective brightness(perceived
intensity) is a logarithmic function
of the actual light intensity
Some facts about our visual
perception
• Brightness adaptation and discrimination
• − The human visual system cannot operate
• over such a range (1010) simultaneously
• − It accomplishes this variation by changing
its overall sensitivity – brightness adaptation
phenomena
• The range of subjective brightness that the eye
can perceive when adapted to the level Ba
• Ba – brightness adaptation level
• Bb – below it all stimuli are perceived as black
Some facts about our visual
perception
Some facts about our visual
perception
Some facts about our visual
perception
Architecture of CBIRS
Visual Content Descriptors
• Visual Content
– General Visual Content
• Color
• Texture
• Shape
• Spatial Relationship
– Domain Specific Visual Content
• Human faces
• Fingerprints
• Semantic Content
– Textual annotation
– Complex inference procedures based on visual
content
• Global
– Whole image
• Local
– Regions / Objects Segmentation
Characteristics of the Features
• Invariant to the accidental variance
introduced by image processing operations
(Illumination change etc.)
• Discriminative power of the visual features
• Trade-off
• Basic Feature – Color
Color Fundamentals
Color Features
• Color Space
• Color Moments
• Color Histogram
• Color coherence vector
• Color correlogram
• Invariant color features
Thank You!