Medical Image Processing DG
Medical Image Processing DG
GLOTSOS DIMITRIS
[email protected]
May 2017 1
BASIC PRINCIPLES AND DEFINITIONS
About the presentation
Image segmentation:
Region extraction
Adjust and optimize
Image classification/recognition:
Computer-aided diagnosis
2
WHY DO WE NEED IMAGE PROCESSING
Image Perception
Source:http://www.qsl.net/w5www/9people.html
3
WHY DO WE NEED IMAGE PROCESSING
Image Perception
4
BASIC PRINCIPLES AND DEFINITIONS
What is a medical image
Definition: -characteristics
Monitoring/recording of the geometric •Anatomical: Static distribution of a certain
physical property, Skeleton.
distribution of certain physical property
•Physiological/Functional: Functionality or
Metabolism of organs, Glucose
consumption in brain.
•Digital detectors!!!
0 or 1
Source: http://www.biologymad.com/nervoussystem/eyenotes.htm
6
BASIC PRINCIPLES AND DEFINITIONS
Visual Perception – A low contrast system
-BRIGHTNESS PERCEPTION
•The visual system may differentiate about
64 different grades of brightness – Low
contrast
7
BASIC PRINCIPLES AND DEFINITIONS
What is medical image processing
Aim:
Enhance, restore, extract,
understand and code
information Adjust and optimize
8
BASIC PRINCIPLES AND DEFINITIONS
Basic image processing steps
Image segmentation:
Region extraction
Adjust and optimize
Image classification/recognition:
Computer-aided diagnosis
9
IMAGE VISUALIZATION
Goal: Transform numbers to •Organize information in a way that the
image observer may understand it: i.e. visualize
the information on the screen
10
IMAGE VISUALIZATION
Goal: Transform numbers to Methods:
image • Linear Display
• Windows
Applications: • Non-Linear Display
•All digital imaging systems! • Tomographic reconstruction
• Volume rendering
X-ray tube
ADC
PATIENT IMAGE MATRIX
VISUAL DISPLAY
UNIT
DETECTORS
Video tutorial:
https://www.youtube.com/watch?v=9SUHgtREWQc
11
IMAGE VISUALIZATION
(HISTORICAL SURVEY)
Generations + History
Year Researcher Milestone
Source:
http://www.crtsite.co
m/page5-2.html
Source:
http://people.csail.mit.edu/bkph/courses/papers/E
xact_Conebeam/Radon_Deutsch_1917.pdf
12
IMAGE VISUALIZATION
(HISTORICAL SURVEY)
Generations + History
Year Researcher Milestone
Source:
http://www.impactscan.or
g/CThistory.htm
13
IMAGE VISUALIZATION
(HISTORICAL SURVEY)
Generations + History
Year Researcher Milestone
Source:
http://www.nobelprize.org/nobel_
prizes/medicine/laureates/1979/
14
IMAGE VISUALIZATION
(HISTORICAL SURVEY)
Generations + History
Year Researcher Milestone
Source:
http://tech.snmjournals.org/cont
ent/36/2/57/F1.large.jpg
Source: http://www.mdanderson.org/education-and-
research/departments-programs-and-labs/labs/pet-
development-laboratory/research/micro-pet-ct-
camera/index.html
15
IMAGE VISUALIZATION
(HISTORICAL SURVEY)
Hounsfield lecture
16
IMAGE VISUALIZATION
(HISTORICAL SURVEY)
Hounsfield lecture
Source:
http://en.wikipedia.org/wik
i/Godfrey_Hounsfield
17
IMAGE VISUALIZATION
(HISTORICAL SURVEY)
Hounsfield lecture
18
IMAGE VISUALIZATION
(HISTORICAL SURVEY)
Hounsfield lecture
19
IMAGE VISUALIZATION
(HISTORICAL SURVEY)
Hounsfield lecture
20
IMAGE VISUALIZATION
(INTENSITY WINDOWING)
Simple Window
Iy
WW (Window Width)
WL (Window Level)
WS (Window Start)
WΕ (Window End)
WW
WS WL
y2 2
x1 WS Ix WE x2 WW
ΙORIGINAL WE WL
2
21
IMAGE VISUALIZATION
(INTENSITY WINDOWING)
Simple Window
A1= [ 30 29 12 IVDU
A2= [ 7 7 1
I x 30, I y 7
y1
17 12 25 5 1 7
12 8 17] 1 0 5]
I x 29, I y 7
Iy
I x 8, I y 0
WW=10, WL=15
WS=10, WE=20
22
IMAGE VISUALIZATION
INTENSITY WINDOWING - PRACTICAL APPLICATION: CT
23
IMAGE VISUALIZATION
INTENSITY WINDOWING - PRACTICAL APPLICATION: CT
Source: LM Fayad et al., Chest CT Window Settings Windowed image for mediastinal tissue
With Multiscale Adaptive Histogram Equalization: Pilot
Study, Radiology 223 (3), 845-852. 6 2002
24
BASIC PRINCIPLES AND DEFINITIONS
Basic image processing steps
Image segmentation:
Region extraction
Adjust and optimize
Image classification/recognition:
Computer-aided diagnosis
25
IMAGE ENHANCEMENT AND
RESTORATION
Reduce
Improve
visibility of 1. Equalization
2. Filtering
3. Deconvolution
26
IMAGE ENHANCEMENT AND
RESTORATION
Image content
Original Equalized
28
IMAGE ENHANCEMENT AND
RESTORATION
1. Histogram Equalization: Increase Contrast
Frequency of appearance of image tones
7 4 5 6
1 4 3 5
5 3 2 1
4 3 3 5
29
IMAGE ENHANCEMENT AND
RESTORATION
1. Histogram Equalization: Increase Contrast
2 1 2
3 4 2
Histogram modification 4 3 2
with histogram 5 4 2
equalization:
6 1 2
redistribution of image
tones in such a way that 7 1 2
each tone will appear
with the same frequency
at the final image
30
IMAGE ENHANCEMENT AND
RESTORATION
1. Histogram Equalization: Increase Contrast
31
IMAGE ENHANCEMENT AND
RESTORATION
HISTOGRAM EQUALIZATION-PRACTICAL APPLICATION: CT
CONTRAST ENHANCEMENT
Source: Wu Z. Q. et al, "The Removal of Blocking Effects Caused by Partially Overlapped Sub-Block Contrast Enhancement", 32
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.103.7458.
IMAGE ENHANCEMENT AND
RESTORATION
HISTOGRAM EQUALIZATION-PRACTICAL APPLICATION: MAMMOGRAPHY
CONTRAST ENHANCEMENT
X -1 -1 -1
-1 9 -1
-1 -1 -1
35
IMAGE ENHANCEMENT AND
RESTORATION
2. Filtering: Reduce noise, enhance texture
36
IMAGE ENHANCEMENT AND
RESTORATION
2. Filtering: Reduce noise, enhance texture
37
IMAGE ENHANCEMENT AND
RESTORATION
FILTERING- PRACTICAL APPLICATION: RADIOGRAPHY
EDGE CRISPERING – HIGH PASS
Source: Lijun Yin, Scalable edge enhancement with automatic optimization for digital radiographic images, Pattern
Recognition, Volume 37, Issue 7, July 2004, Pages 1407-1422
39
IMAGE ENHANCEMENT AND
RESTORATION
FILTERING - PRACTICAL APPLICATION: MRI
DENOISING – LOW PASS
Source: Ertürk MA, Bottomley PA, El-Sharkawy A-MM. Denoising MRI Using Spectral Subtraction.
IEEE transactions on bio-medical engineering. 2013;60(6):1556-1562. doi:10.1109/TBME.2013. 40
IMAGE ENHANCEMENT AND
RESTORATION
FILTERING - PRACTICAL APPLICATION: ULTRASONOGRAPHY
Source: https://www.lpi.tel.uva.es/node/510 41
IMAGE ENHANCEMENT AND
RESTORATION
3. Deconvolution: Restore image quality
Degradation model
42
IMAGE ENHANCEMENT AND
RESTORATION
DECONVOLUTION- PRACTICAL APPLICATION: ULTRASONOGRAPHY
DESPECKLING
Source: Gjenna Stippel, et al, A tissue-specific adaptive texture filter for medical ultrasound images,
Ultrasound in Medicine & Biology, Volume 31, Issue 9, September 2005, Pages 1211-1223
43
IMAGE ENHANCEMENT AND
RESTORATION
DECONVOLUTION- PRACTICAL APPLICATION: MICROSCOPY
Source: https://www.sccp.sc.edu/Microscopy_Flow_Cytometry_Core_Facilities 44
BASIC PRINCIPLES AND DEFINITIONS
Basic image processing steps
Image segmentation:
Region extraction
Adjust and optimize
Image classification/recognition:
Computer-aided diagnosis
45
IMAGE REGISTRATION AND FUSION
ANATOMY/MORPHOLOGY PHYSIOLOGY/FUNCTIONALITY
-x-ray, CT, MRI, US, Portal Imaging, -SPECT, PET, fMRI, EEG, MEG, special
endoscopy, special protocols (MRA, DSA, protocols (pMRI, fCT, EIT, MRE)
CTA, Doppler)
Goal: Applications:
•integration of complementary information from •Diagnosis (breast and colon cancer),
different imaging modalities
cardiac studies, bone injuries,
•Registration: Bring the modalities inflammatory diseases, neurological
involved into spatial alignment disorders, radiotherapy, surgery
•Fusion: after registration, integrate the
two images into one display
Methods:
• Control point-based
• Moment-based
• Edge-based
• Optimization of similarity 46
IMAGE REGISTRATION AND FUSION
(MULTIMODALITY IMAGING)
PET/CT
-PET: monitor metabolic activities
-PET has low spatial resolution
-Spatial resolution is enhanced
using CT
Prototype system:- CTI PET
Systems in Knoxville, TN
(today=Siemens Molecular
Imaging)
-Pittsburgh, 1998
-spiral CT scanner (Somatom
AR.SP; Siemens Medical
Source:
Solutions, Forchheim, Germany)
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2777694/pdf/n
ihms67781.pdf + ECAT ART scanner (CTI PET
Systems, Knoxville, TN) 47
IMAGE REGISTRATION AND FUSION
(MULTIMODALITY IMAGING)
PET/CT
-manufacturers: -applications:
•GE Healthcare •Oncology
(http://www3.gehealthcare.com/en/pro
• PET/CT improves sensitivity in staging
ducts/categories/pet-ct)
(84%) against 63-64% when using only PET
•Philips Medical Systems or only CT (Antoch et al. (2004))
(http://www.healthcare.philips.com/m
• PET/CT presented 50% additional
ain/products/nuclearmedicine/product
information than using only PET or only CT
s/pet/)
(BarShalom et al. (2003)), changing, in this
•Toshiba Medical Corporation way, treatment planning in 14% of patients
(http://medical.toshiba.com/news/pres
• PET/CT contributes in radiotherapy
s-releases/2014/06/09/1940/)
treatment planning ((Herrmann
•Siemens Medical Solutions 2005;Scarfone et al. 2004))
(http://usa.healthcare.siemens.com/mo
lecular-imaging/pet-ct)
48
IMAGE REGISTRATION AND FUSION
(MULTIMODALITY IMAGING)
PET/MRI
Source: http://link.springer.com/chapter/10.1007%2F978-3-
540-72718-7_6#page-1
49
IMAGE REGISTRATION AND FUSION
(MULTIMODALITY IMAGING)
PET/MRI
-manufacturers: -applications:
•GE Healthcare •Oncology
(http://www3.gehealthcare.com/en/pro
• Pancreas, intestine, uterus, lymphoma
ducts/categories/molecular_imaging/p
et_ct_and_mr_trimodality_imaging) •Cardiology
•Philips Medical Systems • Angiography, myocardium studies
(http://www.healthcare.philips.com/m
•Neurology
ain/products/nuclearmedicine/product
s/ingenuity_tf_pet_mr/) • Epilepsy, neurodegeneration
•Siemens Medical Solutions
(http://www.healthcare.siemens.com/
magnetic-resonance-imaging/mr-pet- Video tutorial:
scanner) https://www.youtube.com/watch?v=3B752nZi1qg
50
IMAGE REGISTRATION AND FUSION
(APPLICATIONS)
PET/CT
Source:
https://www.aapm.org/me
etings/08SS/documents/
Townsend.pdf
Video tutorial:
https://www.youtube.com
/watch?v=qCT3KQitrCQ
51
IMAGE REGISTRATION AND FUSION
(APPLICATIONS)
PRACTICAL APPLICATION: MRI - SPECT
Brain cancer
Source: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3101722/
52
IMAGE REGISTRATION AND FUSION
(APPLICATIONS)
PRACTICAL APPLICATION: PET - MRI
Source:
https://imaging.stonybrookmedici
ne.edu/imaging-modalities/pet-
mri
Video Tutorial 1:
https://www.youtube.com/watch?
v=h8IwnDYgs0g
Video Tutorial 2:
https://www.youtube.com/watch?
v=d6GPmBMuth4
53
IMAGE REGISTRATION AND FUSION
(APPLICATIONS)
PRACTICAL APPLICATION: PET – CT/MRI
Rectal cancer: Left-sided, FDG-avid
rectal cancer with rectal wall thickening.
Note the improved detectability of the
surrounding infiltration and detectability
of the small locoregional lymph node.
Source: http://www.auntminnieeurope.com/index.aspx?sec=ser&sub=def&pag=dis&ItemID=607257
54
IMAGE REGISTRATION AND FUSION
(APPLICATIONS)
PRACTICAL APPLICATION: PET – CT/MRI
Abdominal: PET-MRI of
patient with cecal
inflammation. Fused imaging
demonstrates small area of
active inflammatory changes in
the cecum that would be
difficult to diagnose on either
FDG-PET or MR imaging
independently.
Source: http://www.intechopen.com/books/inflammatory-bowel-disease/the-imaging-of-inflammatory-
bowel-disease-current-concepts-and-future-directions
Εαρινό 2014-2015 MTMBIT 2.2 55
BASIC PRINCIPLES AND DEFINITIONS
Basic image processing steps
Image segmentation:
Region extraction
Adjust and optimize
Image classification/recognition:
Computer-aided diagnosis
56
IMAGE SEGMENTATION
57
IMAGE SEGMENTATION
Thresholding example
Source: Vaidyanathan, M. Monitoring brain tumor response to therapy using MRI segmentation 59
(1997) Magnetic Resonance Imaging, 15 (3), pp. 323-334.
IMAGE SEGMENTATION
(APPLICATIONS)
PRACTICAL APPLICATION: ULTRASOUND
Source: Source:
Source:
http://www.obgyn.net/articl https://sbarnes.wordpress.
http://sirkan.iit.bme.hu/~cseb/P
es/fetal-face-and-hands- com/reseach-interests/mri-
ublications/WSCG00/
3d-surface-rendering-1 interests/
61
BASIC PRINCIPLES AND DEFINITIONS
Basic image processing steps
Image segmentation:
Region extraction
Adjust and optimize
Image classification/recognition:
Computer-aided diagnosis
62
IMAGE CLASSIFICATION/RECOGNITION
Grade
Invasiveness
Normal
Malignant
63
IMAGE CLASSIFICATION/RECOGNITION
(APPLICATIONS)
Source: Matthew S. Brown, Computer-aided Lung Nodule Detection in CT: Results of Large-Scale Observer
Test1, Academic Radiology, Volume 12, Issue 6, June 2005, Pages 681-686, ISSN 1076-6332. 64
LAST BUT NOT LEAST…
IMPROPER USE OF
IMAGE PROCESSING
ORIGINAL IMAGE
PROPER USE OF
IMAGE PROCESSING
65 65
FURTHER READING
1. Gonzalez RC, Woods RE, “Digital image processing”, Prentice Hall; 2002
2. Pratt K. William, Digital Image Processing, John Wiley & Sons, 2001
3. Martinez W.L., Martinez A.R., Computational Statistics Handbook with MATLAB®,
Chapman & Hall/CRC, 2002
4. Young I. et al, Fundamentals of Image Processing, link
5. Housfield, Computed medical imaging, link
6. Cormack, Early two dimensional reconstruction and recent topics stemming from it, link
7. Mather S., The Principles of Diagnostic Imaging, link
66