H C E /H H
E/
HSE311
Department of Computer Engineering
Parallel &Distributed Computing
Parallel Computing Architectures
• What is Parallel Computing Architectures?
• What is Flynn's taxonomy ?
• SISD (Single Instruction, Single Data):
• SIMD (Single Instruction, Multiple Data):
• MISD (Multiple Instruction, Single Data):
• MIMD (Multiple Instruction, Multiple Data):
What is Parallel computing
Architectures
• It refers to the design and
organization of computer
systems that enable the
execution of multiple tasks
simultaneously, thereby
significantly enhancing the
overall computational
power and efficiency.
What is Flynn's taxonomy
• It is a classification system
that categorizes computer
architectures based on the
number of instruction
streams and data streams
they can handle
simultaneously.
Flynn's taxonomy ‘s Classification
• SISD (Single Instruction, Single
Data):
• A single instruction stream operates on a
single data stream at a time.
• It represents the traditional sequential
processing model where one instruction is
executed at a time on a single processor
or core.
• It operates sequentially, executing one
instruction at a time on a single data
stream.
Flynn's taxonomy ‘s Classification
• SISD (Single Instruction, Single
Data):
• Examples
• Minicomputers, workstations,
and computers from previous
generations
Flynn's taxonomy ‘s Classification
• SIMD (Single Instruction, Multiple
Data):
• SIMD architecture operates by applying a
single instruction to multiple data elements
simultaneously.
• It leverages data-level parallelism
• It allows a single instruction to be executed on
multiple data elements in parallel.
Flynn's taxonomy ‘s Classification
• SIMD (Single Instruction, Multiple
Data):
• Examples include GPUs, where a single
instruction is applied to multiple pixels
or vertices simultaneously to
accelerate graphics rendering or
general-purpose computations.
Flynn's taxonomy ‘s Classification
• MISD (Multiple Instruction, Single
Data):
• MISD architecture involves multiple
instructions operating on the same
data stream simultaneously.
• In MISD architecture, multiple
instructions operate on the same data
stream simultaneously.
Flynn's taxonomy ‘s Classification
• MIMD (Multiple Instruction,
Multiple Data):
• MIMD architecture supports
multiple instructions operating on
multiple data streams concurrently.
• MIMD architecture operates with
multiple instructions and multiple
data streams simultaneously.
Flynn's taxonomy ‘s Classification
• MIMD (Multiple Instruction,
Multiple Data):
• Examples include multi-core
processors, where each core
can independently execute
different instructions on
different data
