Signal Processing for Multimedia
22ET5PCSPM
Dr Pushpavathi.K.P
ETE, BMSCE
Multimedia
• Multi: Many, Much, Multiple
• Medium: A channel or system of communication or information.
• Multimedia: indicates that the information/data being transferred over
the network is composed of different media types integrated in
someway.
Pushpavathi.k.P, BMSCE
Types of media
• Text
• Images
• Audio
• Video
Pushpavathi.k.P, BMSCE
Text: can be Unformatted or Formatted.
Image: visual representation of something by scanning it with a
detector- computer generated images or comprising of lines,
curves and circles.
Audio: an audible part of the transmitted signal- speech.
Low fidelity speech- telephone or sound recording that contains
technical flaws like hum or background noise
Pushpavathi.k.P, BMSCE
• High fidelity speech: refers to stereo equipment that very accurately
reproduces music without harmonic distortion or unwanted frequency
emphasis or resonance.
• Video: represents scenes in motion – electronically capturing,
recording, processing, storing, transmitting, and reconstructing a
sequence of still images.
Pushpavathi.k.P, BMSCE
Multimedia information representation:
• Text – Unit – block of character, each character is represented by
codeword.
• Image – block called picture elements, each element is represented
by codeword.
• Audio and video signals : analog signals and relatively long
duration.
eg: Telephone conversation, Movie.
• Single media type.
• Different media types.
Pushpavathi.k.P, BMSCE
Multimedia Networks:
Basic types of communication Network:
1. Telephone networks.
2. Data networks.
3. Broadcast television networks.
4. ISDN’s.
5. Broadband multiservice networks.
Pushpavathi.k.P, BMSCE
Telephone Networks
• Designed to provide basic switched telephone services
• Operate in circuit mode – each call has separate circuit setup through
the network for the duration of call
• Access circuits – links telephone handset to PSTN or PBX – to carry
two way analog signals associated with the call
Pushpavathi.k.P, BMSCE
Telephone network and components
Pushpavathi.k.P, BMSCE
Digital transmission using modems
Pushpavathi.k.P, BMSCE
Multiple services via high speed modem
Pushpavathi.k.P, BMSCE
Digital evolution
Pushpavathi.k.P, BMSCE
Data Networks
• Designed to provide basic data communication services-file transfer, email
• Most widely deployed network – internet
• Communication protocols – set of rules
• Open systems interconnection (OSI)
• Packet mode
Pushpavathi.k.P, BMSCE
Selection of network types connected to internet
Pushpavathi.k.P, BMSCE
Broadcast Television Networks
• Designed to support diffusion of TV and radio program – wide
geographical network
• Broadcast medium – cable distribution network
satellite network
• Multimedia services
Pushpavathi.k.P, BMSCE
Cable network
Pushpavathi.k.P, BMSCE
Satellite /terrestrial broadcast network
Pushpavathi.k.P, BMSCE
Integrated Services Digital Networks (ISDN)
• Provides additional services to PSTN users.
• Achieved through
- Converting access circuits to digital form - Digital subscriber line
(DSL).
- two separate communication channels – 2 calls simultaneously
• Subscriber telephone can be analog or digital.
Pushpavathi.k.P, BMSCE
ISDN cntd.
• Digitization produces a binary stream of 64Kbps.
• Aggregation function – 128kbps.
• Primary access rate – 2Mbps, i.e 30* 64Kbps.
• Also called narrowband ISDN (N-ISDN)
Pushpavathi.k.P, BMSCE
Alternative services by ISDN
Pushpavathi.k.P, BMSCE
Broadband Multiservice Networks (B-ISDN)
• Designed for use as Public Switched network to support multimedia.
• Bit rate > 2Mbps
• Switching and transmission methods must be flexible.
• Cells – fixed size packets.
• Varying transfer rate of cells.
• Asynchronous Transfer Mode (ATM) networks
Pushpavathi.k.P, BMSCE
Pushpavathi.k.P, BMSCE
Multimedia Applications:
• Interpersonal Communications.
• Interactive applications over the internet.
• Entertainment Applications.
Pushpavathi.k.P, BMSCE
Interpersonal Communications:
• Involves speech, image, text or video.
• Single media type or two or more media types are integrated together.
Pushpavathi.k.P, BMSCE
Speech:
• User can make telephone calls through PC.
• Computer Telephony Integration (CTI).
• User can create own private directory of numbers.
• Private and public networks support additional services- Voicemail
and Teleconferencing.
• Internet also support telephony.
• PC to PC telephone call.
• PC to telephone call.
Pushpavathi.k.P, BMSCE
Speech only interpersonal communication
public and private switched telephone networks
Pushpavathi.k.P, BMSCE
Telephony over Internet
Pushpavathi.k.P, BMSCE
Image:
• Facsimile or Fax.
• Alternate form is PC can be used instead of normal fax machine.
• PC Fax.
Pushpavathi.k.P, BMSCE
Image only interpersonal communication- facsimile
Pushpavathi.k.P, BMSCE
Text only – electronic mail
Pushpavathi.k.P, BMSCE
E-mail message format
Pushpavathi.k.P, BMSCE
Text and Image:
• Computer Supported Cooperative Working (CSCW)
shared whiteboard, whiteboard program
Pushpavathi.k.P, BMSCE
Audio and Video
• Video Telephony
Pushpavathi.k.P, BMSCE
Audio and Video cntd.
• Video conferencing – using multipoint control unit (MCU).
Pushpavathi.k.P, BMSCE
Audio and Video cntd.
• Video conferencing – without using multipoint control unit (MCU).
Pushpavathi.k.P, BMSCE
Audio and Video cntd.
• Remote lecture
Pushpavathi.k.P, BMSCE
Audio and Video cntd.
• Multiparty video conferencing
Pushpavathi.k.P, BMSCE
Multimedia
• Voice e-mail
• Video e-mail
• Multi media mail
Pushpavathi.k.P, BMSCE
Multimedia electronic mail structure
Pushpavathi.k.P, BMSCE
Interactive Applications over the Internet
• World wide web (www)
Web Servers (World Wide Web).
Hyperlinks- references.
Creator of the documents- anchors.
Hypertext.
Hypermedia.
Uniform Resource Locator (URL).
Home page.
HTML
Client function- Browser.
Teleshopping, Telebanking.
Pushpavathi.k.P, BMSCE
Schematic of World wide web
Pushpavathi.k.P, BMSCE
World wide web (www) cntd.
• Hyper text linkages b/w pages of documents
Pushpavathi.k.P, BMSCE
Entertainment Applications
• Movie /video –on-demand
• Interactive television
Pushpavathi.k.P, BMSCE
Networking schematic : interaction with video server
Pushpavathi.k.P, BMSCE
Movie /video –on-demand (MOD)
Pushpavathi.k.P, BMSCE
Near Movie–on-demand
Pushpavathi.k.P, BMSCE
Cable distribution network
Pushpavathi.k.P, BMSCE
Satellite broadcast network
Pushpavathi.k.P, BMSCE
Multimedia Terminology:
Pushpavathi.k.P, BMSCE
Information flow
• Continuous mode.
• Block mode.
Pushpavathi.k.P, BMSCE
Continuous media:
• Time dependent.
• Streaming – directly to the destination as it is generated.
• Real time media.
• Bit rate of channel – compatible with the rate the source media is
generated.
• eg. - Audio and video.
• Constant bit rate (CBR) and variable bit rate(VBR).
Pushpavathi.k.P, BMSCE
Block mode media
• Time independent way.
• Down loading.
• Bit rate of the channel –need not be constant
• Round trip delay.
Pushpavathi.k.P, BMSCE
Communication modes
• Simplex.
• Half duplex. Symmetric and Asymmetric.
• Duplex.
• Broadcast.
• Multicast.
Pushpavathi.k.P, BMSCE
Pushpavathi.k.P, BMSCE
Communication channel
• Synchronous channel- constant bit rate
Circuit switched networks.
• Asynchronous channel -variable bit rate
Packet switched networks.
Pushpavathi.k.P, BMSCE
Circuit Switched Networks
• Interconnected set of switching offices
• Subscriber terminals – connected to switching offices
• Bit rate – fixed
• Signaling Messages- setting up and clearing a connection.
• Call/ Connection set up delay.
• PSTN and ISDN
Pushpavathi.k.P, BMSCE
Circuit Switched Networks schematic
Pushpavathi.k.P, BMSCE
Packet Switched Networks
• Connection oriented (CO).
• Connectionless (CL).
Pushpavathi.k.P, BMSCE
Connection oriented network
• Eg. - internet
• Each terminal connected to network – unique number/address
• Connection is first set up – virtual connection or virtual circuit (VC)
• Virtual circuit Identifier (VCI)
• Routing table
• 3 phase – call set up
information transfer
call clear
Pushpavathi.k.P, BMSCE
Connection oriented network (cntd.)
Pushpavathi.k.P, BMSCE
Connectionless network
• Eg. – ATM networks (fast packet switching n/w or cell switching n/w)
• Setting up of connection - not required
• Each packet – full source and destination address to route the packets
• Here PSE – called router
Pushpavathi.k.P, BMSCE
Connectionless network (cntd.)
Pushpavathi.k.P, BMSCE
Packet Switched Networks(cntd.)
• Packet is stored in Memory buffer.
• Error detection.
• Best effort service.
• Enter an queue- queuing delay.
• Store and forward technique -Store and forward delay.
• Overall transfer delay - Mean packet transfer delay.
• Variation about the mean – delay variation or jitter
Pushpavathi.k.P, BMSCE
Multipoint Conferencing
• Audio and video conferencing, data sharing, CSCW
• Implemented as
• Centralized mode.
• Decentralized mode.
• Hybrid mode.
Pushpavathi.k.P, BMSCE
Centralized mode:
• Used with circuit switched n/w like PSTN/ISDN.
• centralized conference server.
• Set up the connection prior
to sending the information.
Pushpavathi.k.P, BMSCE
Decentralized mode
• Used with packet switched n/w
• Conference server –not used
Pushpavathi.k.P, BMSCE
Hybrid mode
Pushpavathi.k.P, BMSCE
Types of Conferencing:
• Data Conferencing – data sharing
• Audio Conferencing – audio only – use audio bridge
• Video Conferencing – audio, video – use MCUs
• Multimedia Conferencing – audio, video, data - use MCU
Pushpavathi.k.P, BMSCE
Cntd.
• MCU consists of two parts:
Multipoint Controller – establish the connection to each
participant
Multipoint Processor – distribution of information stream
• Dial-in mode – participant calling in
• Dial-out mode – MCU calls the participants
Pushpavathi.k.P, BMSCE
Reference
• Multimedia communications- applications, networks, protocols and
standards by Fred Halsall
Pushpavathi.k.P, BMSCE
