Chapter 5:

Multimedia Database
System
•Design and Architecture of a Multimedia database
•Indexing and organizing multimedia data

Dr. Zafar Sheikh

chapter5: Multimedia Database System 1
 Multimedia Architecture
• Multimedia Architecture Requirements
– ACID test
– Multimedia Server Requirements
• Distributed Multimedia System
– Super server concept
• Client-Server Systems
• P2P
• Media Streams

chapter5: Multimedia Database System 2

 No Intergration

id size fps title filename

000001 530M 30 soam l6.mpg

000002 450M 30 tibor l7.mpg
000003 600M 30 parag l5.mpg
000004 510M 30 wei l4.mpg

chapter5: Multimedia Database System 3

 Semi-intergrated

BLOB

000001b70ae9902...

chapter5: Multimedia Database System 4

Fully Intergrated

 
index
 

  buffers


chapter5: Multimedia Database System
storage

5
 Multimedia Architecture Requirements
• Database architecture as a structure that facilities
the database to complete a transaction
• Four basic properties that a transaction should
posses
– Atomicity: All or nothing property. A transaction is an
indivisible unit that is either performed or not
•

– Consistency: A transaction must transform the database

from one consistent state to another consistent state
– Independence: Transactions execute independently of
one another
– Durability: The effects of a successfully committed
transaction should be permanently recorded in the
database
– ACID test of transaction reliability
chapter5: Multimedia Database System 6
 ACID test
• For a single-user PC database where only one
person is carrying out transactions at any one time
the circumstances for the ACID test may be
irrelevant
• Important for large number of users which access
the database at the same time

– A transaction can than only be achieved by locking the

data rows involved to stop other users changing the
data

– Replicated database there may be more than one copy

of the data that needs to be updated at the same time

chapter5: Multimedia Database System 7

• Architecture of a multi-user database can
become complex

• It is not clear which architecture would be

the best option for a multimedia database
– A transaction involving multimedia data will
in general be expected to take longer
– Locks will have to be maintained for longer
periods

chapter5: Multimedia Database System 8

• Formal database architecture
• Separate user view from the system view
• Three-layer architecture

chapter5: Multimedia Database System 9

 Three-layer architecture

• The external level provides the user's view of the

database
– It is a partial view
• The conceptual level is the community view of
the database
– Logical level as seen by the system administrator
– In a relational database, relational conceptual level
• Internal level
– The way the data is physically stored
– In a relational database the internal level must not be relational
• Records, pointers, etc..

chapter5: Multimedia Database System 10

• For multimedia objects, performance depends on the
rate at which information can be transferred from
storage memory for processing
• Block size affects the performance
– Number of fetch operations

chapter5: Multimedia Database System 11

 The architecture of the database system
• The architecture of the database system is
influenced by the underlying computer and
network system
– Centralized database system run on a single
computer system that does not interact with other
computer systems
– Client-server system, networking computers
allow a division of work. Task relating to database
structure are executed on server, presentation on
the client computer
– Distributed database systems have been
developed to handle geographically and
administratively distributed data spread over
multiple computer systems
chapter5: Multimedia Database System 12
chapter5: Multimedia Database System 13
 Multimedia Server Requirements

• Often large scale applications

• Take into account:
– User access behavior
– Bandwidth
– Storage requirements
• (Complex multimedia formats)

chapter5: Multimedia Database System 14

 Storage hierarchy
• Example, videos on demand:
• High popular videos are stored in storage
media with the highest bandwidth

chapter5: Multimedia Database System 15

 Characteristics

• Minimal response time

• Reliability and availability
• Ability to sustain guaranteed number of
streams
• Real-time delivery
• Exploit user access patterns

chapter5: Multimedia Database System 16

 Distributed Multimedia System

• In a relational database that is distributed a

table may be divided into a number of
subrelations
• Horizontally - fragments consists of columns
but only some rows
• Vertically - fragments consists of all rows but
only some columns
• Partitioning of the data

chapter5: Multimedia Database System 17

 Distributed Multimedia System

• Replicate fragments so that duplicates are

stored on several sites
• LOBs (video, music)) movements to a site,
where they are likely to be requested
(duplicates)
– Even daily basis!

chapter5: Multimedia Database System 18

 Scalability

• Increasing number of users

• Size of data objects
• Amount of accessible data
– Search, access, management
• Non-uniform request distribution

chapter5: Multimedia Database System 19

 Super server concept
• Distribute load among several servers
– Problems arise when server selection is
mainly based on systems defaults or on the
user choice
– This kind of static selection can cause uneven
loads
• Dynamic server selection by alternatively
mapping the servers in a local cluster
• Saves local load problems

chapter5: Multimedia Database System 20

 Super server concept
• Requests are directed to an appropriate
server according to the location and the
requested data, the current load of the
servers, the location of the servers and the
available network bandwidth
• User contacts a multimedia server as a
normal server, and it makes the decision
which is the most appropriate server

chapter5: Multimedia Database System 21

 Client-Server Systems

• A special case of distributed systems

– Certain sites are designated as clients and
others as servers
• Introduce
– DataLinks as a specific art of SQL3
– Development of intelligent middleware

chapter5: Multimedia Database System 22

 DataLinks
• Store large unstructured data objects in a
file system near a relational database
• Allows existing applications to
incorporate multimedia with no changes
to them
• Video and audio objects need to be
streamed out to the client
– Database servers do not have these
capabilities

chapter5: Multimedia Database System 23

 Intelligent Middleware
• Change information across systems
developed by different vendors
– Oracle,Ingres,DB2,MySQL
• Integration of information
• Three-tier systems were developed
– Gateway to manage connections between the
databases
• In large system there will be many servers
– Data from local and external resources

chapter5: Multimedia Database System 24

3- tier System using mediator

chapter5: Multimedia Database System 25

 Peer-to-Peer Networks

• Type of network in which each workstation

has equivalent capabilities and
responsibilities
• A peer-to-peer (P2P) application is
different from traditional client-server
model
• Applications act both as client and server
• P2P networks are simpler
– Low performance under heavy load

chapter5: Multimedia Database System 26

 P2P application

• No central server
– Napster (original), Freenet
• Discovering other peers
• Querying peers for content
• Sharing content with other peers

chapter5: Multimedia Database System 27

 Heterogeneous Distributed DBMS
• Homogenous system all the sites use the
same DBMS system
• Heterogeneous system different DBMS,
different data models

chapter5: Multimedia Database System 28

 Content Management

• Integration of a number of technologies

• Degree of semantics
– Artifacts (date, location), content information
(sentence, key shape, color histogram),
domain concepts like ontologies
• Decomposition of media into a database in
terms of storage of metadata, building an
indexing structure
– should be an automatic process

chapter5: Multimedia Database System 29

chapter5: Multimedia Database System 30
 Media Streams

• An important objective of multimedia

systems design is to transfer data at a
constant speed
• Streaming is a technique for transferring
data, so that it can be processed as a
steady and continous stream
• By using streaming, the client browser can
display the data before the entire file has
been transmited

chapter5: Multimedia Database System 31

 Definitions

• Media stream: the output of a sensor device such

as a video, audio or motion sensor that produces a
continuous or discrete signal

• Live multimedia: the scenario where the

multimedia information is captured in a real-life
setting

• Continuous queries: persistent queries that are

issued once and then logically run continuously
over live and unbounded streams

chapter5: Multimedia Database System 32

 Media Streams

• If the streaming client receives the data

more quickly than required, it needs to be
saved in a buffer
• However if the data does not arrive
quickly enough, the presentation of the
data will be not smooth

chapter5: Multimedia Database System 33

 Example of MMDBMS

• Digital Library
• News-On-Demand
• Video-On-Demand
• Music Database
• Telemedicine
• Geographic Information System

chapter5: Multimedia Database System 34

 Nature of Multimedia Data

• Large amount of data

• Time sensitive
• Vague matching

chapter5: Multimedia Database System 35

 Database Components

 Query
Interface
Query
Processing

storage buffer index

manager manager
chapter5: Multimedia Database System 36
 Querying

• Image
• Audio
– Music
– Sound
– Speech
• Video

chapter5: Multimedia Database System 37

 Querying Image

• Common approach
– allow query by sketches (color, shape, texture)
or examples.
– perform matching by Feature Vectors
F = (v1, v2, ... vn)
– e.g. Color Histogram

chapter5: Multimedia Database System 38

 Querying Image

• Exisiting Systems :
– QBIC
– VisualSEEK
– PhotoBook
– Virage
– FourEyes

chapter5: Multimedia Database System 39

 Indexing and organizing multimedia data

• Requirements
– support spatio-temporal operations
– support fuzzy matches

chapter5: Multimedia Database System 40

 Indexing Images

• N-dimentional indices for feature

vector
• Well studied in DB/CG community
• Two examples :
– VP-tree
– R-tree

chapter5: Multimedia Database System 41

 VP-tree

R
Q
P

R PQS VWTU

T
S

U
W
V

chapter5: Multimedia Database System 42

 VP(Vantage-point)
-tree

R
Q
P

R P U

T
S VW
S Q T
U
W
V

chapter5: Multimedia Database System 43

 R-tree

chapter5: Multimedia Database System 44

 Indexing Audio

• Audio are modeled as strings

• Inexact match is needed
• Common indices for string search
can be used
• Example
– PAT-tree

chapter5: Multimedia Database System 45

 PAT(Patricia )-tree

ab b c

abc c abc c

ababc abc babc bc c

chapter5: Multimedia Database System 46

 Indexing Video

• Treat time as third dimension

• We can use any multidimension
indexing structures

chapter5: Multimedia Database System 47