UNIT 2 Part2
UNIT 2 Part2
o The use of physical database design is to alter the logical description of data into
the technical specifications for retrieving and storing data for the DBMS.
o The aim is to create a design for storing data that will give adequate performance
and make sure database integrity, recoverability and security.
Some of the basic inputs needed for Physical Database Design are:
o Normalised relations
o Attribute definitions - Choosing the data type for each attribute from the logical data
model to mininize storage space and to maximize data integrity
o Data usage: retrieved, entered, deleted, updated - Arranging similarly structured
records in secondary memory so that individual and groups of records can be stored,
retrieved and updated rapidly.
o Requirements for security, recovery, backup, retention, integrity- protecting and
recovering data after errors are found
o DBMS characteristics. - Selecting structures for storing and connecting files to make
retrieving related data more efficient.
o Performance criterion such as response time necessity with respect to volume
estimates.- preparing strategies for handling queries against the database that will
optimize performance and take advantage of the file organizations and indexes which
have been specified.
Though, for this type of data some of the Physical Database Design Decisions that are
to be taken are:
o 1. The first step to take in physical database design is to estimate the size
and usage patterns of the database.(Data volume and access frequencies) -
o 2. Choosing data type for each attribute from the logical data model. -
Optimising attribute data types. And Modifying the logical design.
o 3. To minimize storage space and to maximize data integrity. - Specifying
the file Organisation.
o 4. Selecting indexes for storing and connecting files to make retrieving
related data more efficient. - .
o 5. Preparing strategies for handling queries against the database.
The following decisions effect these issues during physical database design.
1. Choosing the storage format for each attribute from the logical data model.
INDE499B, Classroom Preparation for 10/30/00
2. Grouping attributes from the logical data model into physical records.
4. Selecting structures for storing and connecting files to make retrieving related
data more efficient.
5. Preparing strategies for handling queries against the database that will
opitmize performance and take advantage of the file organizations and indexes
that you have specified.
Types of Memory
1. Primary Memory
The primary memory of a server is the type of data storage that
is directly accessible by the central processing unit, meaning that
it doesn’t require any other devices to read from it. The primary
memory must, in general, function flawlessly with equal
contributions from the electric power supply, the hardware
backup system, the supporting devices, the coolant that
moderates the system temperature, etc.
• The size of these devices is considerably smaller and they are
volatile.
• According to performance and speed, the primary memory
devices are the fastest devices, and this feature is in direct
correlation with their capacity.
• These primary memory devices are usually more expensive
due to their increased speed and performance.
The cache is one of the types of Primary Memory.
• Cache Memory: Cache Memory is a special very high-speed
memory. It is used to speed up and synchronize with a high-
speed CPU. Cache memory is costlier than main memory or
disk memory but more economical than CPU registers. Cache
memory is an extremely fast memory type that acts as a buffer
between RAM and the CPU.
2. Secondary Memory
Data storage devices known as secondary storage, as the name
suggests, are devices that can be accessed for storing data that
will be needed at a later point in time for various purposes or
database actions. Therefore, these types of storage systems are
sometimes called backup units as well. Devices that are plugged
or connected externally fall under this memory category, unlike
primary memory, which is part of the CPU. The size of this group
of devices is noticeably larger than the primary devices and
smaller than the tertiary devices.
• It is also regarded as a temporary storage system since it can
hold data when needed and delete it when the user is done
with it. Compared to primary storage devices as well as tertiary
devices, these secondary storage devices are slower with
respect to actions and pace.
• It usually has a higher capacity than primary storage systems,
but it changes with the technological world, which is expanding
every day.
Some commonly used Secondary Memory types that are present
in almost every system are:
• Flash Memory: Flash memory, also known as flash storage, is
a type of nonvolatile memory that erases data in units called
blocks and rewrites data at the byte level. Flash memory is
widely used for storage and data transfer in consumer devices,
enterprise systems, and industrial applications. Unlike
traditional hard drives, flash memories are able to retain data
even after the power has been turned off
• Magnetic Disk Storage: A Magnetic Disk is a type of
secondary memory that is a flat disc covered with a magnetic
coating to hold information. It is used to store various programs
and files. The polarized information in one direction is
represented by 1, and vice versa. The direction is indicated by
0.
3. Tertiary Memory
For data storage, Tertiary Memory refers to devices that can hold
a large amount of data without being constantly connected to the
server or the peripherals. A device of this type is connected
either to a server or to a device where the database is stored
from the outside.
• Due to the fact that tertiary storage provides more space than
other types of device memory but is most slowly performing,
the cost of tertiary storage is lower than primary and
secondary. As a means to make a backup of data, this type of
storage is commonly used for making copies from servers and
databases.
• The ability to use secondary devices and to delete the contents
of the tertiary devices is similar.
Some commonly used Tertiary Memory types that are almost
present in every system are:
• Optical Storage: It is a type of storage where reading and
writing are to be performed with the help of a laser. Typically
data written on CDs and DVDs are examples of Optical
Storage.
• Tape Storage: Tape Storage is a type of storage data where
we use magnetic tape to store data. It is used to store data for
a long time and also helps in the backup of data in case of data
loss.
Memory Hierarchy
A computer system has a hierarchy of memory. Direct access to
a CPU’s main memory and inbuilt registers is available.
Accessing the main memory takes less time than running a
CPU. Cache memory is introduced to minimize this difference in
speed. Data that is most frequently accessed by the CPU resides
in cache memory, which provides the fastest access time to data.
Fastest-accessing memory is the most expensive. Although large
storage devices are slower and less expensive than CPU
registers and cache memory, they can store a greater amount of
data.
1. Magnetic Disks
Present-day computer systems use hard disk drives as
secondary storage devices. Magnetic disks store information
using the concept of magnetism. Metal disks are coated with
magnetizable material to create hard disks. Spindles hold these
disks vertically. As the read/write head moves between the disks,
it de-magnetizes or magnetizes the spots under it. There are two
magnetized spots: 0 (zero) and 1 (one). Formatted hard disks
store data efficiently by storing them in a defined order. The hard
disk plate is divided into many concentric circles, called tracks.
Each track contains a number of sectors. Data on a hard disk is
typically stored in sectors of 512 bytes.
2. Redundant Array of Independent Disks(RAID)
In the Redundant Array of Independent Disks technology, two or
more secondary storage devices are connected so that the
devices operate as one storage medium. A RAID array consists
of several disks linked together for a variety of purposes. Disk
arrays are categorized by their RAID levels.
• RAID 0: At this level, disks are organized in a striped array.
Blocks of data are divided into disks and distributed over disks.
Parallel writing and reading of data occur on each disk. This
improves performance and speed. Level 0 does not support
parity and backup.
Raid-0
Raid-1
Raid-2
Raid-3
Raid-5
Storage Hierarchy
Rather than the storage devices mentioned above, there are also
other devices that are also used in day-to-day life. These are
mentioned below in the form of faster speed to lower speed from
top to down.
Storage Hierarchy
can access the records. The type and frequency of access can
be determined by the type of file organization which was
used for a given set of records.
o File organization is a logical relationship among various
the several files and store only one fixed length record in any
given file. An alternative approach is to structure our files so
that we can contain multiple lengths for records.
o Files of fixed length records are easier to implement than the
update or delete.
o For the minimal cost of storage, records should be stored
efficiently.
Types of file organization:
Suppose we have four records R1, R3 and so on upto R9 and R8 in a sequence. Hence, records are nothing but a row
in the table. Suppose we want to insert a new record R2 in the sequence, then it will be placed at the end of the file.
Here, records are nothing but a row in any table.
Suppose there is a preexisting sorted sequence of four records R1, R3 and so on upto R6 and R7. Suppose a new
record R2 has to be inserted in the sequence, then it will be inserted at the end of the file, and then it will sort the
sequence.
If the database is very large then searching, updating or deleting of record will be time-consuming because there is
no sorting or ordering of records. In the heap file organization, we need to check all the data until we get the
requested record.
In this method, there is no effort for searching and sorting the entire file. In this method, each record will be stored
randomly in the memory.
B+ File Organization
o B+ tree file organization is the advanced method of an indexed sequential access method. It uses a tree-like
structure to store records in File.
o It uses the same concept of key-index where the primary key is used to sort the records. For each primary
key, the value of the index is generated and mapped with the record.
o The B+ tree is similar to a binary search tree (BST), but it can have more than two children. In this method, all
the records are stored only at the leaf node. Intermediate nodes act as a pointer to the leaf nodes. They do
not contain any records.
The above B+ tree shows that:
o There is one root node of the tree, i.e., 25.
o There is an intermediary layer with nodes. They do not store the actual record. They have only pointers to
the leaf node.
o The nodes to the left of the root node contain the prior value of the root and nodes to the right contain next
value of the root, i.e., 15 and 30 respectively.
o There is only one leaf node which has only values, i.e., 10, 12, 17, 20, 24, 27 and 29.
o Searching for any record is easier as all the leaf nodes are balanced.
o In this method, searching any record can be traversed through the single path and accessed easily.
Pros of ISAM:
o In this method, each record has the address of its data block, searching a record in a huge database is quick
and easy.
o This method supports range retrieval and partial retrieval of records. Since the index is based on the primary
key values, we can retrieve the data for the given range of value. In the same way, the partial value can also
be easily searched, i.e., the student name starting with 'JA' can be easily searched.
Cons of ISAM
o This method requires extra space in the disk to store the index value.
o When the new records are inserted, then these files have to be reconstructed to maintain the sequence.
o When the record is deleted, then the space used by it needs to be released. Otherwise, the performance of
the database will slow down.
In this method, we can directly insert, update or delete any record. Data is sorted based on the key with which
searching is done. Cluster key is a type of key with which joining of the table is performed.
In indexed cluster, records are grouped based on the cluster key and stored together. The above EMPLOYEE and
DEPARTMENT relationship is an example of an indexed cluster. Here, all the records are grouped based on the cluster
key- DEP_ID and all the records are grouped.
2. Hash Clusters:
It is similar to the indexed cluster. In hash cluster, instead of storing the records based on the cluster key, we generate
the value of the hash key for the cluster key and store the records with the same hash key value.
TYPES of INDEXES
Indexing in DBMS – Types of Indexes in Database
A database index is a data structure that helps in improving the speed of data access.
However it comes with a cost of additional write operations and storage space to store
the database index. The database index helps quickly locate the data in database
without having to search every row of database. The process of creating an index
for a database is known indexing. In this guide, you will learn various types of Indexes
in DBMS (Database management system) with examples.
2. In the library, the books are arranged on the shelf in an alphabetical order. If
you are looking for a book starting with the the letter ‘A’ then you go to the shelf ‘A’.
Here shelf naming with the letter ‘A’ is the index. Imagine if the books are not arranged
in alphabetical order in shelves, it would take a very long time to search for a book.
1. First field is the search key, this is the column that a user can use to access the
record quickly. For example, if a user is searching for a student in database, the user
can use student id as a search key to quickly locate the student record.
2. The second field contains the address of the student record in the database.
Remember indexing doesn’t replicate the whole database, rather it creates an index that
refers to the actual data in database. This field is a reference to the data. If user is
searching for a student with student id “S01” then the S01 is the search key and the
second field of the index contains the address where the student data such as student
name, age, address is stored.
Indexing Methods
Ordered indices
1. Dense Index
In Dense Index, there is an index for every record in the database. For example, if a table
student contains 100 records then in dense index the number of indices would be 100, one
index for each record in table.
If more than one record has the same search key then the dense index points to the first record
in the database that has the search key.
The dense name is given to this index is based on the fact that every record in the database has
a corresponding index in index file so the index file is very dense in this index based database.
Advantages of dense indexes:
1. Searching a record is faster compared to other indexes.
2. It doesn’t require the database to be sorted in any order to generate a dense indexes.
2. Sparse Index
In this index based system, the indexes of very few data items are maintained in the index
file. Unlike Dense index system where every record has an index entry in index file, in this
system, indexes are limited to one per block of data items as shown in the following diagram.
In sparse indexing database needs to be sorted in an order.
For example, let’s say we are creating a sparse index file for student database that contains
records for 100 students.
Student records are divided in blocks where every block contains two records. If index file
contains the indexes for alternate records then we need to maintain indexes for only 50 records
whereas in dense index system, we had to have 100 records in index file.
Write operations to
be generated.
It requires the
sorted.
For example:
Let’s say students are assigned to multiple courses and we are creating indexes
on course_id filed. In this case, all the students that are assigned to a
particular course_id form a cluster and the index for that particular course_id points to this
cluster as shown in the following diagram.
This helps in quickly locating a record in a particular cluster as the the size of the cluster is
limited and smaller than the actual database so searching a record is faster.
One of the type of clustered indexing is primary indexing: In this type of clustered indexing, data
is sorted based on the search key. In this type of indexing, searching is even faster as the
records are sorted.
4. Non-clustered or secondary indexing
In non-clustered indexing, the indexing is done on multiple levels. This indexing is also known
as secondary indexing.
For example, let’s say we have records of 300 students in database, instead of creating indexes
for 300 records on the root level, we create indexes for 1st student records, 101st student and
201st student. This index is maintained in the primary memory such as RAM. Here we have
divided the complete index file in three groups.
The second level of indexes are stored in hard disk, the primary index file is stored in
RAM, refers to this file and this file then points to the actual data block in memory as shown
below:
1. Multilevel index
B+ Tree structure
o The B+ tree is a balanced binary search tree. It follows a
multi-level index format.
o In the B+ tree, leaf nodes denote actual data pointers. B+
tree ensures that all leaf nodes remain at the same height.
o In the B+ tree, the leaf nodes are linked using a link list.
Therefore, a B+ tree can support random access as well as
sequential access.
Structure of B+ Tree
o In the B+ tree, every leaf node is at equal distance from the
Intenal node
o An internal node of the B+ tree can contain at least n/2
values.
o Every leaf node of the B+ tree contains one block pointer P
B+ Tree Insertion