Thanks to visit codestin.com
Credit goes to www.scribd.com

Scribd
Upload
32 views8 pages

HDFS Architecture

Uploaded by

jr9617883006
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
32 views8 pages

HDFS Architecture

Uploaded by

jr9617883006
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 8

HDFS (Hadoop Distributed File System)

 HDFS is specially design file system for storing huge data set with cluster of commodity
hardware with streaming access pattern.
 Streaming access pattern: - Write once but read anywhere, any time
In normal file system

 Memory is split into blocks.


 Each block contain of size 4 KB.
 In 4kb block if 2Kb is used then remaining 2Kb will be wasted.
In HDFS

 In hdfs each block size is 64MB and it can be changed upto 128Mb.

 Suppose in 64Mb block, if I am using 50Mb then remaining 24Mb will be realized for
other work not wasted.
HDFS Contain Following services
1. Name node
2. Secondary Name Node
3. Job Tracker
4. Data node
5. Task Tracker
It is a master and slave service
Master Services Slave Services
Name node Data node
Secondary name node Task tracker
Job Tracker

 Every master service can talk to each other.

 Every slave service can talk to each other.


HDFS Architecture
Hadoop Cluster is a collection of Rack
How data block stored in racks
How the hadoop cluster look like

You might also like