Storage for Networking Professionals
Presented by
Elaine Silber
Training and Certification Director
Infinity I/O
www.InfinityIO.com
Page 1
SNIA Legal Notice
The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in presentations and literature under the following conditions:
Any slide or slides used must be reproduced without modification The SNIA must be acknowledged as source of any material used in the body of any document containing material from these presentations.
This presentation is a project of the SNIA Education Committee.
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 2
Aims and Objectives
This tutorial is intended to be an introduction to basic storage technologies, techniques and terminology associated with data storage devices for networking professionals. It provides an introduction for industry professionals who wish to acquire these fundamentals of data storage before attending more targeted networked storage presentations
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 3
Outcomes
After attending this tutorial you should be able to:
Understand basic storage terms and technology and the basic operation of hard disk drives Identify the components of the SNIA Shared Storage Model Appreciate how disk drive characteristics impact performance Describe storage concepts, including LUN mapping, zoning, volume manager and file systems Describe basic storage protection techniques - RAID Identify tape storage technologies Learn Storage connectivity approaches Understand Tiers of Storage (TOS) as seen from an Information Life Cycle Management point of view
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 4
Networking vs Storage Language
The Language of Networking The Language of Storage
Data over Distance Information movement Configuring and segmenting network topologies Hubs, bridges, switches, routers, gateways, NIC (Network Interface Card), HBA (Host Bus Adaptor) Inherently error prone and acceptable Client/Server applications Email, Web Browsing, File Management Network Interfaces Data over Time Information repository Formatting and partitioning hard disks, Tiers of Storage (TOS) JBOD, RAID, Tape drive Controllers Designed to maximize correct delivery. Expect error free. Initiator/Target Functions Backup, Archive, Mirror, Block Management I/O interfaces
Page 5
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Networking vs Storage Language
The Language of Networking The Language of Storage
Speed, Solid State Media - Copper, Fiber, Wireless Bits in packets, CRC error checks every packet Buffers and Link transfer rates Kb/s, Mb/s, Gb/s Interconnectivity network and device latencies bottlenecks Applications HTTP, NFS, SMTP Transport Protocols (TCP/IP/Ethernet), Fibre Channel Capacity, Mechanical Movement Media Disk, Tape Bytes in blocks, Parity check every byte Cache and Disk/Tape I/O interface transfer rates MB/s Throughput Disk/Tape seek times and latencies ms, us, ns Logical Device Protocols Serial SCSI, FC, IDE/ATA Physical Protocols Parallel SCSI
Page 6
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Historical View of Storage/Network
Host-attached storage Network Administrators saw storage as a black box Storage Managers saw the network as a cloud
Storage Admin Network Admin Database Manager
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 7
Current View of Shared Storage
Storage is a shared resource Separate from the computer system (host) Hosts are consumers of storage
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 8
Overall Terminology Confusion Classic Storage Model
Applications
Storage Domain:
Host
Anything goes?
Appliance?
Network?
Disk array? Data mover?
JBOD?
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 9
SNIA Shared Storage Model
Applications
File/record layer
Files/Databases Files/Databases
Storage Domain
Database (dbms)
File system (FS)
Packing many smaller things into a few larger ones..
Block Layer Block Layer Host
Network Device Storage Devices disk drives, tape drives, solid state disk Block Aggregation address mapping, concatenation, striping, mirroring
Block layer
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Storage Devices
Block Aggregation
Page 10
Storage Basics
Disk Physical Characteristics
Page 11
Disk Drives Walk the Same Walk
From a component perspective, all disk drives are basically the same. A disk platter, usually comprising an aluminum or glass substrate material that is sputter-coated with a magnetically corrosive media (chromium, ruthenium, etc.), provides a precision surface area in which discrete data bits can be written into a series of tracks. Jon William Toigo
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 12
The ABCs of Physical Addressing
Head
Read/write head Defines a single disk surface
Cylinder
The information that can be accessed on a disk drive by all the heads, without having to seek
Sector
A subdivision of a disk surface which is created during formatting (typically a 512-byte segment)
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 13
The ABCs of Physical Addressing
16 Logical Heads Specifications on label: 1416 Cylinders (1416 tracks) 16 Heads 63 Sectors
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
But 4 Physical Heads
Page 14
The ABCs of Disk Performance
Data transfer time is determined by:
Speed of I/O technology (SCSI, Fibre Channel, etc) Seek time (time for heads to move to a new track) Latency (time for sector to rotate under heads) Speed and size of disk drive buffer memory Whether the demand equals offered load
(Can drive keep up with it speed of disk drive vs throughput)
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 15
Storage Basics
Storage Interfaces
Page 16
Drives Do Not Talk the Same Talk
Drive Interface
Parallel IDE/ATA or Serial ATA (sometimes abbreviated SATA)
Integrated Drive Electronics (IDE), AT Attachment (ATA)
Parallel SCSI or SAS (Serial Attached SCSI) Fibre Channel
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 17
Drives Do Not Talk the Same Talk
Drive Interface
Parallel IDE/ATA
lower-cost devices than SCSI, controller/drive electronics wedded to the drive itself. IDE standardizes how disk drives are connected to servers via a ribbon cable and an interface connector on a PC or server motherboard. IDE/ATA protocol five+ revisions, For 10 years now speeds and feeds keeping pace with speed- and capacity-hungry applications. Little improvement in transfer rate expected in future Difficult to create arrays with Parallel ATA
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 18
Drives Do Not Talk the Same Talk
Drive Interface
Serial ATA (sometimes abbreviated SATA)
is a standards-based interface that improves on parallel IDE/ATA interface transfer rate is 150Mb/s, (compared with parallel ATA's 100Mb/s) That's a 50% increase, particularly useful in applications with large data volume requirements, such as video editing. First Generation SATA drives not yet more efficient than Parallel ATA, SATA-2 and SATA-3 - expected transfer rates of 300 and 600 Mb/s Still limited by max speed of PCI bus at 133 Mb/s
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 19
Drives Do Not Talk the Same Talk
Drive Interface
Parallel SCSI
Several standards-based iterations, Confusing descriptors Fast, Wide, Ultra Currently, UltraSCSI 3 or Ultra160 SCSI transfer rates of 160Mb/s attach up to 16 devices on a single bus. Ultra320 andUltra640 are demonstrated at trade shows Doubling and quadrupling of transfer rates No significant improvement in device attachment or cabling distance characteristics. Note Tape Drive speeds do not come close to SCSI bus speeds which is a good thing in order to keep drives moving
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 20
Drives Do Not Talk the Same Talk
Drive Interface
SAS (Serial Attached SCSI)
Greater throughput Higher device attachment capabilities Greater cabling distances http://www.scsita.org/aboutscsi/presentations.html
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 21
Drives Do Not Talk the Same Talk
Reliability SCSI Drives
Mechanical pieces of a SCSI disk drive are manufactured with a higher duty cycle Enterprise drives, supporting highperformance transaction processing databases, are constantly being beaten on by random seeks.
CPU Utilization SCSI & FC drives
Responsibility is split between the host processor and a specialized processor on the hard disk assembly for performing functions such as queue management.
IDE/ATA drives
The electronics in an IDE/ATA drive rely on the host processor to perform all storage tasks.
IDE/ATA drives
Considerably lower duty cycles. For PCs.
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 22
Storage Basics
Protocols
Page 23
SCSI Standards Architecture*
SCSI Block Commands (e.g., disk drive) (SBC, SBC-2)
Reduced Block Commands (e.g., disk drive) (RBC, RBCAM-1)
SCSI Stream Commands (e.g., tape drive) (SSC, SSC-2, SSC-3)
SCSI Media Changer (e.g., jukebox) (SMC, SMC-2)
Multi-Media Commands (e.g., DVD) (MMC, MMC-2-5)
SCSI Controller Commands (e.g., RAID) (SCC-2)
SCSI Enclosure Services (SES, SESAM1, SES-2)
Device Specific Command Sets
Object Based Storage Device (OSD)
Management Server Commands (MSC)
Primary Commands for All Devices (SPC, SPC-2, SPC-3)
Shared Command Set Architectural Model
SAM SCSI Architectural Model (Originally SCSI-3)
SCSI Parallel Interface (SPI-2-5)
Serial Bus Protocol (SBP-2-3)
Fibre Channel Protocol (FCP, FCP-2, FCP-3)
SSA-SCSI-3 Protocol (SSA-S3P) SSA-TL2
SCSI-RDMA Protocol (SRP, SRP-2)
iSCSI
Serial Attached SCSI (SAS, SAS1.1)
Transport Protocols
Related Standards and Technical Reports (SDV, PIP, SSM, SSM2 and EPI)
IEEE-1394
Fibre Channel (FC)
SSA- PH1 or SSA-PH2
InfiniBand TM
Internet
Physical Interfaces
Storage for Networking Professionals *See Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 24 Tutorial SCSI The Protocol for all Storage Architectures
ABCs of SCSI Addressing
SCSI Initiator Host Bus Adaptor
Data/Address Bus
ID7
Interface Interface
Control Signals Interface
SCSI RAID
ID0
SCSI RAID
ID4
SCSI RAID
ID6
LUN 0 LUN 1 LUN 2 LUN 3
LUN 0 LUN 1
LUN 0 LUN 1 LUN 2 LUN 3
Address = BUS : Target ID : LUN
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 25
How do you route SCSI?
SCSI isnt a routable protocol so how do you route SCSI?
SCSI-FCP FCIP
Ethernet header IP TCP header
FCIP Header
S O F
FC Frame Header
Payload: SCSI Command in IU
C R C
E O F
S O F
FC Frame Header
Payload: SCSI Command in IU
C E R O C F
F C S
iFCP iSCSI
Ethernet header
IP TCP header
iFCP Header
FC S O Frame F Header
Payload: SCSI Command in IU
C E R O C F
F C S
Ethernet header
IP header
TCP
iSCSI header
Payload: SCSI Command PDU
F C S
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 26
Storage Basics
Basic Storage Protection
Page 27
RAID Flavors
Why RAID? -Redundant Array of Independent Disk
Original work was to get away from large monolithic disks Better performance with more individual disks and smaller
RAID 1Mirrored Volumes RAID 0+1Mirrored Array RAID 4Block-Level Striping with Parity Disk RAID 5Striping with Distributed Parity RAID 10Mirrored Striping Array
See Appendix for further definitions
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 28
RAID Flavors
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 29
Software RAID
Volume A Volume,me B
Volume n
Block A1 Block A2 Block A3
Block B1 Block B2 Parity 3
Block C1 Parity 2 Block C3
Parity 1 Block D2 Block D3
SERVER
RAID STORAGE
Volume management performed by server Parity computation performed by server increased overhead RAID performance dependent on server performance and CPU load For simple environments with lower performance and availability requirements
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 30
Hardware RAID
Volume A Volume,me B
Volume n
Block A1 Block A2 Block A3
Block B1 Block B2 Parity 3
Block C1 Parity 2 Block C3
Parity 1 Block D2 Block D3
SERVER
RAID STORAGE
Volume management performed by RAID controller card Embedded processor in RAID controller to reduce server overhead Parity computation performed by auxiliary processor in controller Dedicated cache memory increases server write performance
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 31
Future for RAID
A SNIA Technical Working Group (TWG) is currently a common RAID Disk Data Format (DDF) Specification Would allow storing RAID configuration on physical disks in a DDF by different vendor implementations in a common format Why? -- Would enable data-in-place migration among systems from different vendors.
www.snia.org/tech_activities/ddftwg
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 32
Storage Basics
Physical vs. Logical
Logical View of Storage
Page 33
Data Presentation Chain
Application
presents
Users Applications Application
presents
File File
Applications Files System Records tuples tables File System Volumes Metadata tables tablespaces I/O Subsystem
File File
presents
Volume
Volume
presents
Logical Blocks
Logical Blocks
presents
RAID Controller
RAID Controller
presents
Phys. Blocks (C/H/S) Disk Drives Page 34
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
What the Host Sees
?
SAN
JBOD (Just a Bunch of Disks)
Identifying storage volumes (SCSI IDs and LUNs) Block Access
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 35
What the Host Sees with JBOD
Logical Disks SCSI LUNs (Logical Units) 5 x 1GB Physical Disks 5 x 1GB
Host A Drive D (2GB) Drive E (500MB) Drive F (500MB) SCSI ID 3 SCSI ID 4 SCSI ID 1
JBOD
1GB 1GB 1GB 1GB LUN 0 LUN 0 LUN 0 LUN 0
Host B Drive D (1GB) Drive E (1GB) SCSI ID 2 SCSI ID 0
SAN
1GB
LUN 0
Volume Manager
HBA (Host Bus Adaptor) Utility
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 36
What the Host Sees with RAID
Logical Disks SCSI LUNs 2 x 1GB 1 x 3GB Physical Disks 5 x 1GB
Host A Drive D (3GB) SCSI ID 2
1GB 1GB 3GB
RAID (Redundant Array of Independent Disks)
LUN 0 LUN 0 LUN 0 LUN 1 LUN 2
Host B Drive D (1GB) Drive E (1GB) SCSI ID 0 SCSI ID 1
SAN
Volume Manager
HBA Utility
RAID Configuration Utility
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 37
Storage Virtualization at Work
Logical Disks Virtualized LUNs 1 x 1GB 1 x 4GB 1 x 5GB
Metadata Manager SCSI ID 2
3GB 1GB
SCSI LUNs 4 x 1GB 2 x 3GB
Physical Disks 10 x 1GB
Host A Drive D (5GB)
1GB 1GB
LUN 0 LUN 0 LUN 0 LUN1 LUN 2
RAID
Host B Drive D (1GB) Drive E (4GB)
4GB 5GB
SAN
1GB 1GB
LUN0 LUN0 LUN 0 LUN 1
RAID
SCSI ID 0 SCSI ID 1
3GB
LUN 2
Volume Manager
HBA Utility
Virtualization Software
RAID Configuration Utility
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 38
Summary: WYSIWYG? Not..
What the file system makes the user believe.
Myfile.doc Myfile.xls Myfile.ppt
Volume Manager keeps track where data blocks are written
13 9 Reality
10 4 12 14 6 1 15 8 11 3 7
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 39
Storage Basics
Tape (no less important)
Page 40
Tape in the SNIA Shared Storage Model
Applications Tape Application (e.g. backup software)
File/record layer
Database (dbms)
File system (FS)
Block Aggregation
Host
Host
Network Device Network Device Extent aggregation
Block layer
Storage Devices
Tape Devices Tape Media
Page 41
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Tape format system
Why Tape?
Speed Faster than disk? Scalability
Real estateGB/sq. ft.
Proven longevity
Legal, Archiving
Unlike disk, tape media and devices are not co-dependent
Transportableoff-site archiving and storagedisaster recovery Media could be read on compatible tape mechanisms Mechanism failure does not compromise data
Serial access is appropriate for reading and writing long streams of data (but not for real-time backup) Disk to disk copy in theory, but disk to disk to tape is reality for backup. Question
If an appliance controls the backup to tapes, can the backup software read it?
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 42
ABCs of Tape Media
Tape Reel Tape Reel Take-up reel Take-up reel
Tape Reel Tape Reel Tape Arms Tape Arms Pinch Rollers Pinch Rollers Read/write head Read/write head
Take-up reel Take-up reel
Leader pin Leader pin Read/write head Read/write head
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 43
Media Compatibility
Tape drives and cartridges are typically developed together as inseparable technologies:
New tape drives may have the capability to read existing cartridges made on older drives Older drives may not have the capability to read the cartridges written by newer drives
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 44
Tape Recording Method
Data is written to tapes in large contiguous sequential blocks (variable size) Access time to a random block on a tape may be long due to serial recording method:
Some technologies read tape from the middle outreduces access time by 50% on average
Tape can achieve streaming speeds in the range of 5 to 30MB/sec (uncompressed) Compressed speeds vs uncompressed speeds
Compression typically done at tape drive Compression ratio is dependent on the data type (e.g. BMP vs JPEG format)
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 45
Automatic Tape Subsystems
Tape Library
Tape automation product Requires host level specialized management software Management path different from data path Automates media selection and loading Uses bar code readers to facilitate media management
No tight connection between tape library and tape drives (unlike tape drives and tape cartridges)
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 46
Storage Basics
Storage Connectivity
Page 47
Storage Connectivity (DAS)
Traditional way of implementing storage Storage is managed by a single host Other hosts must access the storage through that single host, over the LAN
Direct-attached external storage
Fibre Channel SCSI
Tape device Direct-attached internal storage
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Direct-attached external storage
Page 48
Storage Connectivity (NAS)
Provides access to storage over the Network NAS devices contain a thin server that provides file services to other hosts on the LAN using network file access methods File access
NAS appliance
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 49
Storage Connectivity (SAN)
Servers and stand-alone storage devices, connected by a dedicated network Any server can be configured to access any storage array and/or storage to storage access Servers and storage can scale independently Block level access
Tape device
Server
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Storage array
Page 50
Storage Connectivity Transport Technologies
Parallel SCSI Fibre Channel (Serial)
InfiniBand (Serial) iSCSI (Serial) Close integration of Close integration of System Software and System Software and Hardware functions Hardware functions Definable low latencies Definable low latencies In order delivery built in In order delivery built in to the hardware to the hardware
IP based message passing IP based message passing environment environment Variable (high) latencies Variable (high) latencies In-order delivery support In-order delivery support required (TCP) required (TCP) Security and QoS defined Security and QoS defined
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 51
Storage Connectivity Long Distance
Long Distance to Storage Why???
Large campus environment Separate data centers that need improved manageability Disaster recovery or business continuity Vendors want to demonstrate unique features
FC
Short distance <= 100 km
SONET/SDH
Medium distance <= 160km
IP Routed WAN
Long distance > 160km
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 52
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 53
Storage Connectivity Long Distance
Before you go the distance, consider Applications differ in terms of latency and bandwidth Application read and write characteristics vary
some applications read more data than they write some write in small data blocks, others large some have serial activity while others are random
Where is caching being done?
in the server, array or application
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 54
Storage Connectivity Long Distance
Before you go the distance, consider Cross-site replication techniques vary considerably*
Should you mirror the data synchronously, asynchronously or semi-synchronously? Should the storage array do the replication, or should the operating system or application do the replication? Should a virtualization appliance handle the replication? Should you make full replicas of data or just snap copies?
Check out Check out SNIA Tutorial: SNIA Tutorial:
Data Protection Data Protection with Storage with Storage Networks Networks
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 55
Storage Connectivity SAN Extension Options
FC
FCIP
TC P
FCIP over public or private IP (Frame Relay or T1/T3)* FCIP over SONET/SDH FC directly over SONET/SDH Check out Check out FC over DWDM or CWDM SNIA Tutorial: SNIA Tutorial:
Metropolitan and Metropolitan and Wide Area Wide Area Networks Networks
FC AAL ATM SO N ET FC FC
IP
Ethernet/PoS
SO N ET
SONET
SONET DWDM
FCIP
FC over ATM
FC over SONET
FC over SONET over DWDM or CWDM
Page 56
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 57
Hurdles to Overcome
Optical Network Speed
User
User
Doubling every 8-9 months
Storage Capacity
Doubling every 12 months
Compute Power
Doubling every 18 months
Average values
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 58
Storage Basics
New way to look at Storage Information Life Cycle Management (ILM) and Tiers of Storage (TOS)
Page 59
Information Lifecycle
Information lifecycle:
The creation and/or acquisition of the data information comes into the organization either by being created by one or more individuals or by being acquired through e-mails, faxes, letters, phone calls, etc. The publication of the data some information needs to be published, either in print form or on a companys intranet or a public Web site. The retention and/or removal of the data some information must be archived for later use, and some information has a finite purpose and can be discarded once it has served its purpose or is no longer valuable to the organization.
http://www.webopedia.com/TERM/I/ILM.html
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 60
Information Lifecycle MANAGEMENT
IL Management
determining how the information is stored based on how high of a priority the access of the information has in the organization at any given moment. At each stage in the informations lifecycle, the management infrastructure must determine the best software, hardware and storage medium required for the information at that stage, and how those factors differ as the data move through the lifecycle.
Check out Check out SNIA Tutorial: SNIA Tutorial:
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Business Business Continuity Continuity And HA And HA
Page 61
Tiers of Storage (TOS)
Hardware driven*
High-end storage Super RAID Array Middle tier Raid Array Low end storage jbod
features, functionality, capacity, I/O features, functionality, capacity, I/O capabilities, etc capabilities, etc
*Moving beyond data storage By Ed Frauenheim Staff Writer, CNET News.com
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 62
Tiers of Storage (TOS)
Policy Driven
First
How valuable is this information now? What kind of performance do you need now? Where is the best place for storing it? What is the lowest cost that meets your requirements?
Secondly
What Information needs to be protected and how? Backup tiers (Primary, secondary, nearline, online, offline) What is the value of information over time? Migration of data
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 63
Case Study Hardware TOS
Stanford University Information Technology Systems and Services
Feature
Uptime Connectivity Ports Internal Disks RAID levels Maximum LUNs Cache Size Non-Disruptive Upgrades Upgrade Cost per GB Architecture
High- End
>99.999% < 6 min down/year FC, SCSI, ESCON, FICON 16 - 96 SCSI or FC (73GB/146GB) 0, 1,3,5 20,000 16GB 64GB Yes >$120 Monolithic or Modular
Mid-Tier
>99.99% < 1 hour down /year FC 4-8 SCSI or FC (73GB/146GB) 0,1,3 1024 2GB 16GB Yes < $25 Modular
Low-End
>99.9% < 9 hours down /year FC 2 ATA (180GB/250GB) 0,1 32 512MB 1GB Maybe < $7 Modular Page 64
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Case Study End User Requirements
Requirements
8TB usable RAID 5 capacity GT or = 1024 LUNs GT or = 2 Gb/s FC ports Support for existing infrastructure Multipathing LUN copying and Snapshots Ability to support FC and ATA drives
Desirable Features
RAID 1, 1 + 0 Veritas DMP support
DMP Dynamic MultiPathing Hardware agnostic
Replication of volumes to another array Array management by 3rd party tools
Stanford University Information Technology Systems and Services
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 65
Storage Basics
Audience Poll and Q&A
Page 66
Audience Poll
Are you an end user?
Reseller? Vendor?
Have you attended other SNIA Tutorials?
At this meeting or other SNIA event?
Do you have networked storage in place today?
NAS or SAN? Do you plan to within 6 or 12 months?
Have you been SNIAcertified?
Do you or your staff plan on taking exam within 6 to 12 months?
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 67
Q&A / Feedback
Please send any questions or comments on this presentation to SNIA: [email protected]
Many thanks to the following individuals for their contributions to this tutorial.
SNIA Education Committee Elaine Silber Infinity I/O Bob Lockhart Neoscale Brandy Bartyon Medusa Labs Howie Goldstein - HGAI Leroy Budknik Knowledge Transfer John Moores Sandial Systems Barry Walker Infinity I/O SW Worth Microsoft Jim Nelson Vixel Sam Samuel Infinity I/O Barbara Craig QLogic Ronnie Koch Infinity I/O, Africa
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 68
Storage Basics
Appendix Hidden Slides
Page 69
RAID 0Striped Volumes
Volume A Volume B
Volume n
Block 1 Block 3 Block 5
Block 2 Block 4 Block 6
SERVER
RAID STORAGE
Data blocks written sequentially to each disk in turn Not really RAID No redundant check data Single disk failure can result in loss of all data Better performance than single disk access for large files Good where performance is more important than redundancy
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 70
RAID 1Mirrored Volumes
Volume A Volume B
Volume n
Block 1 Block 2 Block 3
Block 1 Block 2 Block 3
SERVER
RAID STORAGE
Data blocks written to both disks at once 100% data redundancy means no data loss If one disk fails, data can be retrieved from mirrored disk Requires two disk write operations per block but only one read Good for small files where security is paramount
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 71
RAID 0+1Mirrored Array
Volume A Volume,me B
Volume n
Block 1 Block 3 Block 5
Block 2 Block 4 Block 6
Block 1 Block 3 Block 5
Block 2 Block 4 Block 6
SERVER
RAID STORAGE
Data blocks written to each disk in turn then copied to mirrored array Combines RAID 0 performance with RAID 1 Redundancy If one disk fails, the array becomes a RAID 0 Limited scalability and double the cost
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 72
RAID 4Block-Level Striping with Parity Disk
Parity
Volume A Volume B
Volume n
Block A1 Block A2 Block A3
Block B1 Block B2 Block B3
Parity 1 Parity 2 Parity 3
SERVER
RAID STORAGE
Data blocks written sequentially to each disk in the array Similar to RAID 3 but generally performs better because data is accessed in blocks instead of bytes
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 73
RAID 5Striping with Distributed Parity
Volume A Volume,me B
Volume n
Block A1 Block A2 Block A3
Block B1 Block B2 Parity 3
Block C1 Parity 2 Block C3
Parity 1 Block D2 Block D3
SERVER
RAID STORAGE
Data blocks written sequentially to each disk in turn Parity block computed for each row and distributed across all disks If one disk fails, data can be retrieved using parity blocks Parity calculation overhead reduces write performance Good aggregate transfer rate during read
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 74
RAID 10Mirrored Striping Array
Volume A Volume,me B
Volume n
Block 1 Block 3 Block 5
Block 1 Block 3 Block 5
Block 2 Block 4 Block 6
Block 2 Block 4 Block 6
SERVER
RAID STORAGE
Data blocks written sequentially to each mirrored disk array Combines RAID 0 performance with RAID 1 redundancy If one disk fails, data can be retrieved from mirrored disk Parity is not calculated so good write performance
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.
Page 75
