BIG DATA INFRASTRUCTURE:
ISILON AND SCALE-OUT NAS
Shai Harmelin
Principle Systems Engineer
Copyright 2011 EMC Corporation. All rights reserved.
EMC Isilon Scale-Out NAS Agenda
Big Data Growth in the Enterprise
New Architecture Required: Scale-Out NAS
Isilon Solution Overview
Copyright 2011 EMC Corporation. All rights reserved.
Big Data-Enabled Applications
Collaborative
Real Time
Structured &
Unstructured
Petabyte
Scale
Act
EMC Documentum xCP
Analyze
EMC Greenplum + Hadoop
Copyright 2011 EMC Corporation. All rights reserved.
Store
EMC Isilon + Atmos
EMC Isilon Overview
Proven, global leader in Scale-Out NAS Storage solutions
Unrivaled product innovation 6th Generation
World-class products and global services
Strong ecosystem of technology partners
2200+ worldwide customers and growing
Acquired by EMC on 12/21/2010
Copyright 2011 EMC Corporation. All rights reserved.
Copyright 2011 EMC Corporation. All rights reserved.
What is
Big Data?
Copyright 2011 EMC Corporation. All rights reserved.
Big Data is File & Unstructured Data
90
80
70
EXABYTES
60
50
40
30
20
10
0
2009
2010
2011
File Based: 60.7% CAGR
2012
2013
2014
Block Based: 21.8% CAGR
According to IDC, by 2012, 80% of all storage capacity sold will be for file-based data.
Copyright 2011 EMC Corporation. All rights reserved.
Big Data Demands New Solution
47%
Data
Growth
TOP CIO
CONCERNS
37%
System
Performance
& Scalability
CIO Survey, October 2010
Copyright 2011 EMC Corporation. All rights reserved.
Enterprises Had Deployed Scale-Up Solutions
SCALE UP
Scalability
Performance
Management
Availability
Cost
Copyright 2011 EMC Corporation. All rights reserved.
10
Enterprises are Transitioning to ScaleOut
SCALE OUT
Scalability
Performance
Management
Availability
Cost
Copyright 2011 EMC Corporation. All rights reserved.
11
Architecture
Head
Head
CPU, Memory, Throughput
OneFS
Architecture
Symmetric, Shared
Fully distributed OS
Copyright 2011 EMC Corporation. All rights reserved.
Traditional Single/Dual Controller
Controller w/shelves
Legacy single server OS
12
Scalability & Performance
Scale-up
Scale-out
OneFS
Traditional Single/Dual Controller
Scalability
Scale-out
Performance, Capacity, Both
Scale-up
Capacity only
Performance
True linear predictability
Degradation at scale
With NTAP my best day is my first day
Copyright 2011 EMC Corporation. All rights reserved.
13
Management & Economics
File Systems
Volumes
Aggregates
(~16TB)
RAID
OneFS
Traditional Single/Dual Controller
Management
1 volume, 1 file system
Single volume up to 10PB
MANY RAID, volumes, file systems
Single volume up 100TB (16TB typical)
Economics
80%+ utilization, <1FTE
Business agility
Investment protection
55-60% utilization, Multiple FTEs
Silos, limitations
Forklift upgrades
Copyright 2011 EMC Corporation. All rights reserved.
14
Isilons Scale-Out
Storage Solution
Elements
of Scale-out
(Distributed File Systems, Clustered File Systems, etc)
Unlimited Scalability
Ease of Use/Management
High Performance
High Availability
Maximum Data Protection
Enterprise Services
(Windows, Unix, Security, Authentication, etc.)
Copyright 2011 EMC Corporation. All rights reserved.
15
Isilons Scale-Out Storage Solution
Copyright 2011 EMC Corporation. All rights reserved.
16
Core InnovationValue to Customers
Isilons OneFS Scale-Out Operating System
Copyright 2011 EMC Corporation. All rights reserved.
17
Isilons Scale-Out Storage Solutions
Extending our Lead in Scale-Out Storage Market
Copyright 2011 EMC Corporation. All rights reserved.
18
Isilons Broad Range of Solutions
S-SERIES
X-SERIES
Purpose-built for hightransactional & IOPSintensive applications
NL-SERIES
A flexible solution to
accelerate high-concurrent
and sequential throughput
applications
Purpose-built for
cost-effective, large
capacity storage
Copyright 2011 EMC Corporation. All rights reserved.
19
Architecture Overview
Simple is Smart
Copyright 2011 EMC Corporation. All rights reserved.
20
Isilon IQ Network Architecture
Servers
Servers
Servers
Client/Application Layer
Copyright 2011 EMC Corporation. All rights reserved.
Standard Gigabit Ethernet
Layer
Isilon IQ Storage
Layer
Intracluster
Communication Infiniband
or GigE Layer
21
Largest and Most Scalable File System
500X More Scalable than Traditional Storage Systems
OneFS can scale from 18TB to over 15,000 TB in a
single file system
Traditional Scale-Up NAS players are limited to 2-16TB max file system
Under 60 seconds to scale with no downtime
Worlds fastest performance and capacity scaling
Copyright 2011 EMC Corporation. All rights reserved.
22
Using Software
AutoBalance
to do Work Unfit for
Automated data balancing across nodes reduces costs,
complexity and risks for scaling storage
Humans
BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL
AutoBalance migrates
content to new storage nodes
while system is
online and in production
Requires NO manual
intervention, NO
reconfiguration,
NO server or client mount
point or application changes
Eliminate Hot Spots
BALANCED
EMPTY
Copyright 2011 EMC Corporation. All rights reserved.
23
The Most Reliable Storage System
Built-in high availability clustered architecture
NetApp requires costly, redundant heads and software
With
N+2,
N+3, and
With N+1
protection,
N+4
data is protection,
100% available even if
data
is 100%
a single
drive available
or node fails
if multiple drives or nodes fail
100%
100%
FAILED
100%
100%
100%
And Isilon IQ offers the
industrys fastest drive rebuild
times
In less than an hour!
Copyright 2011 EMC Corporation. All rights reserved.
100%
100%
FAILED
100%
24
One File System for Multiple Tiers of Storage
I/Ops
MB/s
Archive
SmartPools
I/Ops
I/Ops
I/Ops
I/Ops
NL Archive
Throughput
NL Archive
Throughput
NL Archive
Throughput
NL Archive
Throughput
Throughput
NL Archive
Throughput
NL Archive
Copyright 2011 EMC Corporation. All rights reserved.
25
Powerful, Flexible, and Scalable Protection
Primary Use Cases:
Disaster Recovery
Business Continuance
Disk to Disk backup
Remote Archive
Block Efficient, File Specific
Leverages SnapshotIQ
Scales with Cluster
Copyright 2011 EMC Corporation. All rights reserved.
26
S-SERIES
X-SERIES
NL-SERIES
ACCELERATOR
& BACKUP
ACCELERATOR
ISILON
EX NODES
OPERATING
SYSTEM
HARDWARE
APPLICATION
SOFTWARE
The Broadest Range of Scale-Out Storage
Solutions for Big Data
Copyright 2011 EMC Corporation. All rights reserved.
27
Copyright 2011 EMC Corporation. All rights reserved.
Back to Navigation
28
Isilon Scale-Out Storage Value
Massive
100x Larger File Systems
Unmatched
40x Higher Total Throughput
Industry-leading
and
As
Copyright 2011 EMC Corporation. All rights reserved.
1000+ Terabytes as 15 Terabytes
29
Visit us at EMC Big Data Booth
THANK YOU
Copyright 2011 EMC Corporation. All rights reserved.
30
