Data Center
Transformation
Patrick McKinnis
Systems Engineer
Cisco Systems, Inc.
© 2008 Cisco Systems, Inc. All rights reserved. 1
Evolving Importance of the Data Center
More Relevant to Business than Simply Bandwidth
Resiliency for Your Business
Storage Meets Network
Consolidation Opportunities
Regulatory Compliance
Unprecedented Innovation
The Data Center is a true opportunity to GO GREEN and
slow the growth of power consumption and cooling needs.
© 2008 Cisco Systems, Inc. All rights reserved. 2
Data Center Switching and I/O Consolidation
Understanding Market Demands for a Unified Fabric
Multiple Networks Are Costly and Cumbersome to Maintain
Traditional Data (IP / Ethernet) Networks
Fiber Channel Storage Networks
High-Performance Computing / Server Clustering / Inter-Process
Communication (IPC ) Networks
The Promise of Fiber Channel Over Ethernet (FCoE)
Success or failure can depend on underlying Ethernet
infrastructure
Converged Network Adapters (CNAs) to support LAN and SAN
Better network management, quality of service, and congestion
managment
Meeting the Network Demands of Virtualization
Increases in traffic resulting from density and consolidation
of servers
Typically, storage is not directly attached to virtual servers
© 2006 Cisco Systems, Inc. All rights reserved. 3
Customers Say Better Responsiveness Is Priority 1
What are your IT organization's
top objectives during 2008?
0% 10% 20% 30% 40% 50% 60% 70%
Improve IT responsiveness to business
Reduce IT costs
Contribute to business process optimisation
Simplify corporate compliance processes
Move to "IT as a service" model
Shift costs from maintenance to new projects
Source: Economist Intelligence Unit
© 2006 Cisco Systems, Inc. All rights reserved. 4
Data Centers Are Under Increasing Pressure
Collaboration Empowered User SLA Metrics Global Availability Reg. Compliance
New Business
Pressures
Operational
Limitations
Power & Cooling Asset Utilization Provisioning Security Threats Bus. Continuance
Presentation_ID ©
© 2007
2008 Cisco
Cisco Systems,
Systems, Inc.
Inc. All
All rights
rights reserved.
reserved. Cisco Confidential 5
Unified Fabric Implementation
Mgmt
Network
Front-End
Network
Backup
Network
Unified
Fabric
Storage Back-End
Network Network
Unified Fabric and I/O
© 2008 Cisco Systems, Inc. All rights reserved. 6
Data Center and Network Evolution: DC 3.0
Data Center 1.0 Data Center 2.0 Data Center 3.0
Client-Server and Service Oriented and
Mainframe
Distributed Computing Web 2.0 Based
IT Relevance and Control
Consolidate
Virtualize
Automate
CENTRALIZED DECENTRALIZED VIRTUALIZED
Application Architecture Evolution
© 2008 Cisco Systems, Inc. All rights reserved. 7
10Gb Ethernet Adoption in the Data Center
100%
Server 80%
Servers Moving to Dense Rack Form
60%
40%
Chassis* Factor 20%
WW Server 0%
Actuals Forecast
Market Units*
Rapid Adoption
Q199
Q100
Q101
Q102
Q103
Q104
Q105
Q106
Q107
Q108
2009
2010
2011
Non-Rack-optimized Rack-optimized Blade
of Multicore*
Intel will exclusively ship 4 Core after 2008
– Post 2008 Intel will ship exclusively X86
100%
80%
4+ cores servers Multi-Core 60%
Adoption 40%
Growth of Virtualization Exceeds WW Server
Market Units*
20%
0%
Growth of Physical Servers* Q105 Q205 Q305 Q405
Single Core
Q106 Q206
2 Core
Q306 Q406
4 Core
Q107 Q207
M
All Drives the Need for More
10
Storage and Network BW Virtualization 6 18.6%
Attach Rate 4.6% of All
Servers
of All
to Physical 4
Servers
Servers* 2
0
2005 2006 2007 2008 2009 2010
*Source: IDC 2007 Physical Machines Virtual Machines
Multi-Core CPUs and Server Virtualization driving
the demand for higher bandwidth network connections
© 2008 Cisco Systems, Inc. All rights reserved. 8
Evolving Physical Media
Role of Transport in Enabling 10GE Technology
10GE Copper Solution
SFP+ to SFP+
SFP+ Cu • Low Cost
• Low power & latency
• Up to 15 meters
Power Transceiver
Technology Cable Distance (each side) Latency
SFP+ CU
Twinax 10m ~0.1W ~0.25µs
Copper
SFP+ USR MM OM2 10m
1W ~0.1µs
ultra short reach MM OM3 100m
SFP+ SR MM OM1 33m
1W ~0.1µs
short reach MM OM3 300m
Cat6 55m ~8W 2.5µs
10GBASE-T Cat6a/7 100m ~8W 2.5µs
Cat6a/7 30m ~4W 1.5µs
© 2008 Cisco Systems, Inc. All rights reserved. 9
Data Center Ethernet Enhancements
A collection of IEEE-based Ethernet Enhancements
enhancements to classical – Priority Groups: Virtualizes links and
Ethernet that provide allocates resources per traffic classes
end-2-end QoS – Priority Flow Control by traffic class
– End-to-End Congestion Mgmt and
Does not disrupt existing notification
infrastructure – Shortest path bridging: L2 multi-pathing
Benefits of DCE Enhancements
– Eliminates transient and persistent
congestion
– Lossless fabric: “No Drop” storage links
– Deterministic latency for HPC clusters
– Enables a converged Ethernet fabric for
reduced cost & complexity
Intel developing products for Ethernet convergence and driving IEEE
standards along with more than 25 other companies.
© 2008 Cisco Systems, Inc. All rights reserved. 10
FC over Ethernet (FCoE)
FCoE Benefits
Mapping of FC frames Wire Server Once
over Ethernet
Fewer cables and adapters
Enables FC to run
Software Provisioning of I/O
on a lossless Data Center
Ethernet network Interoperates with
existing SANs
Ethernet No gateway—stateless
Fibre
Channel
© 2008 Cisco Systems, Inc. All rights reserved. 11
What Is Data Center Class?
Continuous
Operations
Virtualized
Resources
Operational
Efficiency
Power and
Cooling
Efficiency
© 2008 Cisco Systems, Inc. All rights reserved. 12
Introducing Cisco Nexus Family:
The Network Platform for Data Center 3.0
Over 1513 Patents Over $1B in Overall Data
Pending/Issued on Data Center Research
Center Technologies Transport and Development
Flexibility
Cisco® Nexus Cisco Nexus Consists
Delivers a Unified of Multiple Products
Fabric and I/O for Cisco with a Data Center
the DC Nexus Class OS
Operational Infrastructure
Continuity Scalability
© 2008 Cisco Systems, Inc. All rights reserved. 13
Cisco Nexus Data Center Switching
Innovative Data Center Features and Design
Data Center Core
Nexus 7000
• Zero Service Disruption Architecture L3
• 15 Tbps Scalable Bandwidth
• Lossless Fabric / Data Center Ethernet / FCoE
• Investment Protection for 40GB and 100GB Futures
Server Access
Nexus 5000 Top-of-Rack
• Over 1 Tbps Fabric Capacity
L2
• Line-Rate 10GB Ethernet on All Ports
• Lossless Fabric / Data Center Ethernet / FCoE
© 2008 Cisco Systems, Inc. All rights reserved. 14
Data Center Class Requirements Demand
Focused Software Development
Zero Service Disruption Design
Enables Nexus to unify the data
center fabric
Virtual Device Contexts
Overcomes administrative
barriers to consolidation
Stateful Process Restart
Self heals faster than networks
can converge
Graceful System Operations
Enables simplified operations
and links all protocol layers
© 2008 Cisco Systems, Inc. All rights reserved. 15
Cisco Nexus 7000:
Data Center Class Core/Aggregation
Continuity
Operational
Zero Service Disruption design
Graceful systems operations
Integrated lights-out management
Flexibility
Transport
Lossless fabric architecture
Dense 40GbE/100GbE ready
Unified fabric
Scalability
Infrastructure
Virtualized control and data plane
15Tb+ switching capacity
Efficient physical and power design
© 2008 Cisco Systems, Inc. All rights reserved. 16
Nexus 7000 Fabric Module 1
Provides 46 Gbps per I/O Load-sharing across all fabric
module slot modules in chassis
– Also provides 23 Gbps per Multilevel redundancy with
supervisor slot graceful performance degradation
Up to 230 Gbps per I/O Non-disruptive OIR
module slot when 5 fabric Blue beacon LED for easy
modules are installed in identification
system
– Forwaring Engine on initial
shipping I/O modules cannot
leverage full 230 Gbps fabric
bandwidth
– Future modules will
be capable of leveraging
full bandwidth
N7K-C7010-FAB-1
© 2008 Cisco Systems, Inc. All rights reserved. 17
Fabric Capacity and Redundancy
Per-slot bandwidth capacity increases with each fabric module
Fabrics
46Gbps
40G 80G
Module
Slots
1G Module 10G Module 18
© 2008 Cisco Systems, Inc. All rights reserved.
Fabric Capacity and Redundancy
Per-slot bandwidth capacity increases with each fabric module
1G module requires 2 fabrics for N+1 redundancy
Fabrics
46Gbps
92Gbps
40G 80G
Module
Slots
1G Module 10G Module 19
© 2008 Cisco Systems, Inc. All rights reserved.
Fabric Capacity and Redundancy
Per-slot bandwidth capacity increases with each fabric module
1G module requires 2 fabrics for N+1 redundancy
10G module requires 3 fabrics for N+1 redundancy
Fabrics
46Gbps
138Gbps
92Gbps
40G 80G
Module
Slots
1G Module 10G Module 20
© 2008 Cisco Systems, Inc. All rights reserved.
Fabric Capacity and Redundancy
Per-slot bandwidth capacity increases with each fabric module
1G module requires 2 fabrics for N+1 redundancy
10G module requires 3 fabrics for N+1 redundancy
4th and 5th fabric modules provide additional level of redundancy
Fabrics
46Gbps
184Gbps
138Gbps
92Gbps
40G 80G
Module
Slots
1G Module 10G Module 21
© 2008 Cisco Systems, Inc. All rights reserved.
Fabric Capacity and Redundancy
Per-slot bandwidth capacity increases with each fabric module
1G module requires 2 fabrics for N+1 redundancy
10G module requires 3 fabrics for N+1 redundancy
4th and 5th fabric modules provide additional level of redundancy
Future modules will leverage additional fabric bandwidth
Fabrics
230Gbps
46Gbps
184Gbps
138Gbps
92Gbps
40G 80G
Module
Slots
1G Module 10G Module 22
© 2008 Cisco Systems, Inc. All rights reserved.
Fabric Capacity and Redundancy
Per-slot bandwidth capacity increases with each fabric module
1G module requires 2 fabrics for N+1 redundancy
10G module requires 3 fabrics for N+1 redundancy
4th and 5th fabric modules provide additional level of redundancy
Future modules will leverage additional fabric bandwidth
Fabric failure results in reduction of overall system bandwidth
Fabrics
46Gbps
184Gbps
138Gbps
92Gbps
40G 80G
Module
Slots
1G Module 10G Module 23
© 2008 Cisco Systems, Inc. All rights reserved.
Fabric Capacity and Redundancy
Per-slot bandwidth capacity increases with each fabric module
1G module requires 2 fabrics for N+1 redundancy
10G module requires 3 fabrics for N+1 redundancy
4th and 5th fabric modules provide additional level of redundancy
Future modules will leverage additional fabric bandwidth
Fabric failure results in reduction of overall system bandwidth
Fabrics
46Gbps
138Gbps
92Gbps
40G 80G
Module
Slots
1G Module 10G Module 24
© 2008 Cisco Systems, Inc. All rights reserved.
Fabric Capacity and Redundancy
Per-slot bandwidth capacity increases with each fabric module
1G module requires 2 fabrics for N+1 redundancy
10G module requires 3 fabrics for N+1 redundancy
4th and 5th fabric modules provide additional level of redundancy
Future modules will leverage additional fabric bandwidth
Fabric failure results in reduction of overall system bandwidth
Fabrics
46Gbps
92Gbps
40G 80G
Module
Slots
1G Module 10G Module 25
© 2008 Cisco Systems, Inc. All rights reserved.
Fabric Capacity and Redundancy
Per-slot bandwidth capacity increases with each fabric module
1G module requires 2 fabrics for N+1 redundancy
10G module requires 3 fabrics for N+1 redundancy
4th and 5th fabric modules provide additional level of redundancy
Future modules will leverage additional fabric bandwidth
Fabric failure results in reduction of overall system bandwidth
Fabrics
46Gbps
40G 80G
Module
Slots
1G Module 10G Module 26
© 2008 Cisco Systems, Inc. All rights reserved.
Cisco Nexus 5000:
Data Center Class Access
Continuity
Operational
Simpler More Stable Layer 2 Network
Highly Available Platform
Preserves operational best practices
Flexibility
Transport
FCoE based Unified Fabric
Virtualization Optimized Networking
Support for CE, FCoE, DCE, and FC
Scalability
Infrastructure
Reduces power, cooling, cabling
Up to 56 ports non-blocking 10GbE
Up to 1.2 Tbps capacity
© 2008 Cisco Systems, Inc. All rights reserved. 27
Nexus 5000: Innovative Platform for Data
Center Transformation
Standards
Wire Speed 10GbE Data Center Fibre Channel over VM Optimized
Switching Ethernet Ethernet Networking
Capacity Scalability Consolidation Virtualization
LAN SAN A SAN B
Ethernet LAN LAN
LAN SAN A SAN B
MAC MAC
A B A&B C
Active-Active
N5000 End nodes
N5000
N5000
MAC MAC
A C
MAC
B
Eco-System
© 2008 Cisco Systems, Inc. All rights reserved. 28
Expanding Role of Server Virtualization
Server Consolidation And Virtualization Are #1 & #2 Spending
Priorities
Source: Goldman Sachs CIO Survey
10% of server workloads virtualized in 2008; forecast to be 50%-60%
in next 5 years
Source: Industry analyst reports
Increasing Use of VMotion and DRS resulting in Multiplicative
Increase in Complexity
Source: Cisco
Desktop Virtualization Gaining Traction as Tool to Address Desktop
Manageability, Security and Cost
Source: Goldman Sachs IT Spending Survey
© 2008 Cisco Systems, Inc. All rights reserved. 29
Networking Challenges to Scaling VM Deployments
Security and Policy Operation and Organizational
Enforcement Management Structure
Applied at physical Lack of VM Blurs boundaries
server—poor connection between roles
granularity visibility
Creates loss of
Security and policy Inability to productivity &
doesn’t follow VM troubleshoot and compliance
audit challenges
© 2008 Cisco Systems, Inc. All rights reserved. 30
Introducing Cisco Virtual Network Link
Virtualizing the Network Domain
Policy Based VM Mobility of Network & Non-Disruptive
Connectivity Security Properties Operational Model
Cisco Nexus 1000V Nexus 5000 with VN-Link
(Software Based) (Hardware Based)
• Cisco switch forServer
VMW ESX •Scalable, hardware
Serverbased, high
VM VM VM VM performance
VM VMsolution VM VM
• Compatible
#1
with
#2 any#3switching
#4 #1 #2 #3 #4
platform •Standards driven approach to
VMW ESX
• Leverages Virtual Center for server delivering hardware based VM
Nexus 1000V
admin; Cisco CLI for network networking Initiator
VMW ESX
admin •Combines VM & physical network
NIC NIC operations into 1 managed node
Nexus
1000V
LAN Nexus 5000
Two Complementary Models to Address Evolving Customer Requirements
© 2008 Cisco Systems, Inc. All rights reserved. 31
Cisco VN-Link: Virtualizing the Network Domain
Business Problem:
- Servers & apps are currently managed
at the VM level, but network and storage
I/O is being managed at the physical
device level
Result:
- Security and compliance problems
- Management and operations overhead
- All increasing in scope & complexity
Advantages of Cisco VN-Link:
- Better business continuity
- Improved energy efficiency
- Greater resource agility
© 2008 Cisco Systems, Inc. All rights reserved. 32
Key Features of the Nexus 1000V
Switching • L2 Switching, 802.1Q Tagging, VLAN Segmentation, Rate Limiting (TX)
• IGMP Snooping, QoS Marking/Queuing,
Security • Policy Mobility, PVLAN, ACL(L2-4), Port Security, IP Redirect
• Cisco TrustSec – Authentication, Admission, Access Control
Provisioning • Automated vSwitch config, Port Profiles, Virtual Center Integration
• Optimized NIC Teaming (LACP to 1 or more upstream device)
Visibility • Historical VMotion tracking, ERSPAN, Netflow v.9 w/ NDE, CDP v.2
• VM-Level Interface Statistics, Wireshark
Management • Virtual Center VM Provisioning, Cisco Network Provisioning
• Cisco CLI, XMP API, SNMP (Read/Write)
© 2008 Cisco Systems, Inc. All rights reserved. 33
NX-OS is the Data Center Operating System
SAN-OS
NX-OS
IOS
Simplifies the data center environment
Brings server, storage and network closer than ever
Lays the foundation for unified fabric
Re-Branding SAN-OS in recognition of common codebase
© 2008 Cisco Systems, Inc. All rights reserved. 34
NX-OS: High Availability for the Data Center
Granular software modularity
Granular in-service software upgrades
Software offers multi-layered, multi-
faceted resiliency:
Stateful process restarts
Graceful restart for routing protocols
Stateful supervisor engine switchovers
on Nexus 7000
Configuration verification and rollback
Embedded packet analyzer
Hardware and software combine to deliver data-center class high
availability – zero service disruption
© 2006 Cisco Systems, Inc. All rights reserved. 35
Cisco Validated Designs for Data Center
At CISCO.COM search for “Design Zone for Data Centers”
© 2008 Cisco Systems, Inc. All rights reserved. 36
Why Cisco in the Data Center?
Experience and leadership in
IP and SAN networks
Broadest and most flexible
portfolio of Data Center
solutions
Unmatched service, support,
and quality assurance
programs
Strong Cisco channel partners
and ecosystem partnerships
© 2006 Cisco Systems, Inc. All rights reserved. 37
DC3 Launch/os © 2008
© 2007Cisco
Cisco Systems, Inc.AllAll
Systems, Inc. rights
rights reserved.
reserved. Cisco Restricted
38
