Module 05
Module 05
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 1
Module 5: Fibre Channel Storage Area Network
(FC SAN)
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 2
Module 5: Fibre Channel Storage Area
Network (FC SAN)
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 3
Business Needs and Technology Challenges
• An effective information management solution must provide:
Just-in-time information to business users →availability
Flexible and resilient (strong) storage infrastructure
• Information management challenges in direct-attached storage
(DAS) environment:
Explosive growth of information storage that remains isolated and
underutilized
Proliferation (Increasing) of new servers and applications
Complexity in sharing storage resources across multiple servers
High cost of managing information
• Storage area network (SAN) addresses these challenges
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 4
What is a SAN?
SAN
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 5
Understanding Fibre Channel
• High-speed network technology that uses:
Optical fiber cables (for front end connectivity)
Serial copper cables (for back end connectivity)
• Latest FC implementation supports speed up to 16 Gb/s
• Highly scalable
Theoretically, a single FC network can accommodate approximately 15
million devices
IP
Network FC SAN
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 6
SAN
• SAN carries data between
servers (or hosts) and
storage devices through FC SAN
Fibre Channel network.
• Enables storage
consolidation (merge)
Storage management
becomes centralized and Application Servers Storage Arrays
less complex, which
further reduces the cost
of managing information • Enables storage to be shared across multiple
• Enables organizations to servers.
connect geographically • Improves the utilization of storage resources
dispersed servers and compared to direct-attached storage
storage. architecture
• Reduces the total amount of storage an
organization needs to purchase and manage.
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 7
Components of FC SAN
• Node (server and storage) ports
• Cables
• Connectors
• Interconnecting devices such as FC switches and hubs
• SAN management software
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 8
Components of FC SAN: (1) Node Ports
• In FC network, the end devices, such as hosts, storage arrays, and
tape libraries, are all referred to as nodes.
• Each node requires one or more ports to provide a physical
interface for communicating with other nodes.
• Exist on
Host bus adapter (HBA) in server
Front-end adapters in storage
Node
• Each port has a Tx
Port 0
transmit (Tx) link and Port 0
Rx
Link
a receive (Rx) link
Port 1
Port n
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 9
Components of FC SAN: (2) Cables
• SAN implementation uses
Copper cables for short distance (back-end)
Optical fiber cables for long distance
• Two types of optical cables: single-mode and multimode
Single-mode fiber Multimode fiber
(SMF) Cladding (MMF)
Core Cladding Core
(Modal dispersion =
collision - weakens Light In
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 10
Components of FC SAN: (3) Connectors
• Attached at the end of a cable
• Enable swift (rapid) connection and
disconnection of the cable to and from a Standard Connector
port
• Commonly used connectors for fiber optic
cables are:
Standard Connector (SC)
Duplex connectors Lucent Connector
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 11
Components of FC SAN: (4) Interconnecting Devices
• Commonly used interconnecting devices in FC SAN are:
Hubs Switches Directors
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 12
Components of FC SAN: (5) SAN Management Software
• A suite of tools used in a SAN to manage
interfaces between host and storage arrays
• Provides integrated management of SAN
environment
• Enables web-based management using GUI or CLI
• Key management functions:
Mapping of storage devices, switches and servers
Monitoring and generating alerts for discovered
devices
Logical partitioning of SAN (zoning)
Management of SAN components (HBAs, storage
components and interconnecting devices)
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 13
FC Interconnectivity Options
• Point-to-Point
• Fibre Channel Arbitrated Loop (FC-AL)
• Fibre Channel Switched Fabric (FC-SW)
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 14
Point-to-Point Connectivity Servers
a given time
Cannot be scaled to
accommodate a large number of
nodes
• Used in DAS environment
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 15
Fibre Channel Arbitrated Loop (FC-AL) Connectivity
• Provides shared loop to attached nodes Servers
Each node contends with other nodes to
perform I/O operations
Server
Nodes must arbitrate to gain control
At any given time, only one device can perform
I/O operations on the loop
• Implemented using ring or star topology
• Limitations of FC-AL FC Hub
Only one device can perform I/O operation at a
time
Supports up to 126 nodes
Addition or removal of a node causes
momentary (temporary) pause in loop traffic
Storage Array
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 16
Fibre Channel Switched Fabric (FC-SW) Connectivity
FC Switch FC Switch
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 17
• N_Port: An end point in the fabric. Also
Switched Fabric Ports known as the node port. Typically, it is a host
Ports in a switched fabric can be port (HBA) or a storage array port connected
to a switch in a switched fabric.
one of the following types:
N-Port, F-Port, E-Port, G-Port • E_Port: Forms the connection between two
FC switches. Also known as the expansion
port.
Server
• F_Port: A port on a switch that connects an
N_Port. Also known as a fabric port.
N-Port
• G_Port: A generic port on a switch that can
operate as an E_Port or an F_Port and
determines its functionality automatically
during initialization.
F-Port
FC Switch FC Switch
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 18
Module 5: Fibre Channel Storage Area
Network (FC SAN)
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 19
FC Architecture Overview
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 20
FC Architecture Overview
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 21
High Performance Parallel
Fibre Channel Protocol Stack Interface (HIPPI) Framing
Protocol
Asynchronous Transfer
FC-4 Upper Layer Protocol Mapping Mode (ATM),
FC-1 Encode/Decode
16
FC-0 1 Gb/s 2 Gb/s 4 Gb/s 8 Gb/s
Gb/s
FC Layer Function Features Specified by FC Layer
Mapping upper layer protocol (e.g. SCSI) to lower
FC-4 Mapping interface
FC layers
FC-3 Common services Common services (Not implemented)
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 22
FC Addressing in Switched Fabric
• FC Address is assigned to nodes during fabric login
Used for communication between nodes within FC SAN
• Address format
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 23
World Wide Name (WWN)
• Each device in the FC environment is assigned a 64-bit unique
identifier
• Static to node ports on an FC network
Similar to Media Access Control (MAC) address used in IP
networking
• World Wide Node Name (WWNN) and World Wide Port Name
(WWPN) are used: to uniquely identify nodes and ports
respectively
World Wide Name - Array
5 0 0 6 0 1 6 0 0 0 6 0 0 1 B 2
0101 0000 0000 0110 0000 0001 0110 0000 0000 0000 0110 0000 0000 0001 1011 0010
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 24
Structure and Organization of FC Data
• FC data is organized as Exchange, Sequence, and Frame
Exchange Sequence Frame
FC Frame
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 25
Fabric Services
• FC switches provide fabric services as defined in FC standards
• Used during the initial • Responsible for name • Responsible for • Enables FC SAN
part of the node’s registration and managing and management using
fabric login process management of node distributing Registered fabric management
• Located at pre-defined ports State Change software
address of FFFFFE • Located at pre-defined Notifications (RSCNs) • Located at pre-defined
address FFFFFC to attached node address FFFFFA
ports
• Responsible for
distributing SW-RSCNs
to every other switch
• SW-RSCNs keep the
name server up-to-
date on all switches
• Located at pre-defined
address FFFFFD
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 26
Login Types in Switched Fabric
• Fabric login (FLOGI)
Occurs between an N_Port and an F_Port
Node sends a FLOGI frame with WWN to Fabric Login Server on
switch
Node obtains FC address from switch
Immediately after FLOGI, N_Port registers with Name Server on
switch, indicating its WWN, port type, assigned FC address, etc.
N_Port queries name server about all other logged in ports
• Port login (PLOGI)
Occurs between two N_Ports to establish a session
Exchange service parameters relevant to the session
• Process login (PRLI)
Occurs between two N_Ports to exchange ULP related parameters
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 27
Module 5: Fibre Channel Storage Area
Network (FC SAN)
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 28
Mesh Topology Full Mesh
FC Switches
• Full mesh
Each switch is connected to every other Server
switch
Maximum of one interswitch link (ISL) or
hop is required for host-to-storage
traffic Storage Array
• Partial mesh
Not all the switches are connected to Server
Storage Array
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 29
Core-edge Topology
• Consists of edge and core FC Switch
Edge Tier
FC Switch FC Switch
switch tiers (levels)
• Edge tier:
Switches
Adding more hosts Server FC Director
Storage Array
Attached to a switch at Core Tier
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 30
Core-edge Topology (contd.)
• Network traffic traverses FC Switch
Edge Tier
FC Switch FC Switch
core tier or terminate at
core tier
• Storage is usually
connected to the core tier Server FC Director
• Benefits Core Tier Storage Array
High availability
Edge Tier
Medium scalability FC Switch FC Switch FC Switch
Medium to maximum
connectivity
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 31
Zoning
• Whenever a change takes place in the name server database,
fabric controller sends Registered State Change Notification
(RSCN) to all nodes impacted by the change
• If zoning is not configured, RSCN sends to all nodes in the fabric
• For a large fabric, the amount of FC traffic generated due to this
process can be significant and might impact the host-to-storage
data traffic
Zoning
It is an FC switch function that enables node ports within the
fabric to be logically segmented into groups, and communicate
with each other within the group.
• Some terminologies:
• Zones – a set of members (nodes) which could be HBA and array ports
• Zone sets – a set of zones, that can be activated and deactivated
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 32
Zoning (contd.)
• Only nodes in the same zone can communicate with
each other
• A node can be a member of multiple zones
• A fabric can have multiple zone sets, but only one of
them can be active at a time
• Benefits
Restricts Registered State Change Notification (RSCN) traffic
Provides access control
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 33
Zoning (contd.)
Zone 1
Server
FC SAN
Storage Array
Array port
Zone 2
Servers HBA Port
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 34
Zoning Components A node can be a member
of multiple zones
Zone sets
Zone set
(Library)
Zone
Zone Zone Zone
(Library)
Member
Member Member Member Member Member Member
WWN's
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 35
Types of Zoning
• Port zoning
Uses FC addresses of the physical ports to define zones
Also called hard zoning
Secure, but require zone configuration information to be updated
every time fabric configuration changes
• WWN zoning
Uses World Wide Names to define zones
Also called soft zoning
Flexible – no need to reconfigure the zone information if fabric
configuration changes
• Mixed zoning
Enables a specific port to be tied to the WWN of a node
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 36
Types of Zoning
Port 5
Zone 2
Port 1
WWN 10:00:00:00:C9:20:DC:40 FC Switch Storage Array
Port 12
Port 9
Zone 3
WWN 10:00:00:00:C9:20:DC:56
WWN 50:06:04:82:E8:91:2B:9E
Zone 1
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 37
Module 5: Fibre Channel Storage Area
Network (FC SAN)
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 38
Block-level Storage Virtualization
• Provides a virtualization Servers
layer in SAN
• Abstracts block storage Server
•
Virtual Volume Virtualization
Virtual volumes are Appliance
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 39
Use Case: Block-level Storage Virtualization across Data
Centers
Data Center 1 Data Center 2
• Block-level Servers Servers
storage
virtualization Server Server
enables
nondisruptive Virtual Virtual
Volumes Volumes
data migration Virtualization Appliance
virtualization
layers at multiple
data centers. Storage Arrays Storage Arrays
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 40
Virtual SAN (VSAN)/Virtual Fabric
VSAN
VSAN 10 VSAN 20
It is a logical fabric on an FC SAN, Servers Servers
enabling communication among a
group of nodes, regardless of their Server Server
physical location in the fabric.
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 41
Module 5: Fibre Channel Storage Area Network (FC
SAN)
Concept in Practice:
• EMC Connectrix
• EMC VPLEX
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 42
EMC Connectrix
• Connectrix family includes networked storage connectivity
products
Offers high-speed FC connectivity, highly resilient switching
technology, intelligent IP storage networking, and I/O
consolidation with Fibre Channel over Ethernet
• Connectrix family consist of enterprise directors, departmental
switches, and multi-purpose switches
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 43
EMC VPLEX
• Provides solution for block-level storage virtualization and data
mobility – both within and across data centers
• Enables multiple hosts located across two locations to access a
single copy of data
• Provides capability to mirror a virtual volume – both within and
across locations
Allows hosts at different data centers to simultaneously access
cache-coherent copies of the same virtual volume
• VPLEX family consists of three products
VPLEX Local
VPLEX Metro
VPLEX Geo
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 44
Module 5: Summary
Key points covered in this module:
• FC SAN components and connectivity options
• FC protocol stack and addressing
• Structure and organization of FC data
• Fabric services
• Fabric topologies
• Types of zoning
• Block-level storage virtualization and virtual SAN
EMC Proven Professional. Copyright © 2012 EMC Corporation. All Rights Reserved. Module 5: Fibre Channel Storage Area Network 45