DiskShelf14 and DiskShelf14mk2 FC

Hardware Guide

Network Appliance, Inc.

495 East Java Drive
Sunnyvale, CA 94089 USA
Telephone: +1 (408) 822-6000
Fax: +1 (408) 822-4501
Support telephone: +1 (888) 4-NETAPP
Documentation comments: [email protected]
Information Web: http://www.netapp.com

Part number 210-00648

May 2004
Copyright and trademark information

Copyright Copyright © 1994–2004 Network Appliance, Inc. All rights reserved. Printed in the U.S.A.
information No part of this book covered by copyright may be reproduced in any form or by any means—graphic,
electronic, or mechanical, including photocopying, recording, taping, or storage in an electronic
retrieval system—without prior written permission of the copyright owner.

Network Appliance reserves the right to change any products described herein at any time, and
without notice. Network Appliance assumes no responsibility or liability arising from the use of
products described herein, except as expressly agreed to in writing by Network Appliance. The use or
purchase of this product does not convey a license under any patent rights, trademark rights, or any
other intellectual property rights of Network Appliance.

The product described in this manual may be protected by one or more U.S. patents, foreign patents,
or pending applications.

RESTRICTED RIGHTS LEGEND: Use, duplication, or disclosure by the government is subject to

restrictions as set forth in subparagraph (c)(1)(ii) of the Rights in Technical Data and Computer
Software clause at DFARS 252.277-7103 (October 1988) and FAR 52-227-19 (June 1987).

Trademark NetApp, the Network Appliance design, NetApp–the Network Appliance Company, FAServer,
information NearStore, NetCache, and WAFL are registered trademarks of Network Appliance, Inc. in the United
States and other countries. Network Appliance is a registered trademark of Network Appliance, Inc.
in Monaco and a trademark of Network Appliance, Inc. in the United States and Canada. SnapCopy is
a registered trademark of Network Appliance, Inc. in the European Union and a trademark of
Network Appliance, Inc. in the United States. DataFabric, FilerView, SecureShare, SnapManager,
SnapMirror, and SnapRestore are registered trademarks of Network Appliance, Inc. in the United
States. Data ONTAP and Snapshot are trademarks of Network Appliance, Inc. in the United States
and other countries. ApplianceWatch, BareMetal, Center-to-Edge, ContentDirector, gFiler,
MultiStore, SecureAdmin, Serving Data by Design, Smart SAN, SnapCache, SnapDrive, SnapMover,
SnapVault, vFiler, and Web Filer are trademarks of Network Appliance, Inc. in the United States.
Spinnaker Networks, the Spinnaker Networks logo, SpinAccess, SpinCluster, SpinFS, SpinHA,
SpinMove, SpinServer, and SpinStor are registered trademarks of Spinnaker Networks, LLC in the
United States, other countries, or both. SpinAV, SpinManager, SpinMirror, and SpinShot are
trademarks of Spinnaker Networks, LLC in the United States, other countries, or both.

Apple is a registered trademark and QuickTime is a trademark of Apple Computer, Inc. in the United
States and/or other countries.

Microsoft is a registered trademark and Windows Media is a trademark of Microsoft Corporation in

the United States and/or other countries.

RealAudio, RealNetworks, RealPlayer, RealSystem, RealText, and RealVideo are registered

trademarks and RealMedia, RealProxy, and SureStream are trademarks of RealNetworks, Inc. in the
United States and/or other countries.

All other brands or products are trademarks or registered trademarks of their respective holders and
should be treated as such.

Network Appliance is a licensee of the CompactFlash and CF Logo trademarks.

Network Appliance NetCache is certified RealSystem compatible.

ii Copyright and trademark information

Table of Contents
Safety Information (Sicherheitshinweise) . . . . . . . . . . . . . . . . . . . v

Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii

Chapter 1 Preparing for the Installation. . . . . . . . . . . . . . . . . . . . . . . . . . 1

Differences between the DS14 and DS14mk2 FC . . . . . . . . . . . . . . . . 2
Preparing your site . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Required tools and equipment . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Planning and organizing the installation . . . . . . . . . . . . . . . . . . . . .8
Checking shipment contents . . . . . . . . . . . . . . . . . . . . . . . .9
Installation rules and restrictions . . . . . . . . . . . . . . . . . . . . . 10
Guide to the installation process . . . . . . . . . . . . . . . . . . . . . 11

Chapter 2 Installing a Disk Shelf . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

Before you begin your installation . . . . . . . . . . . . . . . . . . . . . . . 14
Installing a disk shelf in a rack . . . . . . . . . . . . . . . . . . . . . . . . . 18

Chapter 3 Connecting a Disk Shelf. . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

Connecting disk shelves to a storage appliance . . . . . . . . . . . . . . . . 26
Connecting a disk shelf to a storage appliance. . . . . . . . . . . . . . 28
Connecting multiple disk shelves . . . . . . . . . . . . . . . . . . . . 33
Connecting to multiple loops of disk shelves . . . . . . . . . . . . . . 35
Grounding disk shelves . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Connecting the disk shelf to a power source . . . . . . . . . . . . . . . . . . 42

Chapter 4 Monitoring the Disk Shelf. . . . . . . . . . . . . . . . . . . . . . . . . . . 45

Monitoring the front operation panel . . . . . . . . . . . . . . . . . . . . . . 46
Monitoring the LRC, ESH, or ESH2 modules . . . . . . . . . . . . . . . . . 49
Monitoring the power supply . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Monitoring the Fibre Channel disk . . . . . . . . . . . . . . . . . . . . . . . 61

Table of Contents iii

Chapter 5 Replacing Disk Shelf Devices . . . . . . . . . . . . . . . . . . . . . . . . . 63
Removing a disk shelf . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
Removing a disk shelf from a single disk shelf configuration . . . . . . 65
Removing a disk shelf from a loop. . . . . . . . . . . . . . . . . . . . 67
Replacing a disk in a disk shelf. . . . . . . . . . . . . . . . . . . . . . . . . 69
Replacing a power supply in a disk shelf . . . . . . . . . . . . . . . . . . . . 72
Replacing an LRC/ESH/ESH2 module. . . . . . . . . . . . . . . . . . . . . 76
Removing a module . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Installing a module . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
Hot-swapping a module . . . . . . . . . . . . . . . . . . . . . . . . . 80
Hot-upgrading or hot-downgrading a disk shelf . . . . . . . . . . . . . 84

Appendix A Adding a Disk Shelf to an Existing System . . . . . . . . . . . . . . . . . 89

Installing a disk shelf in an existing mixed-shelf loop . . . . . . . . . . . . . 90
Hot-adding a DS14/DS14mk2 FC to an existing loop . . . . . . . . . . . . . 95

Appendix B Recommended Power Line Sizes . . . . . . . . . . . . . . . . . . . . . . .101

Recommended AC power line sizes . . . . . . . . . . . . . . . . . . . . . .102
Calculating the length of DC wires . . . . . . . . . . . . . . . . . . . . . . .103

Appendix C Feature Update Record . . . . . . . . . . . . . . . . . . . . . . . . . . . .109

Appendix D Communications Regulations. . . . . . . . . . . . . . . . . . . . . . . . .111

Regulatory notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .112
Declaration of Conformity . . . . . . . . . . . . . . . . . . . . . . . . . . .114

Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .115

iv Table of Contents
Safety Information (Sicherheitshinweise)

Safety rules All products are Class 1 laser devices. You must follow these safety rules
when working with this equipment:

WARNING
Failure to follow these directions could result in bodily harm or loss of
life.

◆ Switzerland only—for FAS900, GF900, R200, and C6200 systems:

This equipment relies on fuses/circuit breakers in the building installation
for overcurrent protection. Each power supply must receive power from a
separately dedicated outlet with a 10A fuse/circuit breaker.
◆ When installing disk shelves and a storage appliance into a movable
cabinet or rack, install from the bottom up for best stability.
◆ DC-based systems must be installed in a restricted access location and the
two input power terminates for the DC power supply must be connected
to separate isolated branch circuits.
◆ To reduce the risk of personal injury or equipment damage, allow internal
components time to cool before touching them and ensure that the
equipment is properly supported or braced when installing options.
◆ This equipment is designed for connection to a grounded outlet. The
grounding type plug is an important safety feature. To avoid the risk of
electrical shock or damage to the equipment, do not disable this feature.
◆ This equipment has one or more replaceable batteries. There is danger of
explosion if the battery is incorrectly replaced. Replace the battery only
with the same or equivalent type recommended by the manufacturer.
Dispose of used batteries according to the manufacturer’s instructions.

Warning for units with If your storage appliance or disk shelf has multiple power cords and you need
multiple power cords to turn the unit off, heed the following warning:

WARNING
This unit has more than one power supply cord. To reduce the risk of
electrical shock, disconnect all power supply cords before servicing.

Safety Information (Sicherheitshinweise) v

Sicherheitsvorgaben Alle Produkte sind Lasergeräte der Klasse 1. Die folgenden
Sicherheitshinweise sind beim Betreiben des Geräts unbedingt zu beachten:

Vorsicht
Nichtbeachtung dieser Anweisungen kann zu schweren Körperschäden führen
oder tödlich sein.

◆ Nur für die Schweiz - Systeme FAS900, GF900, R200 und C6200:
Diese Geräte erfordern den Festeinbau von Sicherungen zum
Überstromschutz. Jeder Netzanschluss muss mit Strom aus getrennten,
speziell für diesen Zweck vorgesehenen Steckdosen versorgt werden, die
jeweils mit einer 10A-Sicherung geschützt sind.
◆ Bei der Montage der Diskettenregale und Archivierungsgeräte, des
NetCache™ -Geräts oder des NearStore® -Systems in bewegliche
Schränke oder Regale sind die Geräte von unten nach oben einzubauen,
um optimale Stabilität zu gewährleisten.
◆ Gleichstrom-Systeme müssen an Betriebsstaette mit beschraenktem
Zutritt installiert sein und die beiden Eingangsstromklemmen für das
Gleichstrom-Netzteil müssen an separate und isolierte Abzweigleitungen
angeschlossen sein.
◆ Zum Schutz vor Körperverletzung oder Sachschäden am Gerät lassen Sie
die inneren Bauteile stets vor dem Berühren abkühlen. Sorgen Sie dafür,
dass das Gerät richtig abgestützt ist oder fest aufrecht steht, bevor Sie
neues Zubehör einbauen.
◆ Dieses Gerät ist für die Einspeisung aus einer geerdeten Netzverbindung
ausgelegt. Der Netzstecker mit Erdungsvorrichtung ist ein wichtiger
Sicherheitsschutz. Zum Schutz vor elektrischem Schlag oder
Sachschäden am Gerät die Erdung nicht abschalten.
◆ Das Gerät ist mit einer oder mehreren auswechselbaren Batterien
ausgestattet. Bei unsachgemäßem Auswechseln der Batterie besteht
Explosionsgefahr. Batterien nur mit dem vom Hersteller empfohlenen
Typ oder entsprechenden Typen ersetzen. Gebrauchte Batterien sind
gemäß den Anweisungen des Herstellers zu entsorgen.

Warnhinweis für Sollte Ihr Archiviergerät, NetCache-Gerät, NearStore-System oder

Geräte mit mehr- Diskettenregal mehrfache Netzanschlussleitungen aufweisen und Sie wollen
fachen Netzan- das Gerät abschalten, bitte folgenden Warnhinweis beachten.
schlussleitungen
ACHTUNG
Gerät besitzt zwei Netzanschlussleitungen. Vor Wartung alle Anschlüsse
vom Netz trennen.

vi Safety Information (Sicherheitshinweise)

Preface

About this guide This guide describes how to set up, install, connect, and manage the NetApp®
Fibre Channel DiskShelf14 (DS14) and DiskShelf14mk2 FC (DS14mk2 FC).

Audience This guide is for qualified system administrators and service personnel who are
familiar with Network Appliance™ filers and/or NetCache® appliances.

Terminology This guide uses the following terms:

◆ Disk shelf refers to any Fibre Channel disk shelf model.
◆ HA configuration refers to a disk shelf configuration that has an ESH
(Embedded Switching Hub) or ESH2 module instead of an LRC (Loop
Resiliency Circuit) module.
◆ LRC refers to the device that combines the LRC, which keeps the FC-AL
loop intact during the addition and removal of disks within a disk shelf and
the enclosure services processor, which communicates the environmental
data of the disk shelf.
◆ ESH refers to the device that combines the ESH, which provides high
availability should a disk fail, and the enclosure services processor, which
communicates the environmental data of the disk shelf.
◆ ESH2 refers to a second-generation ESH module.
◆ Module refers to the LRC, ESH, and ESH2 modules.
◆ Device carrier refers to the container that encases a fan/power supply unit or
a disk.
◆ Disk applies to any Fibre Channel disk encased in its device carrier.
◆ Loop refers to one or more daisy-chained disk shelves connected to a storage
appliance.
◆ Terminate refers to the process of closing a loop on an LRC or ESH module
by activating a terminate switch on the last disk shelf in the loop. The
terminate switch replaces the Output terminators and the auto-terminate
mechanism in previous versions of Fibre Channel disk shelves.
◆ Storage appliance refers to those NetApp filers and Fibre Attached Storage
(FAS) appliances that support the disk shelves.
◆ NetApp appliance refers to storage appliances and NetCache appliances that
support the disk shelves.

Preface vii
 ◆ Multiloop appliance refers to a storage appliance with more than one FC-AL
adapter connected to disk shelves.

Command You can enter filer commands on the system console or from any client that can
conventions obtain access to the filer using a Telnet session. In examples that illustrate
commands executed on a UNIX workstation, the command syntax and output
might differ, depending on your version of UNIX.

Formatting The following table lists different character formats used in this guide to set off
conventions special information.

Formatting
convention Type of information

Italic type ◆ Words or characters that require special attention.

◆ Placeholders for information you must supply.
For example, if the guide requires you to enter the
fctest adaptername command, you enter the
characters “fctest” followed by the actual name of
the adapter.
◆ Book titles in cross-references.

Monospaced font ◆ Command and daemon names.

◆ Information displayed on the system console or
other computer monitors.
◆ The contents of files.

Bold Words or characters you type. What you type is

monospaced font always shown in lowercase letters, unless your
program is case-sensitive and uppercase letters are
necessary for it to work properly.

Keyboard This guide uses capitalization and some abbreviations to refer to the keys on the
conventions keyboard. The keys on your keyboard might not be labeled exactly as they are in
this guide.

viii Preface
 What is in this guide... What it means...

hyphen (-) Used to separate individual keys. For example,

Ctrl-D means holding down the Ctrl key while
pressing the D key.

Enter Used to refer to the key that generates a carriage

return, although the key is named Return on some
keyboards.

type Used to mean pressing one or more keys on the

keyboard.

enter Used to mean pressing one or more keys and then

pressing the Enter key.

Special messages This guide contains special messages that are described as follows:

Note
A note contains important information that helps you install or operate the
system efficiently.

Caution
A caution contains instructions that you must follow to avoid damage to the
equipment, a system crash, or loss of data.

WARNING
A warning contains instructions that you must follow to avoid personal
injury.

Preface ix
x Preface
Preparing for the Installation 1
About this chapter This chapter describes the preparation requirements for first-time installation of
the disk shelf.

Topics in this This chapter discusses the following topics:

chapter ◆ “Differences between the DS14 and DS14mk2 FC” on page 2
◆ “Preparing your site” on page 4
◆ “Required tools and equipment” on page 7
◆ “Planning and organizing the installation” on page 8

Chapter 1: Preparing for the Installation 1

Differences between the DS14 and DS14mk2 FC

Differences The following table lists the differences between the DS14 and the DS14mk2 FC.
between the disk
shelves Note
See the System Configuration Guide at http://now.netapp.com for information
about the storage appliance supporting the disk shelf configuration.

Features DS14 DS14mk2 FC

Shelf Front: Drive bays are not Front: Drive bays are keyed
chassis keyed. to prevent the use of
unsupported drives.
Back: Power supply bays are
not keyed. Back: Power supply bays are
keyed to prevent the use of
older power supplies that are
incompatible.
Existence of a 1-Gb/2-Gb
loop-speed switch.

Drives in Drive carriers are unkeyed and Drive carriers are keyed and
drive cannot be used with DS14mk2 can be used with DS14.
carriers FC.

Power ◆ Power supplies are ◆ Power supplies are keyed

supplies unkeyed and cannot be and can be used with
used with DS14mk2 FC. DS14.
◆ AC and DC power ◆ Only AC power supplies
supplies are available. are available.

LRC LRC functions at 1-Gb loop LRC functions at 1-Gb loop

speed. speed and requires the loop-
speed switch to be set at 1-Gb.

ESH ESH functions at 1-Gb loop ESH functions at 1-Gb or 2-Gb

speed. loop speed, depending on the
system configuration.

2 Differences between the DS14 and DS14mk2 FC

 Features DS14 DS14mk2 FC

ESH2 ◆ ESH functions at 1-Gb ◆ ESH functions at 1-Gb or

loop speed. 2-Gb loop speed,
◆ Does not have a terminate depending on the system
switch. configuration.
◆ Does not have a terminate
switch.

Chapter 1: Preparing for the Installation 3

Preparing your site

About this section This section tabulates the following information:

◆ Disk shelf dimensions
◆ Disk shelf weight
◆ Space requirements
◆ Environmental requirements for operating or storing your disk shelf and
storage appliance
◆ Electrical requirements for your disk shelf

Your site must be capable of housing disk shelves with these requirements.

Disk shelf The following table lists the dimensions of a single disk shelf.
dimensions
Dimensions U.S. Metric

Height 5.25 in. or 3U, where 1U = 1.75 in. 13.3 cm

Width 17.6 in. 44.7 cm

Depth 20 in. 50.9 cm

Disk shelf weight The following table lists the weight of a single disk shelf based on its
configuration.

Weight U.S. Metric

When empty 50.6 lbs 23 kg

With 14 disk drives 77 lbs 35 kg

Space requirements For the disk shelf to have the proper operating conditions, the front of the disk
shelf must be at least 1 inch from the nearest obstruction. The back of the disk
shelf must be at least 6 inches from the nearest obstruction.

4 Preparing your site

Environmental The following table lists the maximum environmental conditions that your site
conditions must meet to properly run or store your disk shelf.

Environmental condition Operating condition Storage condition

Temperature range 50° F to 104° F -40° F to 149° F

(10° C to 40° C) (-40° C to 65° C)

Relative humidity 5% to 95% 5% to 95% in original

(noncondensing) shipping container;
otherwise, 50%.

Note
The recommended operating condition temperature range is 68 to 77° F (20 to
25° C).

Electrical Voltage and inrush current requirements: The following table lists the
requirements inrush current and input voltage requirements with power applied to the disk
shelf.

Current type Input voltage Inrush current

AC 220V AC 50A

110V AC 40A

DC -60V DC to -40V DC No greater than 20A under any

conditions

Note
The DC power can operate from a -48V or a +48V DC source.

Chapter 1: Preparing for the Installation 5

 Power requirements: The following table describes the power requirements
for the disk shelf connected to two 20A circuits based on a maximum PSU load.

Maximum
Type of disk Amps per number of disk
shelf Volts disk shelf shelves

DS14 100V to 120V AC 3.95 4

200V to 240V AC 1.90 8

-60V to -40V DC 7.50 N/A

DS14mk2 FC 100V to 120V AC 4.40 4

200V to 240V AC 2.30 8

Caution
Exceeding the allowed number of disk shelves can lead to power brownouts.

Power consumption and thermal rating: The power consumption (in

watts) and the number of BTUs per hour produced by the disk shelf depend on
the number and type of devices (for example, power supplies, disks, and so on)
installed in the disk shelf.
The following table gives an example of average power consumption for one disk
shelf with 14 disks, two fan/power supply units, and two LRC modules.

Type of disk shelf Power consumption Thermal rating

DS14 350W 1,195 BTU/hr.

DS14mk2 FC 440W 1,502 BTU/hr.

6 Preparing your site

Required tools and equipment

Required tools and You need the following tools and equipment:
equipment for ◆ #1 and #2 Phillips screwdrivers
installation
◆ Antistatic wrist strap and grounding leash

Caution
The disk shelf uses electronic components that are sensitive to static
electricity. Static discharge from your clothing or other fixtures around you
can damage these components. Put on an antistatic wrist strap and grounding
leash to free yourself of static electricity before touching any electronic
components.

◆ Appropriate screws, if the provided screws do not fit your rack

Note
This guide assumes that the rack has threaded holes. If it does not, you need
to provide clip nuts or nut-bars for fastening the screws.

◆ Additional tools to fabricate the cables for DS14 disk shelves with DC power
supplies:
❖ Wire-strippers
❖ Soldering tools
❖ Pliers
❖ 12 AWG x 3C copper wire (determine the length from the requirements
of your environment)
❖ Three copper compression connectors similar to the Panduit #LCA 8-10

Chapter 1: Preparing for the Installation 7

Planning and organizing the installation

Preparing for the This section identifies the shipment contents and the rules and regulations you
installation need to observe for the proper installation of your disk shelf. It also provides an
overview of the entire system installation process and the appropriate
documentation references for the procedures.

For detailed For detailed information, see the following topics:

information ◆ “Checking shipment contents” on page 9
◆ “Installation rules and restrictions” on page 10
◆ “Guide to the installation process” on page 11

8 Planning and organizing the installation

Planning and organizing the installation
Checking shipment contents

Checking shipment Make sure that your shipment package includes the following items, in addition
package contents to this DiskShelf14 and DS14mk2 FC Hardware Guide:
◆ A disk shelf containing the power supplies and Fibre Channel disks you
ordered
◆ Rack alignment tool
◆ FC-AL cables, as ordered
◆ One 0.25m (~10 inches) copper grounding braid and M5 screw
◆ Four #10-32 screws for securing the disk shelf to a rack

Note
If the #10-32 screws cannot be used in your environment, you need four
6 mm screws.

◆ Four bezel mounting screw covers

◆ Envelope with ID labels for the disk shelves, if you are adding these disk
shelves to an existing system
◆ Three mounting kit options for each disk shelf, containing the following
items:
❖ A two-post telco tray kit with eight 10 x 32 x 1/2 Phillips mounting
screws, eight 12 x 24 x 1/2 Phillips mounting screws, eight M5 x 16 mm
Phillips mounting screws, eight M6 x 16 mm Phillips mounting screws,
one 10-inch grounding cable kit with one M5 screw, and one two-piece
equipment tray with left and right halves
❖ A mid-mount telco kit with a pair of mid-mount mounting brackets and
four M5 x 8 mm screws and star washers. This must be used with the
two-post telco tray kit.
❖ A four-post rail kit with a left and right side rail set each with a washer,
a split washer and a wing nut installed, six optional M5 x 10 Phillips
screws, two optional M6 x 12.7H wingnuts, two optional flat washers,
and two optional 1/4 inch split lock washers.

Chapter 1: Preparing for the Installation 9

Planning and organizing the installation
Installation rules and restrictions

Rules for installing You need to observe the following rules and restrictions when installing a disk
disk shelves in a shelf in a standard 19-inch (48.26 cm) telco equipment rack with mounting rails:
rack ◆ You must work with another person.

WARNING
The disk shelf is extremely heavy. To avoid injuring yourself or
damaging the disk shelf, you must work with at least one other person
when you install the disk shelf in the rack.

◆ Install the storage appliance at the bottom of the rack. Installing the storage
appliance at the bottom of the rack adds support for the disk shelves.

WARNING
Install the equipment from the bottom up when installing it in a
movable rack. This helps prevent the rack from tipping over and
seriously injuring you or someone else.

Caution
The top cover of the storage appliance has ventilation holes. When installing
a disk shelf or other equipment above the storage appliance, leave at least 1.5
inches (4 cm) of space for air circulation directly above the ventilation holes.
You can install equipment directly on top of the unventilated area of the top
cover as long as it does not block the ventilation holes.

◆ When installing disk shelves in a rack, do not exceed the maximum storage
limit for your storage appliance.
◆ Make sure that the ID on the back panel of each disk shelf matches the ID
specified on its label.
◆ Always install the disk shelves fully loaded.
◆ If you have any empty drive bays, fill them with the provided empty drive
shuttles to ensure proper cooling.

10 Planning and organizing the installation

Planning and organizing the installation
Guide to the installation process

The installation The following table provides a guide to the disk shelf installation process.
process

Stage Procedure Is the procedure required? For instructions, go to...

1 Install the storage Only if the disk shelf installation Hardware guide for your
appliance in a is part of a new system storage appliance.
freestanding rack. installation.

2 Install the disk shelves in Yes, if the disk shelf is an addition “Installing a Disk Shelf” on
the rack. to your existing system or if your page 13.
new system was not shipped in a
system cabinet.

3 Connect the disk shelf to Only in the following scenarios:

the storage appliance.
◆ If the disk shelf installation is “Connecting a disk shelf to a
part of a new system storage appliance” on
installation. page 28.
◆ If the disk shelf is the first in
an additional loop to your
existing system.

4 Connect the disk shelves. Only in the following scenarios:

◆ If the new system installation “Connecting multiple disk

has multiple disk shelves. shelves” on page 33.

◆ If the disk shelf is an addition “Installing a disk shelf in an

to your existing system. existing mixed-shelf loop”
on page 90.

5 Ground the Fibre Channel Yes. “Grounding disk shelves” on

disk shelves and storage page 40.
appliance.

Chapter 1: Preparing for the Installation 11

 Stage Procedure Is the procedure required? For instructions, go to...

6 Connect the disk shelves Yes. “Connecting the disk shelf to

to a power source. a power source” on page 42.

If the system was shipped in a See the System Cabinet

system cabinet, you must connect Guide.
the system cabinet to a power
source.

7 Configure the system. Yes, if the disk shelf installation is See the Data ONTAP
part of a new system installation. Software Setup Guide or the
NetCache Quick Setup.

12 Planning and organizing the installation

Installing a Disk Shelf 2
About this chapter This chapter provides all the information you need to install a DS14 or DS14mk2
FC into a rack.

Topics in this This chapter discusses the following topics:

chapter ◆ “Before you begin your installation” on page 14
◆ “Installing a disk shelf in a rack” on page 18

Chapter 2: Installing a Disk Shelf 13

Before you begin your installation

About disk shelf Before you install one or more disk shelves in a rack, you need to understand the
installation following information:
◆ Disk shelf numbering
◆ Loop IDs
◆ Supported disk drives
◆ Drive bay requirements

Disk shelf Each disk shelf in a loop must have a unique ID. A valid shelf ID is from 1
numbering through 7, with disk shelf 1 connected to the storage appliance. If you install a
second or third loop of disk shelves, the disk shelf IDs in each loop must start at
1. The ID of a single disk shelf must be 1.

Note
When connecting a DS14 or DS14mk2 FC to a preexisting mixed-shelf loop of
FC7, FC8 and/or FC9, the DS14 or DS14mk2 FC disk shelf ID must be higher
than any of the disk shelves already in the loop.

Caution
A DS14 or DS14mk2 FC with ESH or ESH2 modules does not support mixed-
shelf loops. Disk shelves with LRC modules must not be present in a loop with
ESH or ESH2 modules.

Each disk shelf is shipped with its assigned ID set on its back panel. You must
ensure that the disk shelf has the correct ID number on the label. The ID label is
on the right side of the disk shelf, as shown in the following illustration.

Shelf 1

Drive Bays
13 0

0
Loop ID
13 12 11 10 9 8 7 6 5 4 3 2 1 0 29 - 16

14 Before you begin your installation

 Network Appliance sets the disk shelf IDs at the factory on configured systems,
using an ID switch on the back panel. If you order additional disk shelves, you
must set the disk shelf ID.

Note
If you enter a shelf ID that is not from 1 through 7, the drive addresses default to
those of a shelf with the ID switch set to 7 even though the Shelf ID indicator in
the front operation panel displays a dash (-).

The example in the following illustration shows a DS14mk2 FC with the disk
shelf ID set to 1.

1
1

Shelf ID switch

Loop IDs In addition to identifying the disk shelf ID and the direction of the drive bays, the
ID label on the right side of the disk shelf includes the loop ID. The loop ID
identifies the disks in the disk shelf. The last sheet of the quick reference cards
that come with your disk shelf shows the seven disk shelf IDs and their
corresponding loop IDs.

Chapter 2: Installing a Disk Shelf 15

 Note
For ESH A or ESH2 A, the loop ID is in descending order, and for ESH B or
ESH2 B, the loop ID is in ascending order.

Supported disk The DS14 and DS14mk2 FC support 18-GB, 36-GB, 72-GB, and 144-GB block
drives checksum disk drives.

Drive bay For enclosure services monitoring to work, drive bays 0 and 1 must contain a
requirements disk.

16 Before you begin your installation

 This requirement is posted on the label on the left flange of the disk shelf. The 14
drive bays in the disk shelf are numbered 0 through 13 from right to left, as
shown in the following illustration.

Label
POPULATE
BAYS 0 & 1
FOR
ENCLOSURE
SERVICES 0

13 12 11 10 9 8 7 6 5 4 3 2 1 0

The storage appliance uses the enclosure services monitoring method to monitor
environmental conditions of the disk shelf. Enclosure services conditions are
communicated to the storage appliance through the LRC/ESH module.

The following table describes the three stages of enclosure services monitoring.

Stage Device What it does...

1 Storage Uses a subset of SCSI-3 commands to monitor the

appliance disk shelf for data related to disk presence,
temperature, power supply units, and fan status.

2 Storage Sends the commands through its Fibre Channel

appliance interface to drive bays 0 and 1 on the disk shelf.

3 Drive bays 0 Communicate the request to the LRC/ESH module

and 1 and send the data to the storage appliance.

LRC, ESH, or Collects the requested data and sends it to drive

ESH2 module bays 0 and 1.

Chapter 2: Installing a Disk Shelf 17

Installing a disk shelf in a rack

Installing a disk To install the disk shelf in a rack, complete the following steps.
shelf
WARNING
You must install each disk shelf with either the two-post telco tray kit or the
four-post rail kit that came in your shipment package. If you choose to mid-
mount the disk shelf, use the mid-mount brackets with the two-post telco
tray kit. Do not ear-mount the disk shelf into a telco-type rack; the disk shelf
will collapse from the rack under its own weight.

Step Action

1 Verify that your NetApp appliance meets the minimum software requirements to support the disk
shelf and module combination. See the System Configuration Guide at http://now.netapp.com for
more information.

2 Put on the antistatic wrist strap and grounding leash.

3 If the disk shelf is... Then...

Part of a new storage appliance system that Install your storage appliance. See your
you are installing storage appliance hardware guide for more
information.

An addition to an existing storage appliance Verify that you received the envelope with the
system disk shelf ID labels.

4 Select two holes on each side of the rack for the installation.

5 If you are using the... Then...

Two-post telco tray kit 1. Align the left-post screw holes on the two-
post rack with the screw holes on the left
half of the telco tray, then secure it to the
post with two M5 screws.

2. Align the right half of the telco tray with

the left half and repeat Step 1 to secure it
to the post.

18 Installing a disk shelf in a rack

 Step Action

The following illustration shows the two-post telco tray kit being installed.

Two-post
telco tray kit

Rear view

To flush-mount the disk shelf:

1. Install the disk shelf onto the two-post

telco tray and retain it with the mounting
screws to secure the disk shelf mounting
flanges to the telco-type rack.

2. Conceal the mounting screws with the

provided bezel mounting screw covers.

Chapter 2: Installing a Disk Shelf 19

 Step Action

The following illustration shows a DS14 being flush-mounted onto the two-post telco tray.

DS14

To mid-mount the disk shelf:

1. Select two holes in the middle of each side

of the disk shelf to which you want to
attach the mid-mount brackets and secure
the bracket with the #10 Phillips head
screws.

The following illustration shows a mid-mount bracket being installed on DS14.

Mid-mount

DS14

20 Installing a disk shelf in a rack

 Step Action

2. Align each bracket on the side of the disk

shelf with the chosen holes on the rack
and secure the bracket with the #10
Phillips head screws.

The following illustration shows a DS14 installed in a rack using a mid-mount bracket.

DS14

Four-post rail kit 1. Assemble the left side rail and left side
support, sliding a washer and lock washer
over the threaded post of the left side rail.

2. Secure the side rail and side support

assembly together with the wing nut, but
allow for adjustment.

3. Adjust the rail assembly so that it extends

to the front and rear posts of the
equipment rack.

4. Secure the front of the rail assembly to the

front post of the rack, using the M5 x 10
mounting screws or the appropriate size
mounting screws, and then secure the rear
of the rail assembly to the rear post of the
rack.

Chapter 2: Installing a Disk Shelf 21

 Step Action

DS14

Wing nut
Screws to rail
Lock washer
1 Washer
Adjustable support

5. Repeat Step 1 through Step 4 for the right

rail assembly.

6. Tighten the wing nuts on both rail

assemblies.

7. Slide your disk shelf onto the rail

assemblies and secure it to the front of the
rack with the screws that came with the
disk shelf.

8. If desired, apply the ear covers or screw

covers over the heads of the mounting
screws by peeling the adhesive strip from
the back of the covers and applying one to
each mounting flange or screw head on
your equipment.

22 Installing a disk shelf in a rack

 Step Action

6 If the installed disk shelf is... Then...

Part of a new storage appliance system Make sure that the disk shelf ID is correct.

Note
For a single disk shelf installation, the disk
shelf ID is 1.

An addition to an existing storage appliance Change the disk shelf ID with the following
system procedure:

1. Press the thumbwheel switch on the rear

of the disk shelf and use the + button to
raise the number and the - button to lower
the number to a valid ID from 1 through 7.

Note
If you change a disk shelf ID, you must
power-cycle the disk shelf for the new ID
to take effect. The disk shelf ID display on
the front of the disk shelf blinks until you
power-cycle the disk shelf.

2. Select the correct label from the envelope

identified in Step 3 and attach it to the
right flange of the new disk shelf.

7 If disk shelves in the loop to which you are

adding the new disk shelf have... Then...

LRCs ◆ DS14 only: Go to Step 8.

◆ A mix of DS14 and DS14mk2 FC: Set the
loop speed to 1 Gb.

Caution
An incorrectly set loop speed results in an
open loop condition.

Chapter 2: Installing a Disk Shelf 23

 Step Action

ESHs and ESH2s ◆ DS14 only or a mix of DS14 and

DS14mk2 FC: Set the loop speed to 1 Gb.
◆ DS14mk2 FC only that are running at 1
Gb: Set the loop speed to 1 Gb.
◆ DS14mk2 FC only that are running at 2
Gb: Set the loop speed to 2 Gb.

Caution
An incorrectly set loop speed causes the
storage appliance to panic.

8 If there are multiple disk shelves in the installation on the same loop, follow Step 5 and Step 6 to
install the remaining disk shelves in ascending numerical order, according to the IDs on their
labels.

9 Go to Chapter 3, “Connecting a Disk Shelf,” on page 25.

24 Installing a disk shelf in a rack

Connecting a Disk Shelf 3
About this chapter This chapter describes how to connect a single disk shelf or a loop of disk shelves
to a supported storage appliance, how to ground your system, and how to connect
your system to power.

Topics in this This chapter discusses the following topics:

chapter ◆ “Connecting disk shelves to a storage appliance” on page 26
◆ “Grounding disk shelves” on page 40
◆ “Connecting the disk shelf to a power source” on page 42

Chapter 3: Connecting a Disk Shelf 25

Connecting disk shelves to a storage appliance

Considerations for This section describes how to connect the disk shelf to a supported storage
connecting the disk appliance. The following table presents what to consider when connecting the
shelves disk shelf to a storage appliance.

Type and number of

FC-AL adapters in
the storage appliance LRC connectivity ESH connectivity

1 copper adapter A single loop is the supported Unsupported

configuration for an
unclustered storage appliance.
LRC B must be terminated.

2 copper adapters A dual loop is a supported Unsupported

configuration for an
unclustered storage appliance.
LRCs B must be terminated.
A single loop is the preferred
configuration for an
unclustered storage appliance
because it provides for load
balancing on the shelf.

4 copper adapters For a clustered or mirrored Unsupported

storage appliance, a dual loop
is the supported configuration.
Mirroring requires Data
ONTAP™ 6.1 software or
later.

1 dual optical adapter A single loop is the supported configuration for an

unclustered storage appliance.

2 to 4 dual optical A multiple loop is the supported configuration for a

adapters clustered or mirrored storage appliance.

26 Connecting disk shelves to a storage appliance

Disk shelf cabling The following table lists the cabling requirements for the disk shelves.
requirements
Type of device Cabling requirements

LRC ◆ Can only connect to another LRC.

◆ Uses HSSDC to DB-9 cables when connecting to
copper FC-AL adapters and SC-to-LC cables when
connecting to optical FC-AL adapters.
◆ Uses DB-9 to DB-9 cables for connections between
disk shelves.

ESH ◆ Uses LC to LC cables when connecting to optical FC-

AL adapters.

Note
Connecting to copper adapters is not supported.

◆ Can only connect to another ESH or ESH2.

◆ Uses HSSDC2-to-HSSDC2 cables for connections
between disk shelves with ESH.
◆ Uses HSSDC2-to-SFP cables for connections between
a disk shelf with ESH and a disk shelf with ESH2.

ESH2 ◆ Requires an optical SFP in the input port and an LC to

LC cable when connecting to optical FC-AL adapters.

Note
Connecting to copper adapters is not supported.

◆ Can only connect to another ESH or ESH2.

◆ Uses SFP-to-SFP cables for connections between disk
shelves with ESH2.
◆ Uses HSSDC2-to-SFP cables for connections between
a disk shelf with ESH2 and a disk shelf with ESH.

For detailed The following sections provide detailed information about connecting one or
information more disk shelves in a rack:
◆ “Connecting a disk shelf to a storage appliance” on page 28
◆ “Connecting multiple disk shelves” on page 33
◆ “Connecting to multiple loops of disk shelves” on page 35

Chapter 3: Connecting a Disk Shelf 27

Connecting disk shelves to a storage appliance
Connecting a disk shelf to a storage appliance

Assumptions about The assumption about this procedure is that the disk shelf is the only disk shelf
this procedure connected to the NetApp appliance or it is the first disk shelf in a single loop.

Connecting a disk To connect the disk shelf to a storage appliance, complete the following steps.
shelf to a storage
appliance Caution
Observe the “Disk shelf cabling requirements” on page 27 and do not mix
LRC/ESH/ESH2 modules within a shelf.

Step Action

1 Verify that your NetApp appliance meets the minimum software

requirements to support the disk shelf and module combination. See
the System Configuration Guide at http://now.netapp.com for more
information.

2 Put on the antistatic wrist strap and grounding leash.

3 Make sure that the storage appliance and the disk shelf are turned off.

4 If... Then...

5 Your storage appliance has Connect the cable to the FC-AL

an FC-AL adapter with a adapter on the storage appliance.
single copper interface

6 Your single filer has two Connect the cable to one of the FC-AL
FC-AL adapters with single adapters on the filer.
copper interfaces

7 Your NetApp appliance has Connect one end of the dual-headed

a dual optical interface cable into Port A (Port 1) of the
adapter on the NetApp appliance.

28 Connecting disk shelves to a storage appliance

 Step Action

8 If the module A input... Then...

Has a copper interface 1. Connect the other end of the cable

to the LRC A Input on disk shelf
1.

2. If applicable, tighten the locking

screws on the connector with a
screwdriver.

The following illustration shows a DS14 connected to a storage

appliance using a copper interface.

Has an optical interface Connect the other end of the dual-

headed cable to the module A Input on
disk shelf 1.

Chapter 3: Connecting a Disk Shelf 29

 Step Action

The following illustration shows a DS14 connected to a storage

appliance using a dual optical interface.

Input

0
Input

9 Set the terminate switch on LRC/ESH A to the On position (down),

as shown in the following illustration.

Note
ESH2 is self-terminating and does not have a terminate switch.

LRC A active
terminate position

30 Connecting disk shelves to a storage appliance

 Step Action

10 If... Then...

Your filer has an FC-AL Go to Step 11.

adapter with a single
copper interface

Your single filer has two Connect the cable to the second FC-
FC-AL adapters with single AL adapter on the filer.
copper interfaces

Your NetApp appliance has Connect one end of the dual-headed

a dual optical interface cable into Port B (Port 2) of the
adapter on the storage appliance.

11 If the module B input... Then...

Is a copper interface on a Place a terminator on the Fibre

DS14 and is not part of a Channel input of LRC B.
clustered filer system

Has a copper interface and 1. Connect the other end of the cable
your single filer and has to the LRC B Input on disk shelf
two FC-AL adapters with 1.
single copper interfaces
2. If applicable, tighten the locking
screws on the connector with a
screwdriver.

Is part of a cluster, mirrored See the cluster guide for your storage
cluster, or MetroCluster appliance for more information.
system

Has an optical interface Connect the other end of the dual-

headed cable to the module B Input on
disk shelf 1.

Chapter 3: Connecting a Disk Shelf 31

 Step Action

12 If the disk shelf... Then...

Is the only disk shelf in the 1. Set the terminate switch on

loop connected to the Channel B to the On position
storage appliance (up).

Note
The On position of LRC/ESH B
is the inverse of LRC/ESH A.
ESH2 is self-terminating and does
not have a terminate switch.

2. Connect the disk shelf to a power

source. See “Connecting the disk
shelf to a power source” on
page 42.

Is the first disk shelf in a Connect the disk shelf to the

loop of disk shelves remaining disk shelves. See
“Connecting multiple disk shelves” on
page 33.

32 Connecting disk shelves to a storage appliance

Connecting disk shelves to a storage appliance
Connecting multiple disk shelves

Connecting multiple To connect multiple disk shelves, complete the following steps.
disk shelves
Caution
Observe the “Disk shelf cabling requirements” on page 27 and do not mix
LRC/ESH/ESH2 modules within a shelf.

Step Action

1 Connect the remaining disk shelves in ascending order by completing

the following connections:

1. Connect one end of the cable to the module A Output on the disk
shelf.

2. Connect the other end of the cable to the module A Input on the
next disk shelf.

2 On all but the last disk shelf in the loop, place the terminate switch on
LRC/ESH A to the Off position (up).

Note
ESH2 is self-terminating and does not have a terminate switch.

3 On the last disk shelf in the loop, place the terminate switch on
LRC/ESH A to the On position (down).

Note
ESH2 is self-terminating and does not have a terminate switch.

4 Connect the remaining disk shelves in ascending order by completing

the following connections:

1. Connect one end of the cable to the module B Output on the disk
shelf.

2. Connect the other end of the cable to the module B Input on the
next disk shelf.

Chapter 3: Connecting a Disk Shelf 33

 Step Action

The following illustration shows the LRC of a DS14mk2 FC being

connected to the LRC on another DS14mk2 FC.

1
1

CONSOLE

DIAGNOSTIC FC-AL 0

5 On all but the last disk shelf in the loop, place the terminate switch on
LRC/ESH B to the Off position (down).

Note
ESH2 is self-terminating and does not have a terminate switch.

6 On the last disk shelf in the loop, place the terminate switch on
LRC/ESH B to the On position (up).

Note
ESH2 is self-terminating and does not have a terminate switch.

7 Connect the disk shelf to a power source. See “Connecting the disk
shelf to a power source” on page 42.

34 Connecting disk shelves to a storage appliance

Connecting disk shelves to a storage appliance
Connecting to multiple loops of disk shelves

Requirements for Before you connect multiple loops of disk shelves, make sure that your storage
connecting appliance meets the following requirements:
additional loops ◆ Multivolumes and RAID are correctly configured for filers. See the Data
ONTAP System Administrator’s Guide for information about how to
configure multivolumes and RAID.
◆ The disk firmware is up-to-date for all the disks in each disk shelf. Go to
http://now.netapp.com for the correct firmware versions.
◆ Multiple loop configurations are supported by your storage appliance. See
the System Configuration Guide at http://now.netapp.com for information
about the current configurations supported by your storage appliance.

Connecting multiple Each additional loop requires an FC-AL disk adapter in the storage appliance.
loops to a storage See the System Configuration Guide at http://now.netapp.com for information
appliance about adapters supported by your storage appliance. The following illustration
shows a storage appliance connected to two loops of DS14 disk shelves without
the benefit of multipath cabling.

Up to maximum number of disk

shelves supporting your filer.
0
0

0
0

FC-AL adapter
HSSDC connector

Chapter 3: Connecting a Disk Shelf 35

 To connect another loop of disk shelves to a storage appliance, complete the
following steps.

Step Action

1 If... Then

Your single filer has four FC- Connect the loop to the remaining
AL adapters with single copper pair of FC-AL adapters on the
interfaces filer by following the procedure
in “Connecting a disk shelf to a
storage appliance” on page 28.

Your storage appliance has a 1. Follow Step 2 through Step

dual optical interface 10 of the procedure in
“Connecting a disk shelf to a
storage appliance” on
page 28.

2. Connect the storage

appliance to module B of
disk shelf 1 in the next loop
of disk shelves. See
“Ensuring data integrity with
multiple loops” on page 36
which tabulates possible
cabling options.

3. Go to Step 12 of the
procedure in “Connecting a
disk shelf to a storage
appliance” on page 28.

Ensuring data Software enhancements provided by Data ONTAP 6.1 or later enable you to
integrity with ensure data integrity and incorporate redundancy through the use of multipath
multiple loops cabling in your filer system.

FC-AL adapters with the copper interface: Each loop of disk shelves
must be connected to two FC-AL adapters.

The following table shows the possible configuration for a filer with four
adapters connected to two loops of shelves.

36 Connecting disk shelves to a storage appliance

 Number of copper interface adapters

Number of loops 1 2 3 4

1 LRC A X - - -

LRC B - - - X

2 LRC A - - X -

LRC B - X - -

The following illustration shows a filer with two copper FC-AL adapters
connected to a single loop of DS14 disk shelves with the benefit of multipath
cabling.

Up to maximum
number of disk
shelves supporting
your filer.
0
0

FC-AL adapter

HSSDC
connector

FC-AL adapters with the dual optical interface: If Port A (Port 1) of the
adapter is connected to the module A of disk shelf 1 of a particular loop, Port B
(Port 2) of the same adapter is not connected to module B of disk shelf 1 of the

Chapter 3: Connecting a Disk Shelf 37

 same loop. This is done to ensure maximum redundancy at the FC-AL HBA
level. The following table shows the possible configuration for a storage
appliance with two adapters connected to two loops of shelves.

Number of dual optical interface adapters

1 2

Number of loops A B A B

1 Module A X - - -

Module B - - - X

2 Module A - - X -

Module B - X - -

The following illustration shows a filer with two dual optical FC-AL adapters
connected to two loops of DS14 disk shelves with LRC modules that have the
benefit of multipath cabling.

Up to maximum number of disk

shelves supporting your filer.
0
0

0
0

38 Connecting disk shelves to a storage appliance

 The following table shows a possible configuration for a filer with three adapters
connected to three loops of DS14/DS14mk2 FC disk shelves.

Number of dual optical interface adapters

1 2 3

Number of loops A B A B A B

1 Module A X - - - - -

Module B - - - X - -

2 Module A - - X - - -

Module B - - - - - X

3 Module A - - - - X -

Module B - X - - - -

The following table shows the possible configuration for a filer with four
adapters connected to four loops of DS14/DS14mk2 FC disk shelves.

Number of dual optical interface adapters

1 2 3 4

Number of loops A B A B A B A B

1 Module A X - - - - - - -

Module B - - - X - - - -

2 Module A - - X - - - - -

Module B - - - - - X - -

3 Module A - - - - X - - -

Module B - - - - - - - X

4 Module A - - - - - - X -

Module B - X - - - - - -

Chapter 3: Connecting a Disk Shelf 39

Grounding disk shelves

About grounding For proper grounding, you must daisy-chain the disk shelves and storage
connected disk appliance together with the provided braided copper cables and screws. Multiple
shelves racks should be grounded together.

Each disk shelf is shipped with a 0.25m (~6 inch) braided copper cable and an
M5 x 0.5 inch Phillips head screw. The copper cable has a hole on each end for
grounding filer-to-shelf or shelf-to-shelf.

The storage appliance is shipped with a 0.75m (~19 inch) braided copper cable
and an 8-32 x 0.5 inch Phillips head screw. The copper cable has a lug connector
on each end for grounding filer-to-shelf or filer-to-second loop.

Note
The copper cable shipped with the storage appliance is only necessary when
grounding the storage appliance to a second loop, or when grounding the storage
appliance to a disk shelf farther away than 0.75m (the length of the filer-to-shelf
cable).

Grounding To ground connected disk shelves to a storage appliance, complete the following
connected disk steps.
shelves
Step Action

1 Secure the lug at one end of the 0.25m braided copper cable to the
threaded insert at the back of the storage appliance using the M5 x
0.5 inch screw.

2 Overlay the hole on one end of another 0.25m copper cable to the
unused lug end of the copper cable connected to the storage
appliance.

3 Using the provided M5 x 0.5 inch shelf screw, connect both copper
cables to the threaded hole adjacent to the power supply receptacles
on disk shelf 1.

40 Grounding disk shelves

 Step Action

4 Overlay the hole on one end of another 0.25m copper cable to the
unused lug end of the copper cable connected to the preceding disk
shelf.

5 Using the provided M5 x 0.5 inch shelf screw, connect both copper
cables to the threaded hole adjacent to the power supply receptacles
on the next disk shelf.

The following illustration shows disk shelves grounded to an F700

series filer. While the location for the grounding holes for the various
storage appliances may be different, you can ground any NetApp
storage appliance in a similar manner.

Braided copper
cable
Threaded M5 hole
1

CONSOLE

DIAGNOSTIC FC-AL 0

Threaded 8-32 hole for

all filers except the F630
filer. Threaded 8-32 hole
for all NetCache appliances.

6 Repeat Step 4 and Step 5 with the supplied braided copper cables
until the storage appliance and all disk shelves are grounded together.

Chapter 3: Connecting a Disk Shelf 41

Connecting the disk shelf to a power source

About the power The disk shelf is shipped with two power supplies, labeled PSU1 and PSU2,
supplies respectively.

About AC power supplies: The disk shelf is shipped with an AC power cord
for each power supply. You must have separate circuit breakers for each power
supply.

About DC power supplies: DC power supplies are supported for use in the
DS14 shelf only. You must fabricate the power cords for the DC power
connections.

Connecting the disk To connect a disk shelf to a power source, complete the following steps.
shelf to power
Step Action

1 Make sure that the storage appliance and the disk shelves are turned
off.

2 If you are connecting to... Then...

AC power 1. Plug the power cord for PSU1

into the power receptacle on the
left connector (rear view).

2. Plug the power cord for PSU2

into the power receptacle on the
right connector (rear view).

3. Fasten the power cords with the

clamps.

4. Plug the other end of each

power cord into a grounded AC
power source.

42 Connecting the disk shelf to a power source

 Step Action

5. Turn on the power switch.

Note
The default spin up time for all
disks in the disk shelf is 60
seconds. Reduce this spin up
time to 20 seconds by turning on
the switches of both power
supplies within 5 seconds of
each other.

DC power 1. Remove the cover over the DC

input connector.

2. Fabricate a three-way cable:

a. Use wire-strippers to strip

an inch of the protective
sheathing from the copper
wire.

b. Identify the positive,

negative, and ground wires.

c. Crimp and solder a

connector to the end of the
positive, negative, and
ground wires.

3. Connect the ground, positive,

and negative wires to the power
supply.

4. Place the terminate cover over

the DC input connector to avoid
shorting the power supply
cables.

5. Plug the other end of each

power cord into a power source
and turn it on.

Chapter 3: Connecting a Disk Shelf 43

44 Connecting the disk shelf to a power source
Monitoring the Disk Shelf 4
About this chapter This chapter describes how to monitor the disk shelf from the error messages
displayed on the console that is connected to the storage appliance and identifies
the location of the various LEDs on the disk shelf.

Note
The quick reference cards in the slide-out tray at the base of the disk shelf
describe the functions of each LED on the disk shelf and the suggested course of
action.

Topics in this This chapter discusses the following topics:

chapter ◆ “Monitoring the front operation panel” on page 46
◆ “Monitoring the LRC, ESH, or ESH2 modules” on page 49
◆ “Monitoring the ESH/ESH2” on page 53
◆ “Monitoring the Fibre Channel disk” on page 61

Chapter 4: Monitoring the Disk Shelf 45

Monitoring the front operation panel

About monitoring The front operation panel has five LEDs and a disk shelf ID display. The LEDs
the front operation indicate whether your disk shelf is functioning normally or there are problems
panel with the hardware. You can also identify any hardware failure associated with the
front operation panel of the disk shelf from the error messages displayed on your
storage appliance console.

Location of LEDs The following illustration shows the location of the disk shelf ID display and the
front panel LEDs.

DS14

Power
Fault
Loop A
Loop B
System
1

Disk shelf ID display

Note
The Fault and System LEDs are amber. The other three LEDs are green. See
“LED status on the front operation panel” on page 47 for an illustrated
explanation of how the LEDs function.

Monitoring the disk When you use the thumbwheel switch on the back of the disk shelf to change the
shelf ID disk shelf ID, the disk shelf ID display on the front panel blinks until you power-
cycle the disk shelf to make the change take effect.

46 Monitoring the front operation panel

LED status on the The following illustration is of the first sheet of the quick reference cards that
front operation come with your disk shelf. It shows the normal and fault conditions that the
panel LEDs indicate and recommends a corrective action.

Front operation The following error messages appear on your storage appliance console if an SES
panel console error element on the front operation panel fails. For information about replacing a disk
messages shelf, see “Removing a disk shelf” on page 64.

Error message Action required

Temperature sensor The temperature sensor on the front operation panel

Element 1: failed failed. Contact Network Appliance customer service
to replace the disk shelf.

Chapter 4: Monitoring the Disk Shelf 47

 Error message Action required

Alarm The alarm on the front operation panel failed. Contact

Element 1: failed Network Appliance customer service to replace the
disk shelf.
Display The alarm on the front operation panel failed. Contact
Element 1: failed Network Appliance customer service to replace the
disk shelf.

48 Monitoring the front operation panel

Monitoring the LRC, ESH, or ESH2 modules

About monitoring The LRC has three LEDs, and the ESH and ESH2 have four LEDs. The LEDs
the modules common to all modules indicate whether the it is functioning normally or there
are any problems with the hardware. The fourth LED on the ESH/ESH2 module
indicates 2-Gb operation when lit. You can also identify any hardware failure
associated with the module from the error messages displayed on your storage
appliance console.

This section also describes the different types of messages that appear on the
storage appliance console in response to a command monitoring the ESH/ESH2.

Location of the The modules are in the middle of the back of the disk shelf.
module LEDs
The following illustration shows the location of the LEDs for an LRC with
copper interfaces.
on Terminate

Fault
Out
In

off

In Out Fault

Note
The Fault LED is amber. The other two LEDs are green. See “LED status on the
LRC/ESH/ESH2” on page 51 for an illustrated explanation of the LED functions.

The following illustration shows the location of the LEDs for an LRC with an
optical input interface and copper output interface.
Fault Out In
off
on Terminate
Out
Fault

In

Chapter 4: Monitoring the Disk Shelf 49

 The following illustration shows the location of the LEDs for an ESH.

In Out Fault

The following illustration shows the location of the LEDs for an ESH2.

Note
Because module A on the DS14 is inverted, the location of the module A LEDs is
the inverse of what is shown in the preceding illustrations.

50 Monitoring the LRC, ESH, or ESH2 modules

LED status on the The following illustration is of the second sheet of the quick reference cards that
LRC/ESH/ESH2 come with your disk shelf.

Note
The rest of the second sheet of the quick reference card identifies the LED status
conditions for the power supply and the integrated fan module.

LRC/ESH/ESH2 The following error messages appear on your storage appliance console if an SES
console error element on the LRC/ESH/ESH2 fails. For information about replacing the
messages LRC/ESH/ESH2, see “Replacing an LRC/ESH/ESH2 module” on page 76.

Error message Action required

Temperature sensor The temperature sensor on LRC module A on the

top back of the disk shelf failed. Contact Network
Element 2: failed
Appliance customer service to replace the LRC.

Chapter 4: Monitoring the Disk Shelf 51

 Error message Action required

Temperature sensor The temperature sensor on LRC module B on the

Element 3: failed bottom back of the disk shelf failed. Contact
Network Appliance customer service to replace the
LRC.
SES electronics Module A was replaced and the shelf has the
Element 1: component following unsupported configurations:
is from a different
product family ◆ ESH and LRC
◆ ESH2 and LRC
◆ ESH and ESH2
This error message occurs during the process of
hot-upgrading.
SES electronics Module B was replaced and the shelf has the
Element 2: component following unsupported configurations:
is from a different
product family ◆ ESH and LRC
◆ ESH2 and LRC
◆ ESH and ESH2
This error message occurs during the process of
hot-upgrading.
SES electronics LRC/ESH/ESH2 module A on the top back of the
Element 1: failed disk shelf failed. Contact Network Appliance
customer service to replace the LRC.
SES electronics LRC/ESH/ESH2 module B on the bottom back of
Element 2: failed the disk shelf failed. Contact Network Appliance
customer service to replace the LRC.
Temperature sensor Communication was possible with the temperature
Element 2: not sensor on ESH/ESH2 module A at one point, but it
installed or failed
is not possible now. Even if traffic is flowing
through the Fibre Channel loop, contact Network
Appliance customer service to replace the
ESH/ESH2.

52 Monitoring the LRC, ESH, or ESH2 modules

 Error message Action required

Temperature sensor Communication was possible with the temperature

Element 3: not sensor on ESH/ESH2 module B at one point, but it
installed or failed
is not possible now. Even if traffic is flowing
through the Fibre Channel loop, contact Network
Appliance customer service to replace the
ESH/ESH2.
SES electronics Communication was possible with ESH/ESH2
Element 1: not module A at one point, but it is not possible now.
installed or failed
Even if traffic is flowing through the Fibre Channel
Vendor-specific loop, contact Network Appliance customer service
Element 1: not to replace the ESH/ESH2.
installed or failed

SES electronics Communication was possible with ESH/ESH2

Element 2: not module B at one point, but it is not possible now.
installed or failed
Even if traffic is flowing through the Fibre Channel
Vendor-specific loop, contact Network Appliance customer service
Element 2: not to replace the ESH/ESH2.
installed or failed

Monitoring the Command to use: The storage show hub command enables you to
ESH/ESH2 monitor the ESH/ESH2.

Sample output: The following is an example of the output from the storage
show hub command. The exact messages that appear on your system console
depend on your system configuration.

Note
For the ESH2, the following output shows the Term switch status as N/A or not
applicable because the ESH2 does not have a terminate switch.

Chapter 4: Monitoring the Disk Shelf 53

 Hub name: 9.shelf2
Channel: 9
Loop: B
Shelf id: 2
Shelf UID: 50:05:0c:c0:02:00:24:02
Term switch: ON
Shelf state: ONLINE
ESH state: OK

Disk Disk Port Loop Invalid Invalid Clock Insert Stall Util %
ID Bay State up CRC Word Delta Count Count
Count Count Count

[IN] OK 8 0 0 0 20 0 0
[OUT] TERM 8 0 0 -8 6 0 0
[32] 0 OK 10 0 0 0 6 0 0
[33] 1 OK 8 0 0 -8 9 0 0
[34] 2 OK 10 0 0 -8 6 0 0
[35] 3 OK 10 0 0 0 8 0 0
[36] 4 OK 10 0 0 0 9 0 0
[37] 5 OK 10 0 0 -16 7 0 0
[38] 6 OK 10 0 0 0 6 0 0
[39] 7 OK 10 0 0 16 16 0 0
[40] 8 BYP/TBI 10 0 0 0 8 0 0
[41] 9 OK 8 0 0 -8 6 0 0
[42] 10 OK 8 0 0 0 6 0 0
[43] 11 EMPTY 8 0 0 0 15 0 0
[44] 12 OK 8 0 0 8 4 0 0
[45] 13 OK 10 0 0 16 8 0 0

Description of hub You might receive some of the following status reports in response to the
status information storage show hub command.

Shelf state: The following table lists and describes the shelf status responses.

Shelf state Description

ONLINE Shelf is fully configured and operational.

INIT REQD Shelf needs to configure one or both ESH/ESH2 modules.

OFFLINE Contact was lost with shelf (SES drive access is down).

MISSING Shelf was removed from the system entirely (all paths).

54 Monitoring the LRC, ESH, or ESH2 modules

 Shelf state Description

FAILED Failure occurred on the shelf.

ESH/ESH2 state: The following table lists and describes the ESH/ESH2 status
responses.

Shelf state Description

OK ESH/ESH2 is fully operational.

MISSING ESH/ESH2 is missing from the specified slot.

XPORT ERROR Communication with the ESH/ESH2 is not possible.

Terminate (Term) switch state: The following table lists and describes the
terminate switch status.

Note
The information in the following table is not applicable to the ESH2 because it
does not have a terminate switch.

Shelf state Description

OK Terminate switch is in the Off position. This DS14/DS14mk2

FC is connected to another DS14/DS14mk2 FC in the loop.

TERM Terminate switch is in the On position. This DS14/DS14mk2

FC is the last shelf in the loop.

TERM-ERR Forced terminate event. The terminate switch is in the On

position even though this DS14/DS14mk2 FC is connected to
another DS14/DS14mk2 FC in the loop. The ESH output port
LED flashes to indicate this configuration error.

AUTO-TERM Terminate switch is in the Off position. The output port is no

longer connected to another DS14/DS14mk2 FC in the loop,
but it once was. The ESH output port LED flashes to indicate
this configuration error.

Chapter 4: Monitoring the Disk Shelf 55

 ESH/ESH2 port state: The following table lists and describes the ESH/ESH2
status responses.

Shelf state Description

OK Port is functioning normally.

EMPTY No drive is present in bay.

BYP/TBI Port failed loop test before insert and was not allowed into
loop.

BYP/XMIT Port bypassed due to transmitter default.

BYP/LIPF8 Port bypassed due to drive generating LIP F8s.

BYP/DTO Port bypassed due to data timeout errors.

BYP/RLOS Port bypassed due to receiver loss of signal.

BYP/CLOS Port bypassed due to comma loss of signal.

BYP/RPRT Port bypassed due to redundant port connection.

BYP/STALL Port bypassed due to excessive stall errors.

BYP/WRD Port bypassed due to excessive word errors.

BYP/CRC Port bypassed due to excessive CRC errors.

BYP/CLK Port bypassed due to excessive clock delta.

BYP/MIR Port bypassed due to cluster mirror bit being set (check
partner).

BYP/LIPF7 Port bypassed due to drive transmitting LIP F7s.

BYP/GEN Port bypassed due to a “generic” error.

BYP/MAN Port was manually bypassed (Manufacturing test only).

BYP/LIP Port bypassed due to drive generating excessive LIP

requests.

BYP/INIT Port bypassed as part of ESH Power-On Self-Test.

///:0xXX ESH Admin unable to decode port state XX.

56 Monitoring the LRC, ESH, or ESH2 modules

 Hub statistic: The following table lists and describes the hub statistic
responses.

Hub statistic Description Common values Failure?

Loop up Count Number of times this port saw Depends on the number of No
the loop come up or transition insertions and removals of disks
to up. and LIPs that occur in the loop.

Invalid CRC Count Number of times this port saw Is zero under normal operation. Yes, if
a CRC error. Removal and addition of disks, drive was
and a reset of the adapter, might bypassed.
generate some CRC errors. CRC
errors on a port pinpoint the
failure location. Excessive CRC
errors for a continuous time
period causes the ESH/ESH2
firmware to bypass this port.

Invalid Word Count Number of times this port saw Is zero under normal operation. Yes, if
invalid FC-AL words Removal and addition of disks, drive was
transmitted. and a reset of the adapter, might bypassed.
generate some word errors. Word
errors on a port pinpoint the
failure location. Excessive word
errors for a continuous time
period causes the ESH/ESH2
firmware to bypass this port.

Clock Delta The clock delta between this It is normal for the FC-AL sync Yes, if
port in respect to the clocks to drift with respect to each drive was
ESH/ESH2 clock and seven other. This is a signed drift value. bypassed.
other ports. A value exceeding 6,400 PPM
causes the ESH/ESH2 firmware to
bypass this port.

Insert Count Number of times this port was Depends on the number of No
inserted into the loop. insertions and removals of disks
and LIPs that occur in the loop.

Chapter 4: Monitoring the Disk Shelf 57

 Hub statistic Description Common values Failure?

Stall Count Number of times this port Is zero under normal operation. Yes, if
exceeded the open/close Removal and addition of disks, drive was
(OPN/CLS) maximum and a reset of the adapter, might bypassed.
threshold. generate some stall errors.
Excessive stall errors for a
continuous time period causes the
ESH/ESH2 firmware to bypass
this port.

Utilization % Relative use of this port versus This value does not reflect the No
other ports in the ESH/ESH2. real-time use of what the ports are
currently achieving and is only
obtained when extended status is
available from the ESH/ESH2. It
indicates the relative use from the
last time extended status was
available.

58 Monitoring the LRC, ESH, or ESH2 modules

Monitoring the power supply

LEDs on the power The power supply has four LEDs. The LEDs indicate whether the power supply
supply or the integrated fan module is functioning normally or there are problems with
the hardware. You can also identify any hardware failure associated with the
power supplies from the error messages displayed on your storage appliance
console.

Location of LEDs Each power supply, which contains two LEDs, is encased in a device carrier and
housed at the rear of the disk shelf. The following illustration shows the location
of the power supply LEDs.

Power
Fan LED
AC LED
PSU status normal

Note
The power LED is green. The other three LEDs are amber. See “LED status on
the LRC/ESH/ESH2” on page 51 for an illustrated explanation of how the LEDs
function.

Chapter 4: Monitoring the Disk Shelf 59

Power supply The following error messages appear on your storage appliance console if an SES
console error element on the power supply fails. For information about replacing the power
messages supply, see “Replacing a power supply in a disk shelf” on page 72.

Error message Action required

Power supply The power supply unit on the left at the back of the
Element 1: failed disk shelf failed. Contact Network Appliance
customer service to replace the power supply.
Power supply The power supply unit on the right at the back of the
Element 2: failed disk shelf failed. Contact Network Appliance
customer service to replace the power supply.
Cooling element The integrated fan module in the power supply unit
Element 1: failed on the left at the back of the disk shelf failed. Contact
Network Appliance customer service to replace the
power supply.
Cooling element The integrated fan module in the power supply unit
Element 2: failed on the right at the back of the disk shelf failed.
Contact Network Appliance customer service to
replace the power supply.

60 Monitoring the power supply

Monitoring the Fibre Channel disk

About monitoring The Fibre Channel disk has two LEDs. The LEDs indicate whether the disk is
the Fibre Channel functioning normally or there are problems with the hardware.
disk

Location of LEDs The following illustration shows the Fibre Channel disk, which has two LED
indicators on the front.

LED 2

LED 1

Chapter 4: Monitoring the Disk Shelf 61

LED status on the The following illustration is a correction of the third sheet of the quick reference
Fibre Channel disks cards that come with your disk shelf.

Note
As of Data ONTAP 6.4.2 and later, drives that are idle perform a media scan in
the background resulting in the LEDs pulsing every half second.

N N 20 21 22 23

N
20 Reinsert drive.
21 - SES device identification set - Find a physical drive identified by software.
22 - SES device fault bit set - Replace drive.
23 - Disk port is bypassed by ESH (either port A or B) - Check console messages

62 Monitoring the Fibre Channel disk

Replacing Disk Shelf Devices 5
About this chapter This chapter describes how to replace disk shelves in a rack, disks in a disk shelf,
and other devices.

Topics in this This chapter discusses the following topics:

chapter ◆ “Removing a disk shelf” on page 64
◆ “Replacing a disk in a disk shelf” on page 69
◆ “Replacing a power supply in a disk shelf” on page 72
◆ “Replacing an LRC/ESH/ESH2 module” on page 76

Chapter 5: Replacing Disk Shelf Devices 63

Removing a disk shelf

About this section This section discusses how to disconnect a disk shelf from a storage appliance
and how to remove a disk shelf from a daisy-chain configuration. It does not
discuss how to install a disk shelf or how to hot-add a disk shelf. For information
about installing a disk shelf in a rack, see “Installing a disk shelf in a rack” on
page 18. For information about hot-adding a disk-shelf, see Appendix A, “Hot-
adding a DS14/DS14mk2 FC to an existing loop,” on page 95.

Caution
Hot removal or hot-swapping of a disk shelf is not supported.

For detailed For detailed information about removing a disk shelf from a rack, see the
information following topics:
◆ “Removing a disk shelf from a single disk shelf configuration” on page 65
◆ “Removing a disk shelf from a loop” on page 67

64 Removing a disk shelf

Replacing a disk shelf in a rack
Removing a disk shelf from a single disk shelf configuration

Removing a disk To remove a disk shelf from a single disk shelf configuration, complete the
shelf following steps.

Step Action

1 Put on the antistatic wrist strap and grounding leash.

2 If the disk shelf connects to a... Then...

Filer/FAS appliance Shut down the filer/FAS

appliance by entering the
following command at the
console:
halt

Caution
Always use the halt command
to perform a clean shutdown.

NetCache appliance 1. From the Appliance

Manager home page, select
Maintenance tab > System
Control > Halt/Reboot.

2. Select Halt NetCache.

3 Verify that the LCD display at the front of your NetApp appliance
displays the following message:

Halted

4 If the disk shelf has... Then...

AC power supplies Turn off the power switch on the

disk shelf.

DC power supplies Turn off and unplug the cables

from the power source.

Chapter 5: Replacing Disk Shelf Devices 65

 Step Action

5 Disconnect the two disk shelf power cords from the disk shelf.

6 Disconnect the Fibre Channel cable connecting the disk shelf and
storage appliance.

7 Disconnect the grounding strap connecting the disk shelf and storage
appliance.

8 Use a Phillips screwdriver to remove the screws securing the disk

shelf to the telco tray, the mid-mount bracket, or the four-post rack.

9 With the help of another person, remove the disk shelf from the rack.

WARNING
The disk shelf is very heavy when fully loaded and requires at
least two people to remove it.

66 Removing a disk shelf

Replacing a disk shelf in a rack
Removing a disk shelf from a loop

Removing a daisy- To remove a disk shelf from a loop of disk shelves, complete the following steps.
chained disk shelf
Step Action

1 Put on the antistatic wrist strap and grounding leash.

2 If the disk shelf connects to a... Then...

Filer/FAS appliance Shut down the filer/FAS

appliance by entering the
following command at the
console:
halt

Caution
Always use the halt command
to perform a clean shutdown.

NetCache appliance 1. From the Appliance

Manager home page, select
Maintenance tab > System
Control > Halt/Reboot.

2. Select Halt NetCache.

3 Verify that the LCD display at the front of your NetApp appliance
displays the following message:

Halted

4 If the disk shelf has... Then...

AC power supplies Turn off the power switch on the

disk shelf.

DC power supplies Turn off and unplug the cables

from the power source.

Chapter 5: Replacing Disk Shelf Devices 67

 Step Action

5 Disconnect the two disk shelf power cords from the disk shelf that you
are going to remove.

6 Disconnect the Fibre Channel cables connecting the disk shelf to the
other disk shelves or the storage appliance.

7 Disconnect the grounding strap connecting the disk shelf to the other
disk shelves or the storage appliance.

8 Use a Phillips screwdriver to remove the screws from the flanges of

the disk shelf retention bracket.

9 With the help of another person, remove the disk shelf from the rack.

WARNING
Because the disk shelf is very heavy when fully loaded, it is
advised that at least two people remove the disk shelf.

10 If you are... Then...

Not installing a replacement disk 1. Reestablish the loop by

shelf connecting the disconnected
disk shelves or by
connecting the unconnected
disk shelf to the storage
appliance.

2. Set the terminate switch for

the LRC/ESH on Channel A
(down) and Channel B (up)
to the On position.

Note
ESH2 is self-terminating and
does not have a terminate
switch.

Installing replacement disk shelf See “Installing a disk shelf in a

rack” on page 18.

68 Removing a disk shelf

Replacing a disk in a disk shelf

Reasons to replace You can replace a disk in a disk shelf for any reason. However, the most common
a disk reason is disk failure. If a disk fails, the storage appliance logs a warning message
to the system console indicating which disk on which loop failed.

In addition, a disk shelf with an ESH/ESH2 module identifies any one of the
following situations as disk failure:
◆ A disk is bypassed.
◆ The filer system boots with the presence of bypassed disks.
◆ The filer system detects an eminent threshold bypass.

The following autosupport warning message is then sent:

DISK FAIL!! - Bypassed by ESH

Preparing to Before you replace a disk in a disk shelf, you must first check the disk shelf to
replace a disk ensure that after you remove the disk you still have enough disks installed to
meet the enclosure services requirements. For information about these
requirements, see “Drive bay requirements” on page 16.

About replacing a Replacing a disk in a disk shelf consists of the following procedures:
disk in a disk shelf ◆ “Removing a disk” on page 69
◆ “Installing a disk” on page 71

Removing a disk To remove a disk, complete the following steps.

Step Action

1 If the disk shelf connects to a... Then...

Filer/FAS appliance If you are removing disk that is a

member of a volume, enter:
disk fail disk_name

Chapter 5: Replacing Disk Shelf Devices 69

 Step Action

If you are removing disk that is a

spare disk, enter:
disk remove disk_name
Either command causes the amber
fault LED on the disk to
illuminate.
For more information about
LEDs, see “Monitoring the Fibre
Channel disk” on page 61.
For more information about disk
commands, see the Data ONTAP
System Administrator’s Guide.

NetCache appliance 1. In the Appliance Manager,

select Maintenance tab >
Disk > Management.

2. From the Disk Type column

of the Disk Status table,
identify the disk that you
want to remove.

3. Click Fail.

4. Click Swap Drive.

For more information about disk
management, see the NetCache
Appliance Administration Guide.

2 Put on the antistatic wrist strap and grounding leash.

3 To remove the disk, press down on its release mechanism with one
hand while grasping the top flange of the disk shelf with the other
hand.

70 Replacing a disk in a disk shelf

 Step Action

4 Gently slide the disk until it disengages. Wait 30 seconds for the disk
to stop spinning; then continue removing the disk from the chassis.

WARNING
When removing a disk, always use two hands to support its
weight.

Installing a disk To install a disk in a disk shelf, complete the following steps.

Step Action

1 Put on the antistatic wrist strap and grounding leash.

2 Orient the device carrier so that the release mechanism is at the top.

3 Insert the device carrier into the guide slot in the disk shelf and
firmly push it in until it engages the backplane and you see the
release mechanism click into place.

Note
If the device carrier does not fully seat in the drive bay, you may be
trying to install a DS14 device carrier into a DS14mk2 FC disk shelf.

Caution
Do not slam the device carrier into place.

4 Make sure that disks are installed in drive bays 0 and 1 for Enclosure
Services to work.

Chapter 5: Replacing Disk Shelf Devices 71

Replacing a power supply in a disk shelf

About this section Replacing a power supply in a disk shelf consists of the following procedures:
◆ “Removing a power supply” on page 72
◆ “Installing a power supply” on page 74

Rules for replacing When replacing the power supply on your disk shelf, observe the following rules:
power supplies ◆ You do not need to turn off the power when you replace one power supply.
◆ If you are replacing both power supplies in the same disk shelf, replace them
one at a time to avoid powering down the disk shelf.

Removing a power To remove a power supply, complete the following steps.

supply

Step Action

1 Put on the antistatic wrist strap and grounding leash.

2 If you have a disk shelf

with... Then...

An AC power supply 1. Turn off the switch on the power supply that you are
replacing.

2. Lift up the clip lock and unplug the power cord from the
storage appliance power supply.

A DC power supply 1. Turn off and unplug the cable to the power supply you are
replacing from the power source.

2. Using a #2 Phillips screwdriver, remove and save the

screws securing the connections to the power supply in the
following order:
❖ For positive ground installations: first negative (–),
then positive (+), then ground ( )
❖ For negative ground installations: first positive (+),
then negative (–), then ground ( )

72 Replacing a power supply in a disk shelf

 Step Action

3 If the CAM mechanism on

the power supply is... Then...

In the middle of the rear of the Using the thumb and index finger of both hands, press the
unit CAM mechanism levers in the middle of the power supply to
release it.

The following figure shows how to release the CAM mechanism.

At the top of the rear of the Using your thumb and index finger, press the CAM mechanism
unit levers toward each other to release the power supply handle.

The following figure shows how to press the levers on the CAM mechanism and release the
power supply handle.

OPEN OPEN

Chapter 5: Replacing Disk Shelf Devices 73

 Step Action

4 Use the handle to pull the power supply out of the disk shelf.

WARNING
When removing a power supply, always use two hands to support its weight.

Installing a power To install a power supply in a disk shelf, complete the following steps.
supply
Caution
Do not use excessive force when sliding the power supply into the disk shelf. You
can damage the connector.

Step Action

1 Put on the antistatic wrist strap and grounding leash.

2 If the power supply Then slide the power supply in the

CAM mechanism is... power supply bay...

In the middle of the rear And push the CAM mechanism levers
of the unit into place.

At the top of the rear of 1. Until you hear the power supply
the unit connect with the connector inside the
disk shelf chassis.

2. Raise the handle and push it into

place.

3. Using your thumb and index finger,

press the CAM mechanism levers
toward each other to engage the
power supply into place.

74 Replacing a power supply in a disk shelf

 Step Action

The following figure shows how to raise the handle into place.

3 If the disk shelf has... Then...

An AC power supply 1. Plug the power cord into the power

receptacle and fasten it with the
clamp.

2. Plug the other end of the power cord

into a grounded AC power source.

A DC power supply 1. Connect the positive, negative, and

ground wires to the power supply.

2. Plug the other end of each power

cord into a power source.

4 Turn on the power switch.

Chapter 5: Replacing Disk Shelf Devices 75

Replacing an LRC/ESH/ESH2 module

About the The LRC/ESH/ESH2 module in a DS14/DS14mk2 FC includes a SCSI-3

LRC/ESH/ESH2 Enclosure Services Processor. It maintains the integrity of the loop when disks
module are swapped and provides signal retiming for enhanced loop stability. There are
two modules in the middle of the rear of the disk shelf, one for Channel A and
one for Channel B.

Note
The Input and Output ports on module A on the DS14/DS14mk2 FC are inverted
from module B.

Connectors in an LRC/ESH/ESH2: The LRC/ESH/ESH2 module has the

following connectors.

Module connector Function

Input Provides the interface between the disk shelf and

the storage appliance.

Output Provides the interface between two disk shelves to

create a loop of daisy-chained disk shelves.

For detailed This section provides information about the following topics:
information ◆ “Removing a module” on page 77
◆ “Installing a module” on page 79
◆ “Hot-swapping a module” on page 80
◆ “Hot-upgrading or hot-downgrading a disk shelf” on page 84

76 Replacing an LRC/ESH/ESH2 module

Replacing an LRC/ESH/ESH2 module
Removing a module

Removing a module To remove a module that is connected to the Fibre Channel loop, complete the
following steps.

Step Action

1 Put on the antistatic wrist strap and grounding leash.

2 If the disk shelf connects to

a... Then...

Filer/FAS appliance Shut down the filer/FAS

appliance by entering the
following command at the
console:
halt

Caution
Always use the halt command
to perform a clean shutdown.

NetCache appliance 1. From the Appliance Manager

home page, select the
Maintenance tab > System
Control > Halt/Reboot.

2. Select Halt NetCache.

3 Verify that the LCD display at the front of your NetApp appliance
displays the following message:

Halted

Chapter 5: Replacing Disk Shelf Devices 77

 Step Action

4 If the disk shelf has... Then...

AC power supplies Turn off the power switch on the

storage appliance and disk
shelves.

DC power supplies Turn off and unplug the cables

from the power source.

5 Disconnect the module from the Fibre Channel cabling.

6 Using the thumb and index finger of both hands, press the levers on
the CAM mechanism on the module to release it.

7 Pull the module out of the disk shelf.

8 Go to “Installing a module” on page 79.

78 Replacing an LRC/ESH/ESH2 module

Replacing an LRC/ESH/ESH2 module
Installing a module

Installing an To install a module into the disk shelf, complete the following steps.
module
Caution
Observe the “Disk shelf cabling requirements” on page 27 and do not mix
LRC/ESH/ESH2 modules within a shelf.

Step Action

1 Verify that your NetApp appliance meets the minimum software

requirements to support the disk shelf and module combination. See
the System Configuration Guide at http://now.netapp.com for more
information.

2 Put on the antistatic wrist strap and grounding leash.

3 Push apart the levers on the CAM mechanism and slide the module
into the slot at the rear of the disk shelf, then push the levers of the
CAM mechanism into place.

Caution
Do not use excessive force when sliding the module into the disk
shelf; you might damage the connector.

4 Reconnect the Fibre Channel cabling.

5 Turn on the power to the disk shelves.

6 Reboot the storage appliance.

Chapter 5: Replacing Disk Shelf Devices 79

Replacing an LRC/ESH/ESH2 module
Hot-swapping a module

Assumptions about The assumptions about this procedure are that LRC/ESH/ESH2 modules on the
this procedure disk shelf are multipath connections to the storage appliance and that you are hot-
swapping an LRC with another LRC, an ESH with another ESH, an ESH2 with
another ESH2, or that you are hot-swapping an ESH with an ESH2.

Note
A hot-swap of an ESH with an ESH2 requires that you upgrade to Data ONTAP
6.4.4 or later and replace both ESH modules in the disk shelf. A hot-swap of an
ESH with an ESH2 is not supported with NetCache appliances.

If you are hot-upgrading or hot-downgrading these devices, see “Hot-upgrading

or hot-downgrading a disk shelf” on page 84.

Caution
If you attempt to hot-swap the LRC/ESH/ESH2 on a disk shelf that does not have
multipath connections, you lose all access to the drives on this disk shelf as well
as those below it.

Hot-swapping a To hot-swap a module, complete the following steps.

module
Note
To hot-swap a module on a disk shelf in a cluster, see the cluster guide for your
filer.

Step Action

1 Verify that your NetApp appliance meets the minimum software

requirements to support the disk shelf and module combination. See
the System Configuration Guide at http://now.netapp.com for more
information.

2 Put on the antistatic wrist strap and grounding leash.

80 Replacing an LRC/ESH/ESH2 module

 Step Action

3 From the console of the storage appliance, enter the following

command to disable the loop in which the failed module is a
connection:
storage disable adapter adaptername
The Data ONTAP System Administrator’s Guide (6.1 or later)
provides more information about these commands.

4 If you are hot-swapping... Then...

An LRC or ESH with like Note the position of the

modules terminate switch on the
LRC/ESH you are removing and
set the terminate switch on the
replacement LRC/ESH to the
same setting before inserting it
into the disk shelf.

An ESH with an ESH2 for a disk

shelf that is:

◆ Either the first shelf in the 1. Place the terminate switch

loop or a shelf in the middle on all but the last disk shelf
of the loop where all other in the loop to the Off
disk shelves have ESHs position.
For ESH A it is in the up
position and for ESH B it is
in the down position.

2. Place the terminate switch

on the last disk shelf in the
loop to the On position.
For ESH A it is in the down
position and for ESH B it is
in the up position.

Note
ESH2 is self-terminating and
does not have a terminate switch.

Chapter 5: Replacing Disk Shelf Devices 81

 Step Action

◆ Last shelf in the loop where On all the disk shelves in the
all other disk shelves have loop, place the terminate switch
ESHs to the Off position.
For ESH A it is in the down
position and for ESH B it is in
the up position.

An ESH2 with an ESH2 Go to Step 5.

5 If you are hot-swapping... Then...

An LRC/ESH/ESH2 with like Disconnect the module that you

modules are removing from the Fibre
Channel cabling.

An ESH with an ESH2 Disconnect the ESH from the

Fibre Channel cabling and
remove the cabling.

6 Using the thumb and index finger of both hands, press the levers on
the CAM mechanism on the module to release it and pull it out of the
disk shelf.

7 Slide the replacement module into the slot at the rear of the disk shelf
and push the levers of the CAM mechanism into place.

Caution
Do not use excessive force when sliding the LRC/ESH/ESH2 into the
disk shelf; you might damage the connector.

8 If you are hot-swapping... Then...

An LRC/ESH/ESH2 with like Reconnect the Fibre Channel

modules cabling.

An ESH with an ESH2:

◆ If it is the first shelf in the 1. Plug the optical SFP into the
loop where all other disk input port on ESH2.
shelves have ESHs

82 Replacing an LRC/ESH/ESH2 module

 Step Action

2. Reconnect the Fibre

Channel cabling by using
LC-to-LC cables when
connecting to optical FC-AL
adapters.

3. Use HSSDC2-to-SFP cables

for connections between the
disk shelf with ESH2 and
the disk shelf with ESH.

◆ If it is the last shelf in the Use HSSDC2-to-SFP cables for

loop where all other disk connections between a disk shelf
shelves have ESHs with ESH and a disk shelf with
◆ If it is a shelf in the middle ESH2.
of the loop where all other
disk shelves have ESHs Note
Each ESH2 ships with one SFP-
to-SFP cable and one HSSDC2-
to-SFP cable. If the replacements
are in the middle of the loop, you
require two additional HSSDC2-
to-SFP cables.

9 From the console of the filer, enter the following command to enable
the loop in which the replacement LRC/ESH/ESH2 is a connection:
storage enable adapter adaptername

10 Repeat Step 3 through Step 9 for Loop B.

Chapter 5: Replacing Disk Shelf Devices 83

Replacing an LRC/ESH/ESH2
Hot-upgrading or hot-downgrading a disk shelf

When you can hot- You can hot-upgrade a disk shelf with an LRC into a disk shelf with an
upgrade or hot- ESH/ESH2 or hot-downgrade the disk shelf with an ESH/ESH2 into a disk shelf
downgrade with an LRC, if your system incorporates redundancy through multipathing.

Caution
You must hot-upgrade or hot-downgrade all disk shelves in the loop.

Requirements for To hot-upgrade or hot-downgrade a disk shelf, the following requirements must
hot-upgrading or be met.
hot-downgrading
Disk shelf loop speed Hot-upgrade Hot-downgrade

DS14 (only available at ◆ LRC to ESH/ESH2 ◆ ESH/ESH2 to LRC

1-Gb loop speed) hot-upgrade is hot-downgrade is
supported. supported.

DS14mk2 FC set at ◆ LRC to ESH/ESH2 ◆ ESH/ESH2 to LRC

1-Gb loop speed hot-upgrade is hot-downgrade is
supported. supported.

DS14mk2 FC set at ◆ Upgrades from ◆ ESH/ESH2 to LRC

2-Gb loop speed LRC are not hot-downgrade is
applicable. not supported.
◆ ESH to ESH2 is ◆ ESH2 to ESH hot-
supported. See downgrade is
“Hot-swapping a supported.
module” on
page 80.

84 Replacing an LRC/ESH/ESH2 module

Hot-upgrading or To hot-upgrade or hot-downgrade a disk shelf, complete the following steps.
hot-downgrading a
disk shelf Note
To hot-upgrade or hot-downgrade a disk shelf in a cluster, see the cluster guide
for your storage appliance.

Step Action

1 Verify that your NetApp appliance meets the minimum software

requirements to support the disk shelf and module combination. See
the System Configuration Guide at http://now.netapp.com for more
information.

2 Put on the antistatic wrist strap and grounding leash.

3 From the console of the storage appliance, enter the following

command to disable all the LRC/ESH/ESH2 modules in Loop A:
storage disable adapter adaptername

4 If you are... Then...

Hot-upgrading the disk shelf Note the position of the

terminate switch on the LRC you
are removing and set the
terminate switch on the ESH to
the same setting before inserting
it into the disk shelf.

Note
ESH2 is self-terminating and
does not have a terminate switch.

Hot-downgrading the disk shelf

◆ From an ESH to an LRC Note the position of the

terminate switch on the ESH you
are removing and set the
terminate switch on the LRC to
the same setting before inserting
it into the disk shelf.

Chapter 5: Replacing Disk Shelf Devices 85

 Step Action

◆ From an ESH2 to an 1. Place the terminate switch

ESH/LRC on all but the last disk shelf
in the loop to the Off
position.
For ESH A it is in the up
position and for ESH B it is
in the down position.

2. Place the terminate switch

on the last disk shelf in the
loop to the On position.
For ESH A it is in the down
position and for ESH B it is
in the up position.

5 Disconnect the LRC/ESH/ESH2 from the Fibre Channel cabling and

remove the cabling.

6 Using the thumb and index finger of both hands, press the levers on
the CAM mechanism on the LRC/ESH/ESH2 to release it and pull it
out of the disk shelf.

7 Slide the module into the slot at the rear of the disk shelf and push the
levers of the CAM mechanism into place.

Caution
Do not use excessive force when sliding the module into the disk
shelf; you might damage the connector.

8 If you are... Then...

Hot-upgrading a disk shelf

◆ From an LRC to an ESH Reconnect the Fibre Channel

cabling by using LC-to-LC
cables when connecting to
optical FC-AL adapters, and
with HSSDC2-to-HSSDC2
cables for connections between
shelves.

86 Replacing an LRC/ESH/ESH2 module

 Step Action

◆ From an LRC to an ESH2 Reconnect the Fibre Channel

cabling by plugging an optical
SFP into the ESH2 Input port,
using an LC-to-LC cable when
connecting to optical FC-AL
adapters, and using SFP-to-SFP
cables for connections between
shelves.

Hot-downgrading a disk shelf

◆ From an ESH2/ESH to an Reconnect the Fibre Channel

LRC cabling by using HSSDC to DB-
9 cables when connecting to
copper FC-AL adapters or SC-
to-LC cables when connecting to
optical FC-AL adapters, and
using DB-9 to DB-9 cables for
connections between shelves.

◆ From an ESH2 to an ESH Reconnect the Fibre Channel

cabling by using LC-to-LC
cables when connecting to
optical FC-AL adapters, and
using HSSDC2-to-HSSDC2
cables for connections between
shelves.

9 Repeat Step 3 through Step 8 for the remaining LRC/ESH/ESH2

modules in the loop.

Chapter 5: Replacing Disk Shelf Devices 87

 Step Action

10 From the console of the storage appliance, enter the following

command to verify that the LRC/ESH/ESH2 modules in Loop A
report good status:
environ shelf
As long as only the modules in loop A are upgraded, you also receive
the following error message:

Element 1: component is from a different product family.

This is an unsupported configuration.

11 From the console of the filer, enter the following command to enable
the Loop A:
storage enable adapter adaptername

12 Repeat Step 3 through Step 11 for Loop B.

88 Replacing an LRC/ESH/ESH2 module

Adding a Disk Shelf to an Existing System A
About this appendix This appendix discusses how to install a DS14/DS14mk2 FC into an existing
system.

Topics in this This appendix discusses the following topics:

appendix ◆ “Installing a disk shelf in an existing mixed-shelf loop” on page 90
◆ “Hot-adding a DS14/DS14mk2 FC to an existing loop” on page 95

Appendix A: Adding a Disk Shelf to an Existing System 89

Installing a disk shelf in an existing mixed-shelf loop

Assumptions about This section is based on the assumption that the last disk shelf in the existing
the existing mixed- mixed shelf loop connected to your storage appliance is not a DS14/DS14mk2
shelf loop FC disk shelf.

Note
If the last disk shelf in your storage appliance system is a DS14/DS14mk2 FC,
you can add the disk shelf to the loop without shutting down the system. Go to
“Hot-adding a DS14/DS14mk2 FC to an existing loop” on page 95.

Caution
Do not attempt to add a DS14/DS14mk2 FC that has ESH/ESH2 modules to a
mixed shelf loop.

Installing the disk To install a DS14/DS14mk2 FC disk shelf into an existing mixed-shelf loop on a
shelf storage appliance, complete the following steps.

Caution
If you are installing the DS14/DS14mk2 FC into a loop that contains FC7, FC8,
or FC9 disk shelves, the DS14/DS14mk2 FC must be the last disk shelf in the
loop and must have the highest disk shelf ID in the loop to avoid address
conflicts.

Step Action

1 Put on the antistatic wrist strap and grounding leash.

2 If the disk shelf connects to a... Then...

Filer/FAS appliance Shut down the filer/FAS appliance

by entering the following
command at the console:
halt

Caution
Always use the halt command to
perform a clean shutdown.

90 Installing a disk shelf in an existing mixed-shelf loop

 Step Action

NetCache appliance 1. From the Appliance Manager

home page, select
Maintenance tab > System
Control > Halt/Reboot.

2. Select Halt NetCache.

3 Verify that the LCD display at the front of your NetApp appliance
displays the following message:

Halted

4 Turn off the power to your storage appliance and the disk shelves.

5 Install the disk shelf.

Follow Step 2 through Step 8 of “Installing a disk shelf” on page 18.

6 Ground the disk shelf using the provided grounding cable.

Follow Step 4 and Step 5 of “Grounding connected disk shelves” on
page 40.

7 Connect the disk shelf to a power source.

Follow Step 2 of “Connecting the disk shelf to power” on page 42.

8 If the last disk shelf in the loop

is... Then...

An FC7 or FC8 disk shelf 1. Remove the terminator from

the Output/Terminator
connector.

2. Go to Step 9.

An FC9 disk shelf Go to Step 9.

9 Connect one end of the provided cable to the Output/Terminator

connector of the LRC A on the last disk shelf in the loop.

Appendix A: Adding a Disk Shelf to an Existing System 91

 Step Action

10 Connect the other end of the cable to the LRC A Input on the disk
shelf that you are adding.

The following illustration shows a DS14 disk shelf installed above an

FC9 disk shelf.

Output Input

Terminate switch on

1
DS14 disk shelf
DISCONNECT
2 POWER CORDS
BEFORE
SERVICING

Mute Temp o
FC9 disk shelf

—
PSU 2 PSU 1
Input Output

—A— —B—
SHELF ID

0
FAN 1 FAN 2 FAN 3

11 If the DS14/DS14mk2 FC... Then...

Is the only disk shelf being 1. Connect one end of the

added to the loop provided cable to the LRC B
Input on the disk shelf.

2. Connect the other end of the

cable to the LRC B Output on
the disk shelf.

3. Turn the terminate switches

on LRCs A and B to the On
position.

LRC A active
terminate position

92 Installing a disk shelf in an existing mixed-shelf loop

 Step Action

Note
Because LRC B on the disk shelf
is inverted, the On terminate
position on LRC B is up instead of
down.

Is the first of additional 1. Turn the terminate switch on

DS14/DS14mk2 FC disk the first disk shelf in the
shelves being added to the loop mixed-shelf loop to the Off
position for LRC A (up) and
LRC B (down).

2. Connect one end of the

provided cable to the LRC B
Output on the first disk shelf
in the mixed-shelf loop.

3. Connect the other end of the

cable to the LRC B Input on
the next disk shelf that you
added to the mixed-shelf loop.

4. Verify that the terminate

switch on all but the last disk
shelf is in the Off position for
LRC A (up) and LRC B
(down). The terminate switch
on the last disk shelf should be
in the On position for LRC A
(down) and LRC B (up).

12 Give the disk shelf a unique disk shelf ID. See Step 6 of “Installing a
disk shelf” on page 18 for specific instructions.

Note
A valid shelf ID is between 1 through 7. Only use disk shelf ID 7 if it
is the last ID available on this loop. A shelf ID that is not from 1
through 7 causes the drive addresses to default to those of a shelf with
the ID switch set to 7, even though the Shelf ID indicator in the front
operation panel displays a dash (-).

Appendix A: Adding a Disk Shelf to an Existing System 93

 Step Action

13 If your disk shelf is a... Then

DS14 Go to Step 14.

DS14mk2 FC with an LRC Set the loop speed switch to 1 Gb.

module
Caution
An incorrectly set loop speed
results in an open loop condition.

14 Turn on the power first to the disk shelves and then to the storage
appliance.

15 Reboot the storage appliance.

94 Installing a disk shelf in an existing mixed-shelf loop

Hot-adding a DS14/DS14mk2 FC to an existing loop

About this section This section provides information about how to hot-add a DS14/DS14mk2 FC to
an existing loop. It also tabulates the error messages that appear on your storage
appliance console if the attempt at hot-adding was unsuccessful.

Note
The hot-added disk shelf must have new drives that will be used as spares only.

Requirements for To hot-add a DS14/DS14mk2 FC to an existing loop, the following requirements

hot-adding must be met.

If the disk shelf

being hot-
added... Then...

Has LRC ◆ The disk shelves in the existing loop must have a
modules DS14/DS14mk2 FC disk shelf with LRCs as the last
shelf.
◆ You must follow the procedure “Hot-adding a disk
shelf to an existing loop” on page 96 exactly, if you
are hot-adding to a mixed shelf loop.

Caution
Failure to follow the procedure exactly causes the last
FC9 in the loop to automatically terminate the loop.
The storage appliance loses contact with the existing
last DS14/DS14mk2 FC in the loop and crashes.

Has ESH/ESH2 The disk shelves in the existing loop must have only
modules DS14/DS14mk2 FC disk shelves with ESH/ESH2
modules in the loop.

Appendix A: Adding a Disk Shelf to an Existing System 95

Hot-adding a disk To hot-add a disk shelf to an existing loop, complete the following steps.
shelf to an existing
loop Caution
To hot-add disk shelves to a cluster, see the cluster guide for your filer.

Step Action

1 Put on the antistatic wrist strap and grounding leash.

2 Install the disk shelf.

Follow Step 2 through Step 8 of “Installing a disk shelf” on page 18.

3 Ground the disk shelf using the provided grounding cable.

Follow Step 4 and Step 5 of “Grounding connected disk shelves” on
page 40.

4 Connect the disk shelf to a power source by following Step 2 of

“Connecting the disk shelf to power” on page 42.

Caution
Do not turn on the power to the disk shelf yet.

5 Give the disk shelf a unique disk shelf ID. See Step 6 of “Installing a
disk shelf” on page 18 for specific instructions.

Note
Only use disk shelf ID 7 if it is the last ID available.

6 Verify that the disk shelf ID is not being used in the loop by entering
the following command at the console:
fcstat device_map adaptername

Caution
An invalid disk shelf ID causes the storage appliance to panic.

96 Hot-adding a DS14/DS14mk2 FC to an existing loop

 Step Action

7 If disk shelves in the loop

have... Then, for loops with...

LRC modules ◆ DS14 only: Go to Step 8.

◆ A mix of DS14 and DS14mk2 FC:
Set the loop speed to 1 Gb.

Caution
An incorrectly set loop speed results in
an open loop condition.

ESH/ESH2 modules ◆ DS14 only or a mix of DS14 and

DS14mk2 FC: Set the loop speed
to 1 Gb.
◆ DS14mk2 FC only that are
running at 1 Gb: Set the loop speed
to 1 Gb.
◆ DS14mk2 FC only that are
running at 2 Gb: Set the loop speed
to 2 Gb.

Caution
An incorrectly set loop speed causes
the storage appliance to panic.

8 If the disk shelf you

added has... Then...

ESH2 modules Turn on the power to the disk shelf and

you must wait 30 seconds for the shelf
electronics to finish initializing.

Appendix A: Adding a Disk Shelf to an Existing System 97

 Step Action

LRC or ESH modules Turn on the power to the disk shelf.

Caution
You must power up the new disk shelf
before you connect it to the last disk
shelf in the loop because there must be
approximately a 120-second time
difference between Step 8 (powering
on the disk shelf) and Step 14 (turning
off the terminate switch) of this
procedure.

9 Connect one end of the provided cable to the LRC/ESH/ESH2 A

Output on the last disk shelf in the existing loop.

10 Connect the other end of the cable to the LRC/ESH/ESH2 A Input on

the new disk shelf.

11 Connect one end of the provided cable to the LRC/ESH/ESH2 B

Output on the last disk shelf in the existing loop.

12 Connect the other end of the cable to the LRC/ESH/ESH2 B Input on

the new disk shelf.

13 Verify that all the cables are securely fastened.

Caution
Poorly secured cables cause the storage appliance to panic over an
open loop.

14 If the disk shelf you

added has... Then...

ESH2 modules Result: In 60 seconds, the storage

appliance recognizes the hot-added
disk shelf.

98 Hot-adding a DS14/DS14mk2 FC to an existing loop

 Step Action

LRC or ESH modules 1. Turn the terminate switch of the

newly added disk shelf to the On
position for LRC/ESH A (down)
and LRC/ESH B (up).

Caution
Failure to place the terminate
switches in the On position causes
the storage appliance to panic over
an open loop.

2. Turn the terminate switch of the

now second-to-last disk shelf to
the Off position for LRC/ESH A
(up) and LRC/ESH B (down).

Result: In 60 seconds, the storage

appliance recognizes the hot-added
disk shelf.

Error messages The following error messages appear on your storage appliance console if your
attempt at hot-adding the DS14/DS14mk2 FC is unsuccessful.

Error message Explanation

Open loop panic One of three reasons cause this error message to
appear:
◆ The terminate switch on LRC/ESH A and
LRC/ESH B on the new disk shelf are not in the
On position.
◆ The shelf-to-shelf cable between the now second-
to-last disk shelf and the newly added disk shelf is
defective or is not securely fastened.
◆ The speed of the newly added DS14mk2 FC disk
shelf is incorrectly set.

Appendix A: Adding a Disk Shelf to an Existing System 99

 Error message Explanation

Soft address One of two reasons cause this error message to appear:
panic
◆ There is an invalid disk shelf ID.
◆ The power was turned on before the disk shelf ID
was changed and the disk shelf was not power-
cycled after the disk shelf ID was changed.
Speed mismatch The ESH modules on the disk shelf detected a speed
termination mismatch between the preceding disk shelf and this
disk shelf and is reporting them as automatic terminate
errors.

100 Hot-adding a DS14/DS14mk2 FC to an existing loop

Recommended Power Line Sizes B
About this appendix This appendix describes how to determine the power line lengths running from
the storage appliance to the power source.

Topics in this This appendix discusses the following information:

appendix ◆ “Recommended AC power line sizes” on page 102
◆ “Calculating the length of DC wires” on page 103

Appendix B: Recommended Power Line Sizes 101

Recommended AC power line sizes

About AC power Longer AC power feeds need to be properly designed to preserve voltage levels
feeds to the equipment. The wiring from the breaker panel to the power strip, which
supplies power to the storage appliance and disk shelves, can often exceed 50
feet.

Note
Total AC wire length = breaker to wall or ceiling outlet + extension cable or
ceiling drop.

The following table lists the recommended conductor size for 2% voltage drop
for a particular distance in feet (taken from the Radio Engineer’s Handbook).

20A 30A 40A 50A

110V, single-phase circuit circuit circuit circuit

25 feet 12 AWG 10 AWG 8 AWG 8 AWG

50 feet 8 AWG 6 AWG 6 AWG 4 AWG

75 feet 6 AWG 4 AWG 4 AWG 2 AWG

20A 30A 40A 50A

220V, single-phase circuit circuit circuit circuit

25 feet 14 AWG 12 AWG 12 AWG 10 AWG

50 feet 12 AWG 10 AWG 8 AWG 8 AWG

75 feet 10 AWG 8 AWG 6 AWG 6 AWG

The following table list the approximate equivalent wire gauge (American Wire
Gauge (AWG) to Harmonized Cordage).

AWG 8 10 12

Harmonized, mm-mm1 4.0 2.5 1.5

1. mm-mm = millimeter squared

102 Recommended AC power line sizes

Calculating the length of DC wires

Use these variable To calculate the maximum combined length of the positive and negative wires
definitions between the DC source and DC power supplies, use the following variable
definitions:

◆ VSOURCE Voltage across the internal source

resistance

◆ VOC Voltage across an open circuit of the

input source

◆ VLOAD Voltage across a load, RTEST,

connected to the input source

◆ RTEST Test resistor of known value, that is,

10Ω at 300W

◆ RCABLE DC resistance of the cable at a given

length

◆ RSOURCE DC resistance of the source

◆ RTOTAL Combined DC resistance of the cable

and DC source:

RTOTAL = RSOURCE + RCABLE

◆ V = IR Ohm’s Law

◆ VOC = VSOURCE + VLOAD Kirchoff’s Voltage Law

How to calculate the The following two examples show how to calculate the maximum combined
length length of the positive and negative wires that connect the DC power supply to the
DC source.

Example 1: This example uses the following given values.

Appendix B: Recommended Power Line Sizes 103

 Given
VDROP = 2V Maximum voltage drop through input source and cable
VMIN = 40V Minimum input voltage
IMAX = 8.6V Maximum input current at 40V
VOC = 48V Measured
VLOAD = 47.5V Measured
RTEST = 10Ω (300W)

104 Calculating the length of DC wires

 Solution

VDROP = IMAXRTOTAL

2 = 8.6 RTOTAL

RTOTAL = 2/8.6

RTOTAL = .233Ω

VLOAD = I RTEST

I = VLOAD/RTEST

VOC = VSOURCE + VLOAD

VOC = IRS + VLOAD

RS = VOC - VLOAD
I
RS = (VOC - VLOAD)
VLOAD/RTEST

RS = VOC - VLOAD x RTEST

VLOAD
x 10Ω
= 48V - 47.5V
47.5V

= 0.105Ω

RTOTAL = RCABLE + RSOURCE

RCABLE = RTOTAL - RSOURCE

RCABLE = 0.233Ω - 0.105Ω

= 0.128Ω

For example, if you have a 12 gauge wire, solid strand, at room temperature, use
the following calculation.

Appendix B: Recommended Power Line Sizes 105

 RCABLE
Total cable length =
DC resis.1

.128Ω
Total cable length = = 75 ft
.0017Ω/ft

DC resistance1 [Ω/ft.] Total cable length2 [ft]

AWG Strand 25° C 75° C 25° C 75° C

12 Solid .0017 .0020 75 64

12 7/20 .0015 .0018 85 71

12 19/25 .0017 .0020 75 64

12 65/30 .0018 .0022 71 58

12 165/34 .0016 .0019 80 67

1. Data from Alpha Wire, wire manufacturer

2. Combined positive and negative run

Example 2: This example uses the following given values.

Given

VDROP = 2V Maximum voltage drop through input source

and cable

VMIN = 40V Minimum input voltage

IMAX = 8.6V Maximum input current at 40V

RSOURCE ≅ 0

106 Calculating the length of DC wires

 Solution

VDROP = IMAXRTOTAL

RTOTAL = VDROP
IMAX

RTOTAL = 2/8.6

RTOTAL = 0.233Ω

RTOTAL = RSOURCE + RCABLE

RCABLE = RTOTAL - RSOURCE

RCABLE = 0.233 - 0

RCABLE = 0.233

For example, if you have a solid strand 12 gauge wire at room temperature, use
the following calculation.

RCABLE
Total cable length =
DC resis.1

.233Ω
Total cable length = = 136 ft
.0017Ω/ft

DC resistance1 [Ω/ft.] Total cable length2 [ft]

AWG Strand 25° C 75° C 25° C 75° C

12 Solid .0017 .0020 136 116

12 7/20 .0015 .0018 155 129

12 19/25 .0017 .0020 136 116

12 65/30 .0018 .0022 129 105

12 165/34 .0016 .0019 145 122

Appendix B: Recommended Power Line Sizes 107

 1. Data from Alpha Wire, wire manufacturer.
2. Combined positive and negative run

About using other If you need a longer run for your combined positive and negative DC wires,
wire sizes choose a wire with a lower resistance and calculate the total cable length. For
example, a solid #10 AWG has a lower DC resistance than a solid #12 AWG.

108 Calculating the length of DC wires

Feature Update Record C
Feature update The following table lists and describes the history of changes made to this
history manual. When a change is implemented, it applies to the release in which it was
implemented and all subsequent releases, unless otherwise specified.

Feature updates Feature first implemented in Feature release date

◆ Initial release of this manual Data ONTAP 6.0.2 March 2001

◆ Update to include support for NetCache NetCache 5.1 April 2001

appliances
◆ Hot-adding of disk shelves to NetCache
appliances is not supported

◆ Updates to multiloop cabling section Data ONTAP 6.1.1 July 2001

◆ Update to include hot-adding of disk NetCache 5.2 August 2001

shelves to NetCache appliances

◆ Update to include FAS900 series Data ONTAP 6.3 August 2002

◆ Update to include DS14mk2FC Data ONTAP 6.4.1 May 2003

◆ Update to include ESH Data ONTAP 6.2

◆ Update to specify ESH support for C6200 NetCache 5.5 December 2003
◆ Address BURT on hot-adding disk shelves Data ONTAP 6.5

◆ Update to include ESH2 Data ONTAP 6.4.4 and 6.5.1 May 2004
◆ Connecting an ESH2 to a NetCache
appliance is not supported.

Appendix C: Feature Update Record 109

110 Feature Update Record
Communications Regulations D
About this appendix This appendix lists the regulatory notices you need to be aware of when installing
and operating your Network Appliance equipment.

Appendix D: Communications Regulations 111

Regulatory notices

FCC notices Network Appliance devices are designed for a CFR 47 (Code Federal
(U.S. only) Regulations) Part 15 Class A environment.

The FCC and Network Appliance guarantee the user’s rights to operate this
equipment only if the user complies with the following rules and regulations:
◆ Install and operate this equipment in accordance with the specifications and
instructions in this guide.
◆ Modify this equipment only in the ways specified by Network Appliance.
◆ Use shielded cables with metallic RFI/EMI connector hoods to maintain
compliance with applicable emissions standards.
◆ If the system has nine or more Fibre Channel disk shelves, install the system
in two or three NetApp System Cabinets to maintain performance within
Part 15 of CFR 47 regulations.

Compliance with This equipment has been tested and found compliant with Part 15 of the CFR 47
Part 15 of CFR 47 rules for Class A digital devices. These rules are designed to provide reasonable
protection from interference to electronics equipment operated in a commercial
environment.

Operation of this device is subject to the following two conditions:

◆ This device cannot cause harmful interference.
◆ This device must accept any interference received, including interference
that may cause undesired operation.

Compliance with This Class A digital apparatus complies with Canadian ICES-003.
ICES-003
Cet appareil numérique de la classe A conforme à la norme NMB-003 du
Canada.

Compliance with EN Marking by the symbol indicates compliance of this Network Appliance
regulations device to the EMC Directive and the Low Voltage Directive of the European
Union. Such marking is indicative that this Network Appliance device meets the
technical standards listed in “Declaration of Conformity,” later in this appendix.

112 Regulatory notices

 Caution
This is a Class A product. In a domestic environment this product may cause
radio interference, in which case the user may be required to take adequate
measures.

Bureau of
Standards,
Metrology, and
Inspections notice
(BSMI, Taiwan only)

Translation of the BSMI notice:

Warning: This is a Class A product. In a domestic environment this product may

cause radio interference, in which case the user may be required to take adequate
measures.

Voluntary Control
Council for
Interference by
Information
Technology
Equipment (VCCI,
Japan)
Translation of the VCCI-A notice:

This is a Class A product based on the standard of the Voluntary Control Council
for Interference by Information Technology Equipment (VCCI). If this
equipment is used in a domestic environment, radio disturbance may arise. If
such trouble occurs, the user may be required to take corrective actions.

Appendix D: Communications Regulations 113

Declaration of Conformity

Declaration of Conformity

Network Appliance, Inc.

495 East Java Drive
Sunnyvale, CA 94089, U.S.A,
declare under our sole responsibility that the products

Type of equipment Description Model number Year of manufacture

Disk drive storage shelf Fibre Channel disk shelf DS14 2001

DS14mk2 FC 2003

to which this declaration relates conform to the following standards:

EN 60950:2002, Information Technology Equipment (Safety)
EN 55022:1998, Emissions Requirements for Information Technology Equipment
EN 50024:1998, Immunity Requirements for Information Technology Equipment
EN 60825-1, Safety of Laser/LED Equipment
EN 61000-3-2:2002 Limits for Harmonic Current Emissions
EN 61000-3-3:1995/A1:2001 Limitation of Voltage Fluctuations and Flicker in Low-Voltage Supply
Systems

following the provisions of the directives listed below:

73/23/EEC, Low Voltage Directive (Product Safety)

89/336/EEC, Electromagnetic Compatibility Directive

Part number: 210-02616

114 Declaration of Conformity

Index

A power supply element 1 and 2 60

SES electronics element 1 and 2 52, 53
AC power line sizes 102
Soft address panic 100
AC power supplies
Speed mismatch termination 100
connecting disk shelf to 42
Temperature sensor element 1, 2, and 3 47, 51,
antistatic wrist strap 7
52, 53
audience vii
Vendor-specific element 1 and 2 53
conventions
C command viii
cabling formatting viii
multiloop, with multipath 38 keyboard viii
multiloop, without multipath 35
multipath, without multiloop 37 D
command
DC power supplies
environ shelf 88
connecting disk shelf to 42
fcstat device_map 96
DC wires, calculating the length of 103
halt 65, 67, 77, 90
device carrier, defined vii
storage disable 81
differences between the disk shelves
storage disable adapter 85
drives in drive carriers 2
storage enable 83
ESH 2, 27
storage enable adapter 88
ESH2 3, 27
storage show hub 53
LRC 2, 27
conditions
power consumption 6
operating 5
power requirements 6
storage 5
power supplies 2
connecting to a power source 42
shelf chassis 2
connections of
disk drive compatibility 16
a second or third loop 35
disk shelf dimensions 4
disk shelf to AC power 42
disk shelf ID 14
disk shelf to DC power 43
disk shelf weight 4
disk shelf to power source 42
disk shelves vii
disk shelves to a storage appliance 26
connecting a single disk shelf 28
grounded disk shelves to a storage appliance
connecting multiple disk shelves 33
40
connecting to a storage appliance 26
console error messages
installing 18
Alarm element 1 48
removing from a single configuration 65
cooling element, element 1 and 2 60
replacing 64
Display element 1 48
disks
front operation panel 47
location of LEDs 61
LRC/ESH/ESH2 51
reasons to replace 69
Open loop panic 99
replacing 69
power supply 60

Index 115
drive bay requirements 16 Soft address panic 100
DS14 and DS14mk2 FC, differences 2 hot-adding to an existing loop 95
hot-swap of LRC/ESH/ESH2 modules 80
hot-upgrade or hot-downgrade of LRC/ESH/ESH2
E modules 84
electrical requirements 5 humidity, environmental requirements 5
element 51
empty drive shuttles, for empty drive bays 10
Enclosure Services, drive bays required for 16 I
environmental requirements 4 IDs, disk shelf 14
ESH module, defined vii installation
ESH/ESH2 error messages before you begin 14
SES electronics element 1 and 2 52, 53 disk shelves 18
Temperature sensor element 2 and 3 52, 53 LRC/ESH/ESH2 modules 79
Vendor-specific element 1 and 2 53 power supply 74
ESH/ESH2 state messages preparing for 8
MISSING 55 site requirements for 1
OK 55 tools 7
XPORT ERROR 55
ESH/ESH2, command to monitor 53
ESH2 module, defined vii L
labels
drive bay population 14
F on the disk shelf 17
Fibre Channel Arbitrated Loop (FC-AL) labels on the disk shelf 18
adapter 28, 35 LED interpretation
front operation panel front operation panel 53
Alarm element 1 48 LRC/ESH/ESH2 module 51
console error messages 47 power supplies 51
Display element 1 48 LED locations
interpreting LEDs 53 disks 61
location of LEDs 46 front operation panel 46
monitoring the disk shelf ID 46 power supply 59
Temperature sensor element 1 47 loops, defined vii
LRC error messages
SES electronics element 1 and 2 52
G Temperature sensor element 2 and 3 51, 52
ground, connecting disk shelves to a storage LRC module, defined vii
appliance 40 LRC/ESH/ESH2
grounding to a storage appliance 41 console error messages 51
LRC/ESH/ESH2 module
hot-swapping 80
H hot-upgrading or hot-downgrading 84
HA disk shelf, defined vii installing 79
hot-adding error message interpreting LEDs 51
Open loop panic 99 removing 77

116 Index
 replacing 76 consumption 6
grounded electrical outlet 42, 75
receptacles 75
M requirements 6
mixed-shelf loop power supplies
assumptions about 90 about AC and DC 42
multiloop storage appliance viii installing in a disk shelf 74
adding a loop to 35 interpreting LEDspower supply 51
requirements for 35 location of LEDs 59
power cord with 75
power switch for 75
N ratings of 6
NetApp appliance, defined vii removing from a disk shelf 72
replacing 72
O power supply error messages
cooling element, element 1 and 2 60
Operating conditions
power supply element 1 and 2 60
relative humidity 5
temperature range 5
R
P relative humidity, operating conditions 5
removal of
port state messages
disk shelf from daisy-chain 67
///0xXX 56
disk shelves 65
BYP/CLK 56
LRC/ESH/ESH2 modules 77
BYP/CLOS 56
power supplies 72
BYP/CRC 56
Removing 72
BYP/DTO 56
replacement of
BYP/GEN 56
disk shelves 64
BYP/INIT 56
disks 69
BYP/LIP 56
LRC/ESH/ESH2 modules 76
BYP/LIPF7 56
power supplies 72
BYP/LIPF8 56
requirements
BYP/MAN 56
drive bay 16
BYP/MIR 56
electrical 5
BYP/RLOS 56
environmental 4
BYP/RPRT 56
for connecting additional loops 35
BYP/STALL 56
power 6
BYP/TBI 56
rules
BYP/WRD 56
for drive bays 16
BYP/XMIT 56
for installing disk shelves 10
EMPTY 56
OK 56
power S
brownouts 6 shelf state messages
connecting disk shelves to 42 FAILED 55

Index 117
 INIT REQD 54 Port state 56
MISSING 54 shelf state 54
OFFLINE 54 Term switch 55
ONLINE 54 supported disks 16
shipment contents 9
special messages ix
storage appliance, defined vii T
storage show hub command output temperature range, operating conditions 5
Clock Delta 57 term switch messages
Insert Count 57 AUTO-TERM 55
Invalid CRC Count 57 OK 55
Invalid Word Count 57 TERM 55
Loop up Count 57 TERM-ERR 55
Stall Count 58 terminate, defined vii
Utilization % 58 terminology vii
storage show hub output thermal rating 6
ESH/ESH2 state 55

118 Index