NetApp & Cisco: Lab. 5/6 - Configuring FCoE with Cisco Nexus 5010 Switch for NetApp using CLI

*DOT 8.0.1 first allowed both FCoE and traditional Ethernet protocols using the same UTA
*FCoE Topologies: Fabric or network topology is the only supported attachment configuration (direct connection not supported)
*FCoE connects over the interconnect
*Within FCoE, a session is automatically created upon discovery

Lab Setup:
Host: Windows Server 2008 R2 with Emulex OCe10102-F FCoE CNA
Switch: Nexus 5010 Switch with SFP-10G-SR SFPs
Target: FAS3070 with X1139A UTA running DOT 8.0.1 7-Mode
Cables: OM3 optical cables (OM4 recommended for optimum performance)

1: Verify host OS releases, patches, volume manager, file system, MPIO, NetApp host utilities in the IMT
Install Multipath I/O feature in Windows 2008 R2
Install the DOT DSM for Windows MPIO
2: Install compatible CNA
OneCommand Manager used to manage Emulex CNA.
3: Install and configure required CNA drivers and utilities
4: Install compatible NetApp host utilities kit

DOT command to verify current hardware:
system> sysconfig
DOT command to add the FC service license:
system> license add FCCODEHERE

Cisco Nexus 5010:
After initial setup on boot.
To view currently installed licenses:
switch# show license usage
To view the current configuration of the interfaces on the switch:
switch# show interface brief
To enter configuration mode:
switch# configure terminal
To enable the FCoE feature:
switch(config)# feature fcoe
To create vsan 10 with name myvsan:
switch(config)# vsan database
switch(config-vsan-db)# vsan 10
switch(config-vsan-db)# vsan 10 name myvsan
switch(config-vsan-db)# exit
To create vlan 10:
switch(config)# vlan 10
To associate VLAN 10 with VSAN 10:
switch(config-vlan)# fcoe vsan 10
To verify the VLAN-VSAN configuration:
switch(config-vlan)# show vlan fcoe
To exit the VLAN configuration:
switch(config-vlan)# exit
To configure ethernet port 1/1 for FCoE:
switch(config)# interface ethernet 1/1
switch(config-if)# spanning-tree port type edge trunk
switch(config-if)# switchport mode trunk
To create a new Virtual Fibre Channel (VFC) identified as 1:
switch(config)# interface vfc1
switch(config-if)# bind interface ethernet 1/1
switch(config-if)# no shutdown
switch(config-if)# exit
*and repeat to create vfc2 for eth1/2, vfc3 for eth1/3, vfc4 for eth1/4 (only 1 FC is allowed per 10Gb ethernet connection)

To associate VFC 2 to VSAN 10:
switch(config)# vsan database
switch(config-vsan-db)# vsan 10 interface vfc 2
switch(config-vsan-db)# exit
To view the Fabric Login database:
switch(config)# show flogi database
To view the nameserver database:
switch(config)# show fcns database vsan 10

To check adapter 3b from storage CLI:
system> fcp show adapter 3b

To associate VFC 3 to VSAN 10:
switch(config)# vsan database
switch(config-vsan-db)# vsan 10 interface vfc 3
switch(config-vsan-db)# exit
switch(config)# show flogi database
switch(config)# show fcns database vsan 10

To associate VFC 4 to VSAN 10:
switch(config)# vsan database
switch(config-vsan-db)# vsan 10 interface vfc 4
switch(config-vsan-db)# exit
switch(config)# show flogi database
switch(config)# show fcns database vsan 10

To view the discovered initiators from storage CLI:
system> fcp show initiators

To create the first zone in VSAN 10:
switch(config)# zone name fcoehost1 vsan 10
Add the WWPN for storage system 3a:
switch(config-zone)# member pwwn 50:0a:09:81:87:09:3d:96
Add the WWPN for host port 0:
switch(config-zone)# member pwwn 10:00:00:00:c9:9c:6c:85
switch(config-zone)# exit
To create an fcoe zoneset called fcoe in VSAN 10:
switch(config)# zoneset name fcoe vsan 10
Add zone fcoehost1 to the zoneset:
switch(config-zoneset)# zone name fcoehost1
Activate the zoneset:
switch(config-zoneset)# zoneset activate name fcoe vsan 10
switch(config-zoneset)# exit

On storage system, to view the discovered initiators:
system> fcp show initiators

To create the second zone in VSAN 10:
switch(config)# zone name fcoehost2 vsan 10
Add the WWPN for storage system 3b:
switch(config-zone)# member pwwn 50:0a:09:82:87:09:3d:96
Add the WWPN for host port 1:
switch(config-zone)# member pwwn 10:00:00:00:c9:9c:6c:87
switch(config-zone)# exit
To open the fcoe zoneset called in VSAN 10:
switch(config)# zoneset name fcoe vsan 10
Add zone fcoehost2 to the zoneset:
switch(config-zoneset)# zone name fcoehost2
Re-activate the zoneset to get the changes to show up:
switch(config-zoneset)# zoneset activate name fcoe vsan 10
switch(config-zoneset)# exit

On storage system, to view the discovered initiators:
system> fcp show initiators

To verify connectivity to the host's Emulex port 1 through 3a on the storage system:
system> fcp ping 3a 0x3b0002
To view the topology visible through 3a:
system> fcp topology show 3a
Enter the following command to view the zones visible:
system> fcp zone show
Enter the following commands to view the UTA details:
system> priv set diag
system*> cna show

Quality of Service Configuration
To show the current policy maps:
switch# show policy-map
*default is 50% for FCoE traffic and 50% for other traffic.
switch# configure terminal
To create a new policy map called fcoe-80:
switch(config)# policy-map type queuing fcoe-80
To configure the FCoE class within the policy:
switch(config-pmap-que)# class type queuing class-fcoe
Set the FcoE bandwidth to 80%:
switch(config-pmap-c-que)# bandwidth percent 80
To configure the default class within the policy:
switch(config-pmap-c-que)# class type queuing class-default
Set the default bandwidth to 20%
switch(config-pmap-c-que)# bandwidth percent 20
switch(config-pmap-c-que)# exit
switch(config-pmap-que)# exit

Quality of Service Configuration:
switch(config)# system qos
To set the input policy to the fcoe-80 map:
switch(config-sys-qos)# service-policy type queuing input fcoe-80
To set the output policy to the fcoe-80 map:
switch(config-sys-qos)# service-policy type queuing output fcoe-80
switch(config-sys-qos)# end
To show the new policy maps:
switch# show policy-map system
switch# copy running-config startup-config

LUN connectivity steps with DOT
1: Create an igroup
2: Create a logical unit
3: Map the logical unit to the igroup

Best Practice: Do not put LUNs in the root volume

To create an igroup:
system> igroup create -f -t windows my_fcoegroup 10:00:00:00:C9:9C:6C:85 10:00:00:00:C9:9C:6C:87
To show the existing igroups:
system> igroup show

To create an aggregate:
system> aggr create aggr_SAN 7
To create the volume for the LUN:
system> vol create vol_SAN1 aggr_SAN 2g
To turn off the default Snapshot policy for the volume:
system> snap reserve vol_SAN1 0
system> vol options vol_SAN1 nosnap on
To create a LUN named LUN1:
system> lun create -s 500m -t windows /vol/vol_SAN1/lun1

To map the LUN to the igroup:
system> lun map /vol/vol_SAN1/lun1 my_fcoegroup
*DOT will automatically assign a LUN number in the absence of a given number
To verify the LUN and mapping:
system> lun show -m

IP-Based Protocols

Configuring the storage system's UTA.
To verify the current configuration of the network adapters:
system> ifconfig -a
To configure e3a and e3b for a private network:
system> ifconfig e3a 172.1.1.52 up netmask 255.255.255.0
system> ifconfig e3b 172.1.1.53 up netmask 255.255.255.0
Verify the configurations:
system> ifconfig -a

License and setup the CIFS service:
system> license add CIFSCODE
system> cifs setup
*Option 3 for Windows Workgroup authentication
*Accept default workgroup name
*Default share for root volume is automatically created during setup

Configure CNA in Windows for TCP/IPv4 on both adapters.
In Windows map drive to the UTA.
Results in successful demonstration of Ethernet convergence (CIFS and FCoE over same adapters)!

SEO: Walkthrough / Step by Step

Comments