I love a bit of Visio, and since I’ve not shared any Visio on my blog in what seems like ages, I thought I’d share this!
The NetApp FAS/AFF8080EX has a lot of on-board ports and 12 x IO card expansion slots. If you populate 6 slots with dual-port UTA2 cards (that can do either FC or Ethernet), and 4 slots with quad-port SAS cards, and have balanced FC and 10 GbE front-end connectivity requirements, and following Hardware Universe priority slot assignments, we can draw up something like the diagram below.
- This is just one node of the HA-pair
- We still have 2 spare IO card slots
- We can have up to 10 stacks of disks (20 SAS ports)
- e0a, e0b, e0c, e0d are utilized by the private Cluster Interconnect network
- We have: 8 x 16 Gb FC ports
- We have: 8 x 10 GbE ports
- And UTA ports can be used for either FC or GbE, so we could have had:
-- 16 x 10 GbE, or
-- 16 x 16 Gb FC
I’ve drawn it as there being two FC fabrics - FC Fabric A and FC Fabric B. And I’ve imagined we’re plugging into two Ethernet switches - Switch 1 and Switch 2 - and we’d have two LACPs - set 1 for Switch 1 of e0g, e4a, e9a, e11a, and set 2 for Switch 2 of e0h, e4b, e9b, e11b.
Image: FAS/AFF8080EX node with 16 ports for front-end FC/10GbE connectivity
I thought I’d point out why I’ve only drawn 1 * 1 GbE connection in the diagram (we don’t need to use the other 1 GbE ports, but can if wanted.) This is because the MGMT VLAN can be presented to our LACP ports, as covered by the diagram below, which shows the management network, and Cluster and Node (includes Service Processor) management connectivity (SVMs aren’t considered in this post.) The SPs can’t move port, all the other management LIFs can fail over to other ports if their home port (represented with the @) goes down.
Image: Cluster and Node Management Connectivity
As always, comments are great and much appreciated. If you had this kit, would you do the front-end connectivity differently? And if so, why?
Note: I’ll also add that it makes a lot of sense to use portsets in this scenario with so many FC ports in the mix (so as not to exceed SAN host OSes path maximums.)