I love a bit of Visio, and since I’ve not
shared any Visio on my blog in what seems like ages, I thought I’d share this!
The
NetApp FAS/AFF8080EX has a lot of on-board ports and 12 x IO card expansion
slots. If you populate 6 slots with dual-port UTA2 cards (that can do either FC
or Ethernet), and 4 slots with quad-port SAS cards, and have balanced FC and 10
GbE front-end connectivity requirements, and following Hardware Universe
priority slot assignments, we can draw up something like the diagram below.
Remember:
- This is just one node of the HA-pair
- We still have 2 spare IO card slots
- We can have up to 10 stacks of disks (20 SAS
ports)
- e0a, e0b, e0c, e0d are utilized by the
private Cluster Interconnect network
- We have: 8 x 16 Gb FC ports
- We have: 8 x 10 GbE ports
- And UTA ports can be used for either FC or
GbE, so we could have had:
-- 16 x 10 GbE, or
-- 16 x 16 Gb FC
I’ve
drawn it as there being two FC fabrics - FC Fabric A and FC Fabric B. And I’ve
imagined we’re plugging into two Ethernet switches - Switch 1 and Switch 2 -
and we’d have two LACPs - set 1 for Switch 1 of e0g, e4a, e9a, e11a, and set 2
for Switch 2 of e0h, e4b, e9b, e11b.
Image: FAS/AFF8080EX node with 16 ports for
front-end FC/10GbE connectivity
I
thought I’d point out why I’ve only drawn 1 * 1 GbE connection in the diagram
(we don’t need to use the other 1 GbE ports, but can if wanted.) This is
because the MGMT VLAN can be presented to our LACP ports, as covered by the
diagram below, which shows the management network, and Cluster and Node
(includes Service Processor) management connectivity (SVMs aren’t considered in
this post.) The SPs can’t move port, all the other management LIFs can fail
over to other ports if their home port (represented with the @) goes down.
Image: Cluster and Node Management Connectivity
As
always, comments are great and much appreciated. If you had this kit, would you
do the front-end connectivity differently? And if so, why?
Note: I’ll also add that it makes a lot of
sense to use portsets in this scenario with so many FC ports in the mix (so as
not to exceed SAN host OSes path maximums.)
Comments
Post a Comment