Monday, 17 July 2017

Automatically Adding Host Credentials to 7MTT via Batch File

It’s a “feature” of 7MTT (every version), that when your 7MTT server reboots, or when you restart the “NetApp 7-Mode Transition Tool” service, you lose all the cached credentials and have to re-input them. This is a bit of a pain if you’ve got lots of hosts in 7MTT. It’s doubly a pain since 7MTT (from 2.0 I think) schedules the 7 to C SnapMirror transfers, so all the transition SnapMirrors grind to a halt until you re-input those credentials.

The good news is that it’s perfectly possible to write a batch file, and re-add the credentials using this batch file. You could even set a scheduled task to run this batch file, to make sure the credentials are loaded. One issue scheduling this with a batch file is that we have to use plain text passwords (if anyone has a cunning solution around this, please let me know.)

Here’s an example batch file to show how it’s done (adding 2 host credentials). Save as say Add_7MTT_Credentials.bat and double-click to run.

echo "START"
echo mypassword | transition credentials add -h host1_IP_FQDN -u admin
echo mypassword | transition credentials add -h host2_IP_FQDN -u admin
echo "END"
pause

Nice and simple!

Note: Version of 7MTT was 3.2.0.

Image: 7MTT Transition Credentials Management Commands
 
Tip 1: As in the above screenshot, to make your DOS command prompt look nicer, check out this Scott Hanselman post.
Tip 2: Making the PowerShell prompt look nicer is simple:
PS> Function Prompt{"YOUR PROMPT DESIGN HERE"}

How to Quickly Disable IE ESC in Windows Server 2016 using PowerShell

I really hate “Internet Explorer Enhanced Security Configuration”. Whilst I understand the arguments for it - and against - I simply loathe it.
Good thing that we can easily disable it using PowerShell.

Disabling IE ESC

All you need to do is (using keyboard shortcuts here):

1) Press the Windows button
2) Type “po” for PowerShell (you might have to type a bit more - with a vanilla install, Windows PowerShell will be the best match)
3) Press Ctrl+Shift+Enter (shortcut to Administrator: Windows PowerShell)
Note: You may need to click ‘yes’ to the User Account Control prompt.
4) Then copy and paste the following code into Powershell:


$AdminsKey = "SOFTWARE\Microsoft\Active Setup\Installed Components\{A509B1A7-37EF-4b3f-8CFC-4F3A74704073}"
$UsersKey = "SOFTWARE\Microsoft\Active Setup\Installed Components\{A509B1A8-37EF-4b3f-8CFC-4F3A74704073}"
$BaseKey = [Microsoft.Win32.RegistryKey]::OpenBaseKey("LocalMachine","Default")

$SubKey = $BaseKey.OpenSubkey($AdminsKey,$true)
$SubKey.SetValue("IsInstalled",0,[Microsoft.Win32.RegistryValueKind]::DWORD)
$SubKey = $BaseKey.OpenSubKey($UsersKey,$true)
$SubKey.SetValue("IsInstalled",0,[Microsoft.Win32.RegistryValueKind]::DWORD)
logoff


Note 1: We have to log off and log on for the settings to take effect.
Note 2: Here we disable IE ESC for Admins and Users.

Enabling IE ESC

If you wanted to enable IE ESC, it’s just (0 changed to 1):


$AdminsKey = "SOFTWARE\Microsoft\Active Setup\Installed Components\{A509B1A7-37EF-4b3f-8CFC-4F3A74704073}"
$UsersKey = "SOFTWARE\Microsoft\Active Setup\Installed Components\{A509B1A8-37EF-4b3f-8CFC-4F3A74704073}"
$BaseKey = [Microsoft.Win32.RegistryKey]::OpenBaseKey("LocalMachine","Default")

$SubKey = $BaseKey.OpenSubkey($AdminsKey,$true)
$SubKey.SetValue("IsInstalled",1,[Microsoft.Win32.RegistryValueKind]::DWORD)
$SubKey = $BaseKey.OpenSubKey($UsersKey,$true)
$SubKey.SetValue("IsInstalled",1,[Microsoft.Win32.RegistryValueKind]::DWORD)
logoff


Image: “Internet Explorer Enhanced Security Configuration is not enabled” - hurrah!

Credit: This 4sysops.com post led me in the right direction.

NetApp Site Survey Questionnaire / Template / Checklist

I was asked “have you a template that you use for site surveys?”
Now I’ve done the odd Site Survey myself, but I realize I just had it in my *ahem* head precisely what was needed.

It’s never worth reinventing the wheel, so I dug around for a bit without success to see what’s out there. There was a NetApp official “Site Requirements Guide” that’s dated 2014, and is not going to be updated since everyone is - quite rightly - redirected now to http://hwu.netapp.com/  for site requirements.

I remember from a very old (February 2012) study notes post - http://www.cosonok.com/2012/02/netapp-ns0-502-study-notes-part-34-san.html
- that I wrote:


Prepare site for installation:
- Be able to review implementation flowchart with customer and assign task areas.
- Make contact with datacenter/site personnel.
- Validate equipment move path to installation location.
- Verify site infrastructure including: dual power (and proximity of power drops to the install location), floor space, floor loading plan, HVAC (Heating, ventilation, and air conditioning.)
- Validate logistics plan for staging and installation of equipment.
- Verify Ethernet cabling plan and availability of cable supports.
- Verify fiber cabling plan and availability of cable supports.


I Googled “NetApp site survey form” / “NetApp site survey template” and the only decent result - in the first 2 pages of search results - was Mike Brown’s Preparing for a data center site survery.


NetApp Site Survey Questionnaire / Checklist / Template

Since I don’t post spreadsheets/word docs on this blog, here’s my take on this in blog format.

Before Site Visit

+ Have you got a cabinet layout diagram (excel, visio, ...)?
+ Have you got access to the sales order(s) / bill of materials?
+ Does everything look in order on the bill of materials (sufficient cables and of sufficient length, SFPs, IO cards ...)?
+ Check NetApp Hardware Universe for site requirements for the involved hardware (power requirements, hardware dimensions, compatibility ...)
+ If this is adding to an existing installation, verify Interoperability on the NetApp IMT (the IMT also needs to be checked if this is a new FC SAN installation)
+ Who is the site contact?
+ Has site access been arranged?

Equipment to Bring

+ Identification Documents (if required)
+ Safety Equipment (if required: like steel tipped boots...)
+ Documentation
+ Pen and paper/laptop
+ Tape measure
+ Tools (knife - to open boxes, torch ... and whatever else you think might be useful.)

Site Visit

+ Make contact with datacenter/site personnel.
+ If the new hardware is on site, request an inspection (to make sure all parts are present and as expected, and so that the installation engineers know where to find the parts.)
+ If the new hardware in not on site, discover where it will be stored.
+ Validate equipment move path to installation location.
+ Verify the cabinet(s).
-- Cabinets are not damaged.
-- Cabinets are big enough (front posts are forward enough and there is enough length in the cabinet) to take the hardware.
-- There are no obstructions in the cabinets (like cabling, switches, cooling pipes, other hardware units not in the cabinet layout ...)
-- Cabinet feet are down.
+ Verify site infrastructure including:
-- Power (ideally dual power on separate circuits, plug and socket types, proximity of power drops to the install location, PDUs will not obstruct removal of controller trays out the back of the cabinet for non-disruptive maintenance...)
-- Floor space
-- Floor loading plan
-- HVAC (Heating, ventilation, and air conditioning.)
+ Validate logistics plan for staging and installation of equipment.
+ Verify Ethernet cabling plan, availability of cable supports/tidies and cable lengths.
+ Verify fiber cabling plan, availability of cable supports/tidies and cable lengths.

Post Site Visit

+ Document your observations (what’s good, what’s bad, concerns ...)
+ Distribute to the relevant parties.
+ Follow up where there were concerns needing addressing.

Image: Site Survey

Saturday, 15 July 2017

Exploring ONTAP 9.2 OnCommand System Manager GUI

I’m a bit of a geek and love using the Clustershell CLI, or APIs to manage ONTAP; so much so that it’s easy for me to overlook the OCSM Web UI. The Web UI in ONTAP 9.2 is very good, so it definitely warrants taking a closer look.

News

Applications tab: even with an ONTAP 9.2 Simulator - not just AFF like it was before - the Applications tab is now available to all.
Storage Tiers tab: There’s a Storage Tiers tab which lets you configure an ‘External Capacity Tier’ to the cloud (Note: my SIM is not licensed for FabricPool - we only see StorageGrid.)
Configurations > Cluster Settings > Licenses: In ONTAP 9.2, the Cluster Base License is now deprecated. You don't need a Cluster Base License anymore, as shown in the following screenshot.

Image: {DEPRECATED}-Cluster Base License

Screenshots

Note: Please click images to enlarge.

Tab 1) Dashboard

Image: OnCommand System Manager 9.2: Dashboard

Tab 2) Applications

Image: OnCommand System Manager 9.2: Applications

Tab 3) LUNs

Image: OnCommand System Manager 9.2: LUNs

Tab 4) SVMs

Image: OnCommand System Manager 9.2: SVMs

And if you click on ‘Manage

Image: OnCommand System Manager 9.2: SVMs: Manage

Tab 5) Network

Image: OnCommand System Manager 9.2: Network

Tab 6) Storage Tiers

Image: OnCommand System Manager 9.2: Storage Tiers

And clicking  ‘Add/Configure External Capacity Tier

Image: OnCommand System Manager 9.2: Storage Tiers: Add External Capacity Tier

Tab 7) Hardware and Diagnostics (dropdown)

Image: OnCommand System Manager 9.2: Hardware and Diagnostics

Tab 8) Protection (dropdown)

Image: OnCommand System Manager 9.2: Protection

Tab 9) Configurations

Image: OnCommand System Manager 9.2: Configurations

Note: Notice that you can now do 'Cluster Expansion' from the GUI.

Top Right) Buttons and Dropdowns

Guided Problem Solving (button)
This takes you to NetApp’s ‘Welcome to Guided Problem Solving’ page

Technical Support Chat (button)
This lets you chat online with NetApp Technical Support (automatic case generation)

Help (dropdown)
- OnCommand System Manager Help
- Support (This displays the ‘Supportability Dashboard’ - see image below)
- About NetApp OnCommand System Manager

Administration (dropdown)
- Settings
-- Log Level: OFF/ERROR/WARN/INFO/DEBUG
-- Inactivity Timeout (in minutes) {Can set this to 0 if you don’t want the GUI to timeout}

Sign Out (button)

Search dropdown
- You can search on: All/ Volumes/ LUNs/ Qtrees/ Network Interfaces/ SVMs/ Aggregates/ Disks/ Ethernet Ports

Search textbox

+ (Plus) (button/dropdown)
- Quick access to certain (common?) tasks*: Create Volume/ Create Aggregate/ Create Subnet/ Volume Move/ Volume Resize/ Add Licenses
*I wonder if this is customizable

Image: OnCommand System Manager 9.2: Top Right: Buttons and Dropdowns

Image: OnCommand System Manager 9.2: Supportability Dashboard

SEO: Graphical Documentation OnCommand System Manager 9.2 User Interface

Friday, 14 July 2017

NetApp ONTAP 9.2 Simulator Setup: Part 2 of 2

Continuing from the previous post...

Note: Click to enlarge any of the pictures in this post. 

The Guided Cluster Setup in ONTAP 9.2 is really very good. I remember I tried to setup a 9.1 simulator using the guided setup, and that didn’t work, with ONTAP 9.2 it can be used to setup your simulator.

First,
log into:
https://node_mgmt_IP

And click the big ‘Guided Setup’ button.

Image: Welcome to the Guided Cluster Setup

Image: ‘Guided Setup’ button

1) Cluster

Input:
Cluster name
Node name
admin password
Feature Licenses (Optional)

Then click ‘Submit and Continue

Image: Guided Setup to Configure a Cluster: Cluster and Node name

Image: Guided Setup to Configure a Cluster: admin password and licenses

2) Network

Input:
Cluster Management Address
Node Management Address(es)
Service Processor Address(es)
DNS Details
NTP Details

Then click ‘Submit and Continue

Image: Guided Setup to Configure a Cluster: Network

3) Support

Configure:
AutoSupport
Event Notifications
Cluster Configuration Backup (recommended for single-node clusters)

Then click ‘Submit and Continue

Image: Guided Setup to Configure a Cluster: Support

4) Storage

This step will configure you a recommended storage layout or you can skip.

Click ‘Submit and Continue’ or ‘Skip this step

Image: Guided Setup to Configure a Cluster: Storage

Image: Guided Setup to Configure a Cluster: Storage Recommendation

5) SVM

In this section you can create a Storage Virtual Machine, and configure Data Protocols - CIFS, NFS, iSCSI, FC/FCoE - as required (if you have the license.)

The click ‘Submit and Continue’ or ‘Skip this step

Image: Guided Setup to Configure a Cluster: SVM

6) Summary

And we’re finished!

Click ‘Manage your cluster’ or ‘Export Configuration

Image: Guided Setup to Configure a Cluster: Summary

Finally,
just an image to prove log in into a working ONTAP 9.2 simulator!

Image: OnCommand System Manager: NetApp Release 9.2: Tue Jun 20 03:20:03 UTC 2017
Up next: Exploring the ONTAP 9.2 OnCommand System Manager GUI...

NetApp ONTAP 9.2 Simulator Setup: Part 1 of 2

Note: For a more detailed simulator build, check out this post which I wrote for 8.3.2:

ONTAP 9.2 went GA on Jun 29 2017 (see Software Change Log).

The NetApp ONTAP 9.2 Simulator is not yet out (I checked this morning on the 'Simulate ONTAP for ONTAP 8.x and 9.x' download page), so if you want to play with ONTAP 9.2 GA, you’ll need to upgrade the ONTAP 9.1 simulator, and this is simple to do.

Step-by-Step Guide

Note: This walkthrough is done with VMware Workstation 12.5.

1) Download 92_q_image.tgz from here:

2) Serve the 92_q_image.tgz file from a WebServer

Image: ONTAP 9.2 served (user whatever webserver is approved for use at your organization)

3) Download vsim-netapp-DOT9.1-cm.ova from here:

4) Open the OVA in VMware Workstation, and Import

5) Edit the ‘Virtual Machine Settings’ as desired

6) (Optional) Configure Memory down to 4GB
The SIM comes configured with 5GB, and normally you’d not change this, or increase it to make an upgrade possible. Here we do something slightly different. We reduce the Virtual Machine Memory down to 4096MB and then edit the VMX file with this extra line:

pciHole.start = "1024"

Image: Example of edited VMX file

7) Power on the VM and Press Ctrl-C for Boot Menu (when it appears)

Image: Press Ctrl-C for Boot Menu

8) Select option (7) Install new software first, and follow the prompts:


This procedure is not supported for Non-Disruptive Upgrade on an HA pair. The software will be installed to the alternate image, from which the node is not currently running. Do you want to continue? y

In order to download the package, a temporary network interface needs to be configured.

Select the network port you want to use for the download: e0c

The node needs to reboot for this setting to take effect. Reboot now? y


The node reboots, and then:


In order to download the package, a temporary network interface needs to be configured.

Enter the IP address for port e0c: 10.0.0.2
Enter the netmask for port e0c: 255.0.0.0
Enter IP address of default gateway:

What is the URL for the package? http://10.0.0.1/92_q_image.tgz
What is the username on "10.0.0.1", if any?


Then the install will run (be patient). And then:


Do you want to set the newly installed software as the default to be used for subsequent reboots? y

The node must be rebooted to start using the newly installed software. Do you want to reboot now? y


The node will reboot.

9) When ‘Press Ctrl-C for Boot Menu’ appears, press Ctrl-C

All being well you should have seen the node boot to ONTAP 9.2, and will see something like the below:


bootarg.from.version="9.1"
bootarg.to.version="9.2"


Image: bootarg.to.version="9.2"

Note the boot menu option ‘(9) Configure Advanced Drive Partitioning’ which wasn’t there before.

10) In the Boot Menu, select:


(4) Clean configuration and initialize all disks


And follow the prompts to kick off the wipeconfig request:


Zero disks, reset config and install a new file system? y
This will erase all the data on the disks, are you sure? y


Wait for the wipeconfig request to complete.

11) Cluster Setup Wizard

After the wipeconfig the node will boot into the ‘cluster setup wizard’.


Enabling AutoSupport can significantly speed problem determination and resolution...
Type yes to confirm and continue: yes


Enter the node management interface...
...port
...IP address
...netmask
...default gateway

In part 2 we’ll continue the ONTAP 9.2 Simulator Setup in the WebUI:
https://node_mgmt_IP

Image: Welcome to the cluster setup wizard

Image: Node management interface configuration

Image: Use your web browser to complete cluster setup ... or ... the command line

Thursday, 13 July 2017

WFA 4.1: Web UI Mapped Out: Part 2 - WFA Configuration

Continuing this post: WFA 4.1: Web UI Mapped Out +

This post just documents (in 10 screenshots) the 9 tabs available from:

Administration Menu > WFA Configuration

1) AutoSupport Tab

Protocol options:
HTTP / HTTPS (default) / SMTP

Content options:
send only configuration data /
send configuration and cache data (default) /
send configuration and cache extended data

Image: WFA Configuration: 1) AutoSupport Tab

2) Authentication Tab

Image: WFA Configuration: 2) Authentication Tab

3) Mail Tab

Image: WFA Configuration: 3) Mail Tab

4) Proxy Tab

Image: WFA Configuration: 4) Proxy Tab

5) SNMP Tab

Image: WFA Configuration: 5) SNMP Tab

6) Syslog Tab

Syslog level options:
INFO / WARN / ERROR / FATAL

Image: WFA Configuration: 6) Syslog Tab

7) Other Tab

Image: WFA Configuration: 7-1) Other Tab (Top)

Image: WFA Configuration: 7-2) Other Tab (bottom)

8) Advanced Tab

Image: WFA Configuration: 8) Advanced Tab

9) Storage Automation Store Tab

Image: WFA Configuration: 9) Storage Automation Store Tab

NetApp HCI: Some Notes and Maximum Configuration (Unofficial*)

*It’s pretty obvious that a blog with Mongolian yurts in the header picture, is not the official blog of any Enterprise IT organization, still, I always feel like stressing this blog is unofficial (i.e. this stuff is un-vetted, un-peer-reviewed; there’s no one to stop me writing total cr^p.)

I briefly touched on NetApp HCI in my Tech Round Up 22nd June 2017.

Minimum Configuration

From the NetApp HCI Datasheet at http://www.netapp.com/us/media/ds-3881.pdf (DS for Disk Shelf) the minimum configuration is made up of:

2 x 2-RU 4-Node chassis
4 x Storage nodes
2 x Compute nodes
2 x Open bays for expansion nodes

Image: NetApp HCI Minimum Configuration

A small minimum configuration would have:

2 x 2-RU 4-Node chassis
4 x SMALL Storage nodes
2 x SMALL Compute nodes
2 x Open bays for expansion nodes

The NetApp HCI Visio’s are now available from http://www.visiocafe.com/netapp.htm. The physical representation of the minimum configuration is below.

Image: Front View

Image: Rear View

Small/Medium/Large Storage/Compute Nodes

Reading from the datasheet, there’s 3 sizes of storage node, and 3 sizes of compute node:


Storage |           | Effective Block Capacity
Node    | SSDs      | @ 5x - 10x Efficiency
--------+-----------+-------------------------
SMALL   | 6 x 480GB | 5.5TB - 11TB
MEDIUM  | 6 x 960GB | 11TB - 22TB
LARGE   | 6 x 1.9TB | 22TB - 44TB

Compute | Cores   | GB Memory
Node    | for VMs | for VMs
--------+---------+----------
SMALL   | 16      | 256
MEDIUM  | 24      | 512
LARGE   | 36      | 768


From this, the small minimum configuration is:


Storage |     |            | Effective Block Capacity
Node    | QTY | SSDs       | @ 5x - 10x Efficiency
--------+-----+------------+-------------------------
SMALL   | 4   | 24 x 480GB | 22TB - 44TB

Compute |     | Cores   | GB Memory
Node    |     | for VMs | for VMs
--------+-----+---------+----------
SMALL   | 2   | 32      | 512


Maximum Configuration

I was looking for what the Maximum size of a NetApp HCI cluster could be - there is no maximum size published. Then I came across this article:

Note: Personally I disagree with Chris Mellor’s view. The storage and compute are all in one box, so it’s hyperconverged end of story (vBlock, Flexpod... get away with being converged by virtue of all components being in the same cabinet). IMHO, the NetApp HCI solution is much better than First Generation HCI solutions where you’d either end up with way too much storage, or way too much compute. If I was being really picky though, it might be nice to be able to add memory for VMs / cores for VMs separately (i.e. so don’t end up with either way too much CPU, or way too much memory), still, that’d make the solution less elegant and more complex.

A couple of quotes from the article:

Rollason: "The HCI storage capabilities exactly match SF AFA scale. The ESX cluster sizes are only limited by ESX maximums. The management software for HCI can manage multiple storage and ESX clusters within the same solution and UI. That combines to allow HCI scale to be in theory limitless."
Rollason: "In real life the thing that would limit the scale of the solution would be VMware vCenter’s maximum capabilities. NetApp HCI architecture has nothing that limits it from continuing to expand in a single solution so long as a vCenter Server can handle it."

So there we have it!

The VMware vSphere 6.0 Configuration Maximums lists a maximum of 1000 Hosts per vCenter Server.
The VMware vSphere 6.5 Configuration Maximums lists a maximum of 2000 Hosts per vCenter Server.
The NetApp HWU has SolidFire having 100 max nodes per cluster.

A single NetApp HCI solution could scale up to 2000 compute nodes (with vSphere 6.5), and as many up-to 100 storage node clusters as the hosts could support.

1000 large compute nodes:


Compute |      | Cores   | GB Memory
Node    | QTY  | for VMs | for VMs
--------+------+---------+----------
LARGE   | 1000 | 36’000  | 768’000


100 large storage nodes:


Storage |     |             | Effective Block Capacity
Node    | QTY | SSDs        | @ 5x - 10x Efficiency
--------+-----+-------------+-------------------------
LARGE   | 100 | 600 x 1.9TB | 2200TB - 4400TB


Other Links


Other Links (SolidFire Specific)

On the NetApp Field Portal and okay to share:

Technical Reports:

NetApp HCI: Enterprise-Scale HyperConverged Infrastructure Solution

And finally!

NetApp HCI is designed on the foundation of SolidFire and VMware ESXi - industry proven storage software and industry proven virtualization software. The only new element is the deployment engine.

Image: NetApp HCI: Enterprise-Scale Hyper Converged Infrastructure Solution