Tuesday, 26 February 2019

Tech Roundup - 26th February 2019

Stuff collated/new since Tech Roundup - 16th December 2018. With headings:
Cisco, Storage Industry News, NetApp, Veeam, Vmware, Miscellaneous

Cisco

Virtualized SAP HANA on FlexPod Datacenter
This architecture is based on and supports the following hardware and software components:
+ SAP HANA
- SAP Business Suite on HANA or SAP Business Warehouse on HANA
- S/4HANA or BW/4HANA
- SAP HANA single-host or multiple-host configurations
+ Operating System
- SUSE Linux Enterprise (SLES), SUSE Linux Enterprise for SAP (SLES for SAP)
- RedHat Enterprise Linux
+ Cisco UCS Server
- Bare Metal
- VMware
+ Network
- 40GbE end-to-end
- NFS for SAP HANA data access
- NFS or iSCSI for OS boot
+ Storage
- NetApp All Flash FAS

FlexPod Datacenter with Oracle RAC Databases on Cisco UCS and NetApp AFF A-Series (Oracle 12cR2 )CVD
This FlexPod Datacenter design is validated with following hardware and software components:
- NetApp AFF A700 Storage Systems and ONTAP 9.3
- Cisco Unified Computing System (Cisco UCS)
- Cisco UCS Chassis 5108
- Cisco UCS Blade Servers
- Cisco 6300 Series Fabric Interconnects
- Cisco Nexus 9000 series switches
- Cisco MDS 9100 Series Fabric Switches

FlexPod Datacenter with Microsoft SQL Server 2017 on Linux VM Running on VMware and Hyper-V:
This FlexPod Datacenter design is validated with following hardware and software components:
- NetApp AFF A300 and ONTAP 9.5
- NetApp SnapCenter 4.1.1 for VM Backup and Restore
- NetApp VSC 7.2.1 for Storage provisioning in VMware ESXi environment.
- Cisco UCS with UCS-FI-6332-16UP fabric interconnect, UCS B200 M5 servers, UCS VIC 1340 and UCS Manager 4.0 (1c)
- Cisco Nexus 93180YC Switch with NXOS 9.2(2)
- VMware vSphere 6.7U1
- Microsoft Windows Server 2016
- Microsoft SQL Server 2017 in Linux on ESXi as well as Hyper-v

The FlexPod with End-to-End NVMe white paper is available for customers and partners download:
The following innovative technologies are being delivered by the FlexPod with End-to-End NVMe converged infrastructure solution:
- Cisco UCS M5 servers with VIC 14xx for FC-NVMe
- Cisco UCS 4.0.2 with support for FC-NVMe
- Cisco MDS 9xxx FC SAN switches for FC-NVMe
- NetApp AFF storage controller with NVMe disks
- NetApp ONTAP 9.4 with support for FC-NVMe

Storage Industry News

Are You Prepared to Survive the Zombie (Botnet) Apocalypse?

A Look Back at 2018: It Is All About Buttoned-Up Data Analytics

NetApp

General News


It’s a Small, Small Data World: How NetApp FlexCache Makes It Smaller

MAX Data: Optimising Application Performance with SCM

Benefits of Native Cloud File Services for File Shares

Speed Up Your MySQL-Based Apps and Retain Customers With NetApp Cloud Volumes Service

MetroCluster IP Technical Updates:
TR-4689: MetroCluster IP Solution Architecture and Design
The MetroCluster IP switch technical guides have also been recently updated:
MetroCluster IP 40Gb Switch Technical
MetroCluster IP 100Gb Switch Technical

How Linux is Winning in the Azure Cloud for Tier One Workloads

IMPROVED version of Migration Guide for NetApp Import Utility for SnapCenter & VSC:
It can also be accessed through the ToolChest page here:

NetApp Trident v19.01:
*dag = Design and Architecture Guide

Creating a Unified Content Platform in the Cloud for Broadcasting

ONTAP AI: A Look Back at the Last 6 Months of Innovation

Introduction to NetApp MAX Data

Inside a Smart Campus: How a World-Class University Runs on Data

iSCSI Best Practices: Solutions to Real-World Deployment Challenges

Image: Jumbo frame MTU settings on VMkernel port, vSwitch, physical switches, and cluster-node ports

Bridging the CPU and GPU Universes

NetApp CSO 2019 Perspectives

Data Protection for Persistent Data Storage in Kubernetes Workloads

Hortonworks HDP 3.0 Certified on NetApp Cloud Volumes Service

NetApp PowerShell Toolkit 4.7 Released! (20th November 2018)

New Technical Reports (TRs)

TR-4749: NetApp for Epic Software: Solution Design

TR-4748: Build your Data Fabric: With NetApp HCI, ONTAP and Converged Infrastructure

TR-4747: SANtricity Snapshot Feature: Overview and Deployment Guide

TR-4746: SAP Applications on Microsoft Azure: Using Azure NetApp Files

TR-4744: Secure Hadoop using Apache Ranger with NetApp In-Place Analytics Module: Deployment Guide

TR-4741: NetApp Element Software Remote Replication: Feature Description and Deployment Guide

TR-4740: SMB 3.0 Multichannel: Accelerate SMB 3.0 Performance for Applications

TR-4739: IPv6 in Element Software: Configuration and Features of IPv6

TR-4738: Reconfiguring NetApp HCI Compute Interfaces

TR-4737: Automatic Load Balancing: NetApp SANtricity Feature Description and Implementation

TR-4736: SANtricity Web Services API: Built-In and Central Management Capabilities

TR-4733: SnapMirror Synchronous for ONTAP 9.5

TR-4731: HyTrust KeyControl Key Management in ONTAP 9.3 or Later: Integration Guide

New Technical Reports Internal (NetApp + Partner)

No direct link, find them in the NetApp Field Portal:

TR-4723i: NetApp E2800 Storage Array Performance Guide with SANtricity OS 11.50
TR-4728i: NetApp E5700 Hybrid Storage Array Performance Guide with SANtricity OS 11.50
TR-4729i: NetApp EF280 Storage Array Performance Guide with SANtricity OS 11.50
TR-4730i: NetApp EF570 Storage Array Performance Guide with SANtricity OS 11.50

TR-4750: NetApp HCI Manual Install H610C v1.4 - Existing HCI Cluster

TR-4751: NetApp HCI Manual Install H610C v1.4 - New HCI Cluster

TR-4752: NetApp HCI vSphere 6.5 to 6.7 Upgrade

New on the Tech ONTAP Podcast

Episode 178: SAN Overview and SAN Health

Episode 177: Data Science

Episode 176: NetApp Cloud Insights

Episode 175: Service Providers Using NetApp featuring Tierpoint

Episode 174: Veeam 9.5 Update 4

Episode 173: NetApp Advanced Technology Group

Episode 172: Scale Out Networking in ONTAP

Episode 171: Cloud Data Services with Nick Howell

Episode 170: Active IQ

KB.NetApp.com

Unable to connect to NetApp VSC for VMware Plug-in after changing vCenter IP address

NetApp University

NetApp HCI Technical Training:
Driving NetApp Sales: HCI Pre-Sales technical Training
NetApp HCI Fundamentals
Element Fundamentals

Veeam

Native snapshot integration for NetApp HCI and SolidFire

VMware

Best Practices for running VMware vSphere on NetApp ONTAP

Miscellaneous

Let’s Encrypt is a free, automated, and open Certificate Authority
FREE SSL Certificate Wizard

Tuesday, 12 February 2019

Prospecting for NetApp Verified Architectures

I’ve come across a few NetApp Verified Architectures in my time and thought they were pretty cool (similarly fabulous to Flexpod Design Guides.) But I’ve never seen a list of NVAs, and knowing that they are usually PDFs on https://www.netapp.com/us/media/ with the name nva-XXXX, or nva-XXXX-design, or nva-XXXX-deploy, I thought I’d try prospecting for them, using similar code to my NetApp Technical Report (TR) PowerShell Collector Script.

Full list of the NVAs discovered:

FlexPod Express with VMware vSphere 6.5 and FAS2600 (DEPLOY)

FlexPod Datacenter with Apprenda for PaaS (DESIGN)
Including Red Hat OpenStack 8, Docker Containers, NetApp Jenkins Plugin, and ONTAP 9

FlexPod Express with Microsoft Windows 2016 Hyper-V and FAS2600 (DEPLOY)

Converged Infrastructure Solution with NetApp E-Series and Splunk (DESIGN)

FlexPod Datacenter with Microsoft Applications and NetApp AFF A-Series (DESIGN)

FlexPod Datacenter with Microsoft Exchange 2016, SharePoint 2016, and NetApp AFF A300 (DEPLOY)

NetApp and Broadcom Modern SAN Cloud-Connected Flash Solution (DESIGN)
Oracle and SUSE NetApp Verified Architecture Design Edition

NetApp ONTAP AI, Powered by NVIDIA (DEPLOY)
Scalable AI Infrastructure for Real-World Deep Learning Use Cases: Deployment Guide

NetApp ONTAP AI, Powered by NVIDIA (DESIGN)
Scalable AI Infrastructure: Designing for Real-World Deep Learning Use Cases

VMware Private Cloud on NetApp HCI (DESIGN)

VMware Private Cloud on NetApp HCI (DESIGN)

FlexPod Express with VMware vSphere 6.7 and NetApp AFF A220 (DEPLOY)

Red Hat OpenShift Container Platform with NetApp HCI (DEPLOY)

Red Hat OpenShift Container Platform with NetApp HCI (DESIGN)

Red Hat OpenShift Container Platform with NetApp HCI (DESIGN)

FlexPod Express with Cisco UCS C-Series and AFF A220 Series (DESIGN)

NetApp and Broadcom Modern SAN Cloud-Connected Flash Solution (DESIGN)
Oracle and SUSE NetApp Verified Architecture Design Edition

NetApp and Broadcom Modern SAN Cloud-Connected Flash Solution (DESIGN)
MongoDB and SUSE NetApp Verified Architecture Design Edition

VMware Validated Design for NetApp HCI (DESIGN)
VVD 4.2 Architecture Design

VMware End-User Computing with NetApp HCI and NVIDIA GPUs (DESIGN)

FlexPod Express with VMware vSphere 6.7U1 and NetApp AFF A220 with Direct-Attached IP-Based Storage (DESIGN)

The Script Used to Prospect for NVAs:


[String]$DownloadFolder = "C:\NVAs\"
[String]$LogFilePath = "C:\NVAs\log.txt"
[Int]$RangeStart = 1000
[Int]$RangeEnd   = 1200
[System.Array]$Title = "","","",""

## Generic display function:
Function Wr{Param($P,$I="WHITE");Write-Host $P -ForegroundColor $I}

## Download the NVAs:
Import-Module BitsTransfer
For($i=$RangeStart; $i -le $RangeEnd; $i++){

  [String]$Title[1] = "nva-$i"
  [String]$Title[2] = "nva-$i-deploy"
  [String]$Title[3] = "nva-$i-design"
 
  For($t = 1;$t -le 3;$t++){
 
    [String]$WebUrl = ("https://www.netapp.com/us/media/" + $Title[$t] + ".pdf")
    [String]$SavePath = ($DownloadFolder + $Title[$t] + ".pdf")
   
    ## Get the header:
    $hdr = $NULL
    Try{$hdr = Invoke-WebRequest $WebUrl -Method Head}
    Catch{"Dead link: $WebUrl" | Out-File $LogFilePath -Append}
   
    ## If we have a header:
    If($hdr){
     
      ## Only download updated versions:
      $Download = $FALSE     
      If(Test-Path $SavePath){
        $SavedLRT = [DateTime]((Get-ChildItem $SavePath).LastWriteTime)
        $WebFileLRT = [DateTime]($hdr.headers."last-modified")
        If($WebFileLRT.Ticks -gt $SavedLRT.Ticks){
          [String]$OutputString = ("UPDATED: " + $Title[$t])
          $OutputString | Out-File $LogFilePath -Append
          Wr $OutputString GREEN
          $Download = $TRUE
        }else{
          [String]$OutputString = ("NO UPDATE: " + $Title[$t])
          Wr $OutputString
        }
      }else{
        [String]$OutputString = ("NEW D/LOAD: " + $Title[$t])
        $OutputString | Out-File $LogFilePath -Append
        Wr $OutputString GREEN
        $Download = $TRUE
      }
     
      ## Download:
      If($Download){
        Start-BitsTransfer -Source $WebUrl -Destination $SavePath
      }
     
    }else{
      Wr "DEAD LINK : $WebUrl"
    }
  }
}


Image: Discovery in Action

Monday, 21 January 2019

Disk Sanitization Time?

There’s not much information out there regards disk sanitization time, so I thought I’d share my experience. I had the privilege to sanitize an old NetApp FAS2040A system running ONTAP 7.3.6 with 12 x 600GB 15k RPM SAS disk drives.

There are a couple of KBs on this:

And there is this communities post with useful information:

These were the timings for a (to DoD/Department of Defense standard) -

disk sanitize start -c 3 DISK

- on 600GB 15k RPM SAS disks.

TIME = 9 hours  4 minutes and 22 seconds

From the> rdfile /etc/log/messages

Wed Jan 16 12:32:05 GMT [disk.failmsg:error]: Disk 0c.00.3 (...): message received.
Wed Jan 16 12:32:05 GMT [raid.disk.unload.done:info]: Unload of Disk 0c.00.3 Shelf 0 Bay 3 [NETAPP   X290_S15K7560A15 NA00] S/N [...] has completed successfully
...
Wed Jan 16 21:36:27 GMT [disk.sanit.complete:info]: Disk 0c.00.3 [S/N ...] has completed sanitization.


According to the communities post link above, you can run sanitize on up to 100 disks at a time. You’ll have to run it two times at least, since the root disks also need to be sanitized (4a/reinitialize the system on different set of root disks.) For this system it took 3 visits to site to complete the work (alas, remote access was not possible):

Day 1: Re-initialize and sanitize spare disks (cannot do root disks).
Day 2: Re-initialize and sanitize disks we couldn’t do before.
Day 3: Final checks (“disk sanitize status”) to confirm all disks are wiped.

Image: Hard Disk

Saturday, 29 December 2018

Burn USB Key PowerShell

Christmas bonus post...

For Christmas - amongst other things - I got 3 more Jamiroquai albums (I’ve got all 8 now) and also an Amazon Giftcard with which I purchased Anjunabeats Volume 13. So, I wanted to update my car music USB key, but needed to use a fresh USB key. I realized that the method of my 24th April 2018 post Using PowerShell to Create a Correctly Ordered USB Music Key was way too clunky, so came up with the following script.

You’ll need to copy all your music into a folder of folders first, and make sure it’s ordered how you want.

Image: Car Music folder

Then just run the PowerShell as in the below example:

.\BurnUSB.ps1 -SourcePath "D:\CAR MUSIC" -DestinationDrive F

And your USB key will be burned like a CD (since car music systems read USB keys like a CD, that is the first copied file is first in the playlist, second copied second, third copied third, etcetera.)

The Script


Param(
  [Parameter(Mandatory=$true)][String]$SourcePath,
  [Parameter(Mandatory=$true)][String]$DestinationDrive
)

[System.Array]$Folders = (Get-ChildItem $SourcePath | sort-object Name).Name

Foreach($Folder in $Folders){
  [String]$NewFolderPath = Join-Path ($DestinationDrive + ":") ($Folder)
  "New-Item -Path $NewFolderPath -ItemType directory"
  New-Item -Path $NewFolderPath -ItemType directory

  [String]$ReadFolderPath = Join-Path ($SourcePath) ($Folder)
  [System.Array]$MusicFiles = (Get-ChildItem $ReadFolderPath | sort-object Name).Name

  $MusicFiles | Foreach{
    [String]$FileToCopy = Join-Path ($ReadFolderPath) ($_)
    [String]$FileDestination = Join-Path ($NewFolderPath) ($_)
    "Copy-Item -LiteralPath $FileToCopy $FileDestination"
    Copy-Item -LiteralPath $FileToCopy $FileDestination
  }
}


Monday, 17 December 2018

End of Year 2018 Post (Happy New Year 2019!)

It’s been a bit of a quiet year on Cosonok’s blog. Including this post, I’ll have done 56 posts this year, which is a record minimum number of posts in a full year for Cosonok (61 posts in 2011 being the previous record minimum.) Still been busy though, with other blogs and a tiny bit of YouTube too.

Stats-wise, Cosonok’s blog appears to be in decline. Which is perhaps not surprising since prior to 2013 this was very much an IT generalists blog, but since 2013 it’s been predominantly NetApp, so more specialized and perhaps less reach. The stats, whilst fun, have never been the goal, it’s always about sharing hopefully useful stuff, an aid for my memory, and I’m always amazed and grateful that people read posts from this blog - and leave comments.

Image: Cosonok’s IT Blog Stats

All of the most viewed posts are from 2010/11/12 – which is not unsurprising – but what might be surprising is that the most viewed posts from the last month (November 16 to December 16, 2018) have 6 out of 10 posts from 2010/11/12.

Image: Top 10 Posts by Pageviews (All time)

Image: Top 10 Posts by Pageviews (last month)

I’m actually working over Christmas (except for the usual holidays and 24th) but this will be 2018’s final post. So all that’s left to say is:

Merry Christmas!

- and -

Happy New Year 2019!