Performing an ETL of Data from NetApp Cloud Insights

on

In this blog post, I go over using the REST API ODATA interface to acquire one table from the NetApp Cloud Insights DataWarehouse. Not really an ETL, but I couldn't think of a better title...

API Access

Firstly, we must generate an API Key. To do that, login to your NetApp Cloud Insights portal, and select:

ADMIN > API Access

Then click + API Access Token

And choose your options. For the sake of performing an ETL, we just need “Data Warehouse” and Read Only.

  • Name: YOUR-TOKEN-NAME
  • Description: A-DESCRIPTION
  • What type of APIs will this token be used to call? All Categories / Acquisition Unit / Alerts / Assets / Data Collection / Data Ingestion / Data Warehouse
  • Permissions: Read Only / Read/Write / Write Only
  • Token Expires In: 1 Week / 1 Month / 3 Months / 6 Months / 1 Year / Custom
  • No. of valid days:


For example:


Make sure to copy and store the token in a safe place -
Copy API Access Token
- your token will only be available once!


Performing an ETL of one DWH Table

- from Postman

2 Headers are required:

Content-type = application/json
X-CloudInsights-ApiKey = {The API Access Token you obtained above}

All requests will start with the url:

https://{tenant}.cloudinsights.netapp.com/rest/v1/dwh-management/odata/{schema}

The below image is an example where we pull dwh_inventory.storage. We have to add an additional key:

Accept = */*

https://{tenant}.cloudinsights.netapp.com/rest/v1/dwh-management/odata/dwh_inventory/storage

Image: Postman Acquisition of dwh_inventory.storage from NetApp Cloud Insights


Performing an ETL of one DWH Table

- using a Linux Client

demo@DESKTOP:~$

curl -X GET "https://YOURTENANT.cloudinsights.netapp.com/rest/v1/dwh-management/odata/dwh_inventory/storage" -H "accept: */*" -H "Content-Type: application/json" -H "X-CloudInsights-ApiKey: YOUR_VERY_LONG_API_TOKEN"

Image: Example



Comments

Post a Comment