Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Info
titleINFO

Datameer Spotlight gives organizations fast access and deep visibility into all of their enterprise data assets - whether in the cloud or on-premises - via a single unified self-service platform. With Datameer Spotlight business teams can discover, access, collaborate and analyze more data for faster, more trusted cloud analytics while eliminating complex data movement and maintaining strong governance.

Table of Contents

Datameer X Prerequisites

...

  • your Datameer X instance must be from version 7.4 or higher
  • your Datameer X cluster must be run in grid mode 
  • your Hadoop cluster/ HDFS must be configured to allow access to the data within the HDFS
  • the plug-in 'Datameer DWH API' (including two extensions) must be installed
    NOTE: Please contact the Datameer Service to receive the plug-in.
  • a job must be run at least once in Datameer X and also be kept
  • any data you wish to access through Spotlight must be in the 'Parquet' format (this has been the default format since Datameer 6.3)
  • your user must at least have the role 'ANALYST' to access the data

...

  • :
    • read-only access to the Datameer folders and files

Datameer X Running on Hadoop/ HDFS

The following prerequisites must be fulfilled from the Datameer Spotlight instance:

  • the Datameer X instance , must be reachable:
    • the REST API endpoint URL
    • user name
    • password
  • the Hadoop/ HDFS instance must be reachable:
    • the Hadoop-NameNodes
    , and
    • the Hadoop-DataNodes
    must all be reachable
  • this includes being able to resolve hostnames
  • all ports need to be accessible
    • Hadoop NameNode client port: normally 8020, 9000 or 54310
    • Hadoop DataNodes: normally 50010 and 50020

Datameer X Running on Amazon EMR/ S3

The following applies for running Datameer X von EMR/ S3:

  • Spotlight must be able to read the data files at the S3 folder/ file locations, provided by the Datameer DWH API:
    • access key/ secret must be known in the appropriate account that can read from Datameer X's internal storage bucket
    • have to be set as connection options when setting up the Datameer X connection