Install a Datameer X Enterprise clustered instance from Amazon Marketplace.

This guide steps through the requirements and process for installing Datameer X Enterprise from the Amazon Marketplace.

Overview

Datameer X is a cloud-native analytic lifecycle platform that enables the transformation of raw data into analytics-ready datasets—without hours of engineering time. It leverages the power of AWS EMR compute clusters to handle the scale, volume, and complexity of big data and heavy-duty enterprise workloads. Datameer's intuitive spreadsheet-like interface enables analysis of the raw data on-the-fly, while built-in connectors allow for easy integration of data from a variety of data sources - including S3 and Redshift.

Datameer X Enterprise, available in the AWS Marketplace, utilizes the AWS CloudFormation Template (CFT) for launching a Datameer X instance alongside relevant resources - VPC, Availability Zones, Subnets, ELB, Security Groups, Datameer X EC2 instances, EMR, S3 bucket.

Review the product information and pricing by visiting Datameer X Enterprise on AWS Marketplace.

Learn more about Datameer X for Amazon Web Services.

Follow the comprehensive Step-by-Step Guide to deploy Datameer X in your AWS account within a few minutes.

If you experience problems with launching via CFT, please contact Datameer X Support at support@datameer.com.

Prerequisites and Recommendations

Before you begin, review the End User License Agreement (EULA).

New to AWS? See Getting Started with AWS.

AWS Requirements

A valid AWS account is required for deploying Datameer X Enterprise with abilities to create VPC, Security Groups, S3, EC2 and EMR assets.
Familiarity with the stack creation process using CloudFormation Templates.
A basic understanding of the purpose and function of Amazon Elastic MapReduce (EMR).

Deployment and Integration Architecture

Planning Guidance

Security

By default CloudFormation uses permissions based on your user credentials to create, modify, or delete resources in the stack. Optionally, when configuring stack parameters, you can choose an IAM role to explicitly define how CloudFormation can manage stack resources. For more information see Controlling Access with AWS Identity and Access Management.

Datameer X Enterprise stack provides an option to enable secure access to the Datameer X instance via HTTPS (port 443). You will be required to provide security certificate that can be created via AWS Certificate Manager.

During the stack creation process you must specify a key pair name - name of an existing EC2 key pair to authorize SSH access to the instances. If you don't already have the key pair, refer to Amazon EC2 Key Pair documentation on how to create new key pair.

Once the stack is created and the Datameer X instance is launched, it can be accessed via the web browser using default credentials. See Accessing Datameer X Enterprise. By default the instance is not reachable via public Internet. This can be changed during the stack creation by enabling Auto-assign Public IP option.

Within the Datameer X application, user authentication and authorization can be handled via the Admin interface. Datameer X Enterprise offers both Internal User Management and Remote Authentication (Active Directory and LDAP) options.

Sizing

Datameer X Enterprise can be deployed on AWS using different types of EC2 instances. During the stack creation process you can select which type you would like to use for the Datameer X instance as well as for the creation of the EMR cluster. The following instance type families are supported for deployments:

M4/M5 Series - provides a balance of compute, memory, and network resources and is suitable for most data processing tasks and cluster computing.

C4/C5 Series - optimized for compute-intensive workloads and delivers a very cost-effective high performance at a low price per compute ratio. Recommended for batch processing, distributed analytics, high performance science and engineering applications.

R4/R5 Series - memory optimized, recommended for real time big data analytics.

For a complete list of EC2 instance types, visit Amazon EC2 Instance Types.

Various instance types offer different combinations of the number of vCPU per instance, memory, and network performance - this affects job execution/data processing in Datameer X Enterprise. For example, an EMR cluster of 6 instances using the recommended m4.4xlarge type (16 vCPU, 64GiB per instance) processes a medium workload of 1.5GB (100MM records) in approximately 10 minutes. Processing of the same workload can be expedited to ~6 minutes by doubling the infrastructure to 12 m4.4xlarge instances.

Note: An EMR cluster is created with a single "master" instance and x number of "worker" instances. When configuring your Datameer X stack, the "Number of EC2 instances in the EMR cluster" defines the number of "worker" instances. For example, leaving this setting with the default value of 2 will trigger creation of the EMR cluster with total of 3 instances of the same type (1 "master" and 2 "worker").

Costs

Datameer X Enterprise is offered with the 14-day free trial. During the trial period you will only be responsible for the AWS services and infrastructure costs.

After the trial period ends, Datameer X Enterprise is available at a fixed hourly price irrespective of the instance type or deployment region. The total cost of running Datameer X Enterprise on AWS is calculated as following:

Total Deployment Cost = Datameer X Enterprise Software Cost + AWS Services & Infrastructure Cost

The Datameer X CloudFormation Template exposes stack configuration parameters (e.g., instance type, number of EC2 instances in the EMR cluster) that you can customize. Some of these settings, such as instance type and the number of instances in the EMR cluster, will affect the total cost of the deployment. For AWS infrastructure cost estimates see AWS Pricing Calculator.

Browser not supported