/
System Requirements

System Requirements

Feb 07, 2020

Datameer X Application Server

Recommended hardware for the production environment with a database on the same server as Datameer

Minimum:

  • 1U Server

  • 2 Quad Core CPUs

  • 16 + GB RAM

  • 2 x 1 TB Hard Drives (Recommended available disk space: 250 GB)

  • RAID - 0 striping

  • RAID - 1 mirroring

  • Dual 1GbE network

  • Redundant power

  • Failover requires a standby server with the same configuration

Recommended:

  • 1U Server

  • 2 Octa Core CPUs

  • 16 + GB RAM

  • 2 x 1 TB Hard Drives (Recommended available disk space: 250 GB)

  • RAID - 0 striping

  • RAID - 1 mirroring

  • Dual 10GbE network

  • Redundant power

  • Failover requires a standby server with the same configuration

Required Software:

  • Unix-based operating system (see Supported Operating Systems for more information)

  • Oracle Java 1.8
    or
    OpenJDK 8 (As of Datameer X 7.2)

    or 
    Amazon Corretto Open JDK (As of Datameer X 7.4)

  • Installed software: SSH, VI, MySQL 5.5, 5.6, 5.7 (server and client executables must be available via shell search path)
    As of Datameer X 7.4: MariaDB is supported as an alternative to MySQL.

  • Optional: SMTP server (for email notification)

Datameer X Database Server

The Datameer X database should be hosted on the same machine as the Datameer X application server. It can be located on a hosted database only if the response time for a full write to the database is less than 20 milliseconds. If during database maintenance the database response can't be guaranteed, you need to gracefully shut down the Datameer X service before maintenance. 

Hosted databases must use MySQL 5.5 or higher. The recommended size is a minimum of 5 GB. 
As of Datameer X 7.4: MariaDB is supported as an alternative to MySQL.

Hadoop cluster

  • One of the supported Hadoop Distributions installed (Datameer X installs Hadoop if it isn't already available)

  • Gigabit switches (10 GigE interconnected)

  • Sufficient power supply & cooling
     

The Hadoop distribution being used should be available to provide the Hadoop cluster design and sizing recommendations.

 Helpful links:

Hadoop master (NameNode and JobTracker)

Hardware:

  • 1U Server

  • 2 Quad Core CPUs

  • 32 + GB RAM

  • 2x1 TB hard drives

  • RAID - 0 striping

  • RAID - 1 mirroring

  • Dual 1GbE network

  • Redundant power

  • Failover requires a standby server with the same configuration

Software:

  • Unix-based system (e.g., Ubuntu Linux 10.04)

  • Java 1.8 (Oracle recommended)

  • Set JAVA_HOME to the root of your Java installation

  • Installed software: VI, SSH, SSHD, rsync, and SCP
     

2 Hadoop master nodes are required for HA (high availability) testing.