Page Comparison

Setting up Datameer X on HDP

When configuring Datameer X for Hortonworks HDP, the following properties need to be set in the Custom Properties section of the Hadoop Cluster page: 

hdp.version=<hdp version>
mapreduce.application.framework.path=/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#yarn
mapreduce.application.classpath=/usr/hdp/${hdp.version}/hadoop/conf:/usr/hdp/${hdp.version}/hadoop/lib/*:/usr/hdp/${hdp.version}/hadoop/*:/usr/hdp/${hdp.version}/hadoop-hdfs/:/usr/hdp/${hdp.version}/hadoop-hdfs/lib/*:/usr/hdp/${hdp.version}/hadoop-hdfs/*:/usr/hdp/${hdp.version}/hadoop-yarn/lib/*:/usr/hdp/${hdp.version}/hadoop-yarn/*:/usr/hdp/${hdp.version}/hadoop-mapreduce/lib/*:/usr/hdp/${hdp.version}/hadoop-mapreduce/*:/usr/hdp/current/hadoop-mapreduce-client/*

The hdp.version property value should reflect the exact version of the HDP Hadoop cluster Datameer X is connecting to. These properties are prefilled in the Hadoop Distribution Specific Properties section of the Edit Hadoop Cluster page.

Image RemovedImage Added

Anchor
spark spark

Setting Up HDP with Spark

When configuring Datameer X with Spark for Hortonworks HDP, the following properties need to be set in the Custom Properties section of the Hadoop Cluster page: 

...

The hdp.version property value should reflect the exact version of the HDP Hadoop cluster Datameer X is connecting to. These properties are prefilled in the Hadoop Distribution Specific Properties section of the Edit Hadoop Cluster page.

Anchor
hive hive

Setting Up HDP with Hive Server 1 or Hive Server 2

HDP 2.6 supports the use of Hive 1.2 and Hive 2.1.

Datameer's default HDP packaging supports Hive 2.1. In order to use Hive 1.2 with HDP 2.6, you need to download and install the HDP Datameer X artifact with he suffix "-hive1".

Administrators need to ensure they are selecting the correct Datameer X installation artifact when installing or upgrading Datameer.

...