Page Comparison

Upgrading the Database

From now on upgrading the database during an Datameer X X upgrade is executed automatically with the new upgrade tool which is available within the Datameer X X distribution installation folder. Therefore a compatible SQL connector jar file must be places.

The new upgrade tool creates a database dump before the upgrade automatically, validates the correct schema from the database, selects only the necessary upgrades in the correct order. The execution can be logged out via commend line.

MariaDB is also supported as an alternative to MySQL.

Retriggering of the Search Index

With Datameer X X v11, the search index is retriggered automatically.

Support for Cloudera CDH

Datameer X X now supports Cloudera CDH v6.3.2., CDH v7.0.3 and CDH v7.1.1.

Support for Amazon EMR

Datameer X X now supports Amazon EMR v5.28.1, EMR v5.29.0., EMR v5.30.0 and EMR v6.0.0.

Support for Hortonworks HDP

Datameer X X now supports Hortonworks HDP 3.1.4 and 3.1.5.

HBase Support

HBase 2.0 is now supported for Hortonworks HDP 3.1.0 and 3.1.4.

MapR Extension Package with MapR 6.3

Datameer X X now supports MapR Extension Package with MapR 6.3.

Google Cloud Storage as a Private Folder

The Google Cloud Storage can now be used with the Datameer X X Private Folder. This can be set up within the Google Cloud Dataproc connection.

Set up Google Cloud Dataproc on Datameer X X

Google Cloud Dataproc can now be used as an execution engine if it is deployed against a Google Cloud Platform 1.4 cluster.

Multi-Group Sharing Plug-In

Datameer X X provides with the /wiki/spaces/DASSB110/pages/20221232594 a new extension point that allows using Access Control Lists to setup file and folder permissions for different users and groups in the HDFS.

Set up Datameer X on EMR

Both, the cluster name as well as the ID are validated when saving the configuration to avoid errors later on.

New Housekeeping Service Property

For performance issues the new property 'housekeeping.run.task-attempts-per-run' was introduced and can be set in the 'default.properties' file. The property is set as '50' per default. Therefore Housekeeping does not run all tasks again but only those that need to run again.

UI Change in Admin Tab - Cluster Configuration

The former 'Hadoop Cluster' section in the 'Admin' tab was renamed to 'Cluster Configuration'.

Neebo JDBC Dialect Introduction

Datameer X X comes with the new Neebo dialect in the 'Database Driver's" section in the 'Admin' UI. Contact support@datameer.com to receive the JDBC driver to connect to Neebo.

Tableau Export as a Connection

Setting 'das.splitting.disable-combining=true' as a custom property will run Tableau export jobs significant faster. There is now a verification that an export of a sheet to a Tableau Server launches multiple tasks and not just one.

You can now select the authentication mode when configuring Tableau as a connector: 'Username/ Password' or 'Personal Access Token'.

Snowflake as a Connection

In Datameer X X, a connection to the Data Warehouse Snowflake can now be established.

Azure Cosmos DB as a Connection

You can now import and export by an Azure Cosmos DB connection.

Azure Databricks as a Connection

Importing from Azure Databricks is now implemented.

Importing Data with Amazon Athena Dialect

Datameer X X supports importing data with the Amazon Athena database dialect now.

Azure Data Lake Store Gen 2 as a Connection

You can connect to Azure Data Lake Store Gen 2. The connection can be build to an existing HD Insights Data Lake Store (ADL). Import as well as export can be executed.

Workbook Health Check

Datameer X X provides a new list with the release versions of the Workbook Health Check per version.

REST API Creating a Folder

A folder is created when creating or updating a connection, when all capabilities and permissions are sufficient.

REST API for Workbook Variables

Workbook variables can now be set via the REST API while executing a job.

REST API Lookups

The new REST API Lookups returns information about a referenced entity to an existing UUID.

REST API Job Commands

The response of the request 'List Active Jobs' contains all jobs that are from job status 'RUNNING' or 'QUEUED' now.

Setup and Installation

The page 'Custom Properties' is moved as a subpage of 'General Setup Information' and updated. The new page provides general information about custom properties and a how-to.

General Information on Connections

A user gets general information about creating/ deleting/ editing connections within this new documentation page.

Working with Workbooks

The general information documentation for the SQL function 'CAST' is moved as a subpage of 'Using SQL Sheets' which is a how-to documentation.

The general information documentation for 'Join Data' is split in 'Joining General Information' for providing general information and 'Joining Data' which is a how-to documentation.

The documentation for 'Hiding and Expanding Columns' within a workbooks, 'Removing Columns', 'Reordering Columns', 'Resizing Columns' as well as 'Splitting Columns' is moved to the /wiki/spaces/DASSB110/pages/20217740613 section.

The section 'Adding a Sheet' is now available on the documentation page 'Working with Sheets'.

Guide for Developers

Find the whole REST API documentation in a new design.

Glossary

New entries are added to the glossary: AES, CBC, DAS, NMU, Spark, AWS Athena, Teradata Aster, HSQL file, Neebo and UUID.