Behavior Change

Behavior Change

INFO

Find behavior changes sorted by version here.

Release 10.1

Expanding Column Headers

Subject

Changed "Expand Column" behavior

Behavior Change

Selecting "Expand Column"/ "Expand All Columns" within a Workbook column now expands only the column headers to the maximum width and not the cell content anymore.

Versions Affected & Ticket Reference

10.1 - DAP-41783

Housekeeping 

Subject

New housekeeping property

Behavior Change

Datameer X introduces the new property to configure the amount of deletion of file artifacts.

# Maximum number out-dated file artifacts that should be deleted from HDFS per housekeeping run housekeeping.run.delete.outdated-file-artifacts=10000.

Versions Affected & Ticket Reference

10.0/ 10.1 - DAP-39283

Hive Mapping 

Subject

Improve record encoding for Datameers big integer and big decimal to be Hive compatible

Behavior Change

Newly written and synced Parquet files are now compatible and readable by Hive.

Versions Affected & Ticket Reference

10.0/ 10.1 - DAP-39367

Column Encoding 

Subject

Columns with very high cardinality have notification about one-hot-encoding

Behavior Change

Workbook columns with high cardinality now show a warning message in the encoding inspector.

Versions Affected & Ticket Reference

10.1 - DAP-39545

Release 10.0

Hive Plugin

Subject

Export data mapping changes

Behavior Change

While export into existing tables Datameer`s BigInteger can also be exported to Hive`s BigDecimal.

Versions Affected & Ticket Reference

10.0 - DAP-39147

Subject

Added support to export into new unpartitioned table with different Hive output format

Behavior Change

Datameer X now supports exports with selectable output format into a new unpartitioned table. You can select the output format in the export wizard.

Versions Affected & Ticket Reference

7.5/ 10.0 - DAP-38804

Parquet Import

Subject

Enabled support of Parquet files containing binary, fixed, int32 and int64 DECIMAL column types

Behavior Change

The import of Parquet files has now enabled supporting INT32 and INT64.

Versions Affected & Ticket Reference

7.4./ 7.5/ 10.0 - DAP 39110

Avro Import

Subject

Support FIXED, BYTES decimals for Avro file

Behavior Change

Datameer X supports now 'fixed with logical type decimal' and 'bytes with logical type decimal' on Avro file import.

Versions Affected & Ticket Reference

7.4/ 7.5/ 10.0 - DAP 39006

Workbook Info Dialog

Subject

Workbook Info dialog removed

Behavior Change

The 'Workbook Info' dialog is removed. The reference sheets and data source sheets have their reference shown in the corresponding sheet inspector now.

Versions Affected & Ticket Reference

10.0 - DAP-38689

Workbook Inspector

Subject

Enable list of formulas used by a formula sheet

Behavior Change

Since the 'Workbook Info' dialog is removed, you can find the list of formulas used by a formula sheet in the 'Sheet Inspector' in a collapsable panel now.

Versions Affected & Ticket Reference

10.0 - DAP-39102

Workbook Columns

Subject

Column names can be case sensitive

Behavior Change

Column names can now have the same names but different capitalisations, e.g. 'Foo', 'foo', 'FoO'.

Versions Affected & Ticket Reference

7.2/ 7.4/ 7.5 - DAP-38825

Subject

Document controllable Join column transpose

Behavior Change

You can now configure if join columns should be transposed to the front of the join sheet.

Versions Affected & Ticket Reference

10.0 - DAP-30214

Subject

Case-sensitive column names in workbook can be used in all sheet types

Behavior Change

All case-sensitive column names in a workbook can be used in all sheet types.

Versions Affected & Ticket Reference

7.5/ 10.0 - DAP-38825

Job Configuration

Subject

Take hadoop properties capability in account when overwriting configurations

Subject

Take hadoop properties capability in account when overwriting configurations

Behavior Change

You can now overwrite the Hadoop properties if you have the capability to execute that. Datameer X provides a capability evaluation.

Versions Affected & Ticket Reference

7.4/ 7.5/ 10.0 - DAP-38342

New Property

Subject

Document usage of 'das.cluster.plugin.resources.fixer.enabled'

Subject

Document usage of 'das.cluster.plugin.resources.fixer.enabled'

Behavior Change

A new property to mitigate YAN-3591 and YARN-6641 is introduced: 'das.cluster.plugin.resources.fixer.enabled'.

Versions Affected & Ticket Reference

10.0 - DAP-38032