Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Info
titleINFO

Find behavior changes sorted by version here.

Release 10.1

Housekeeping 

SubjectNew housekeeping property
Behavior Change

Datameer X introduces the new property to configure the amount of deletion of file artifacts.

# Maximum number out-dated file artifacts that should be deleted from HDFS per housekeeping run
housekeeping.run.delete.outdated-file-artifacts=10000.
Versions Affected & Ticket Reference10.0/ 10.1 - DAP-39283

Hive Mapping 

SubjectImprove record encoding for Datameers big integer and big decimal to be Hive compatible
Behavior Change

Newly written and synced Parquet files are now compatible and readable by Hive.

Versions Affected & Ticket Reference10.0/ 10.1 - DAP-39367

Column Encoding 

SubjectColumns with very high cardinality have notification about one-hot-encoding
Behavior Change

Workbook columns with high cardinality now show a warning message in the encoding inspector.

Versions Affected & Ticket Reference10.1 - DAP-39545

Release 10.0

Hive Plugin

SubjectExport data mapping changes
Behavior Change

While export into existing tables Datameer`s BigInteger can also be exported to Hive`s BigDecimal.

Versions Affected & Ticket Reference10.0 - DAP-39147
SubjectAdded support to export into new unpartitioned table with different Hive output format
Behavior ChangeDatameer X now supports exports with selectable output format into a new unpartitioned table. You can select the output format in the export wizard.
Versions Affected & Ticket Reference 7.5/ 10.0 - DAP-38804

...

SubjectSupport FIXED, BYTES decimals for Avro file
Behavior ChangeDatameer X supports now 'fixed with logical type decimal' and 'bytes with logical type decimal' on Avro file import.
Versions Affected & Ticket Reference7.4/ 7.5/ 10.0 - DAP 39006

...

SubjectTake hadoop properties capability in account when overwriting configurations
Behavior ChangeYou can now overwrite the Hadoop properties if you have the capability to execute that. Datameer X provides a capability evaluation.
Versions Affected & Ticket Reference7.4/ 7.5/ 10.0 - DAP-38342

...