Versions Compared

Version Old Version 5 New Version 6
Changes made by

Juliane Wetzel

Juliane Wetzel

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Info
titleINFO

Within these release notes Datameer X provides information and resolutions on improvements, bug fixes, and visual changes for 11.1.x maintenance release versions.  

Visit Datameer's Help Center for additional information or contact your customer service representative. 

Table of Contents

Section

Datameer X 11.1.4

Improvements

1

Workbook: Provide an option to cancel the 'Repoint Sheet' dialog.DAP-42003

You can now cancel the 'Repoint Sheet' dialog after first applying a formula and then saving the sheet name. The applied formula is also being reset after cancelling the dialog.



2REST API v2: Keep column style for a Workbook with Duplicate/ Copy/ PasteDAP-41786

A Workbook's column style is applied after duplicating, copying/ pasting a Workbook.


Bug Fixes

1

Workbook: Workbook still appears in the tab bar after closing the WorkbookDAP-42027

After closing a Workbook, the associated Workbook tab is being closed  in the tab bar as well. 

(tick) Bug fixed.


2

Import: JSON import - Datameer ignores the first array objectDAP-41996

All arrays of the JSON file are being imported. With the 'include root array' property, Datameer parses the whole array including the first object also. In general when importing JSON: If a JSON file contains a 'root array', means the first level if the data structure is a JSON array (file starts with [...]), the 'include array' checkbox has to be checked during the import wizard. If a JSON file contains an object in the first level and a nested data structure contains an array for the data ingest (file starts with {...[...]...}), the 'include root array' must not be checked. Then the JSON path to the 'target array' for the data ingest must be entered into the textbook during the import wizard. 

(tick) Bug fixed.


3

Datameer Distributions: Azure Blob Storage Connector - Packaging issuesDAP-41979

After updating the core libraries, the Azure Blob Storage connector is working as expected again. 

(tick) Bug fixed.


4In-product documentation: Wrong documentation link for 'New Connection'DAP-41944

A user who wants to find out about more information about the 'Data Types' during the 'New Connection' workflow, is now directed to the correct public documentation page. (tick) Bug fixed.


5Import: 'Create new import/ data link' - slow wizard loadDAP-42072

After optimizing the database query, the wizard for creating a new import job/ data link is working as quick as expected again.(tick) Bug fixed.


6Workbook: Formula parser throws the StackOverflowError while trying to digest a huge nested 'IF' expressionDAP-42051

After changing a JVM parameter that is responsible for the set of the nested functions, the formula parser doesn't throw the exception furthermore. (tick) Bug fixed.


7REST API v2: When a connection is injected or restored, the File Browser is not updatedDAP-41831

After injecting or restoring the connection, the File Browser is updated and the connection is immediately visible now.(tick) Bug fixed.



Section

Datameer X 11.1.3

New Features

1

Supported Hadoop Distributions: Add support for Google Dataproc version 1.5DAP-40353

Datameer X now supports Google Dataproc version 1.5.


Improvements

1

Supported Hadoop Distributions: Add support for Cloudera Private Cloud/ Cloudera Runtime 7.1.6DAP-41823

Datameer X now supports Cloudera Private Cloud/ Cloudera Runtime 7.1.6.



2Admin Plug-ins: ‘plugin-tez’ - Upgrade to TEZ 0.10DAP-41279

After a plug-in patch, the 'plugin-tez' plug-in is now available for Datameer X distributions again.


3Properties: AWS S3 http client max pool size should be configurableDAP-41912

The default maximum connection execution amount is now set to 100. With custom properties, you can change this amount to a higher or lower number. The custom count can also be set via Hadoop property in the cluster settings. 


4Workbook: Create Toolbar button to auto-expand all column width to make all column names visibleDAP-41603

Datameer has now a new toolbar button to expand all column width to make all column names fully visible.


5Workbook: Formula sheet repointingDAP-41549

When changing a formula sheet that points to another sheet, Spectrum now detects this changes and displays a dialog: The user can apply the changes to only the current column or to all columns. This dialog is only displayed, when when more than one column is affected. 


6Workbook: validate join sheet creation and provide supportive error messagesDAP-40809

If one is trying to create an invalid join definition, the join validation will give the user a hint why the join can not be created in a warning dialog.

Bug Fixes

1

Workbook: Parquet format - Ingesting creates duplicate 'das' metadata columnsDAP-41874

When ingesting a Parquet file into Datameer by a File Upload, Import Job or Datalink, there will be no more duplicated columns displayed in the tab "Define Fields". 

(tick) Bug fixed.


2

Snowflake Export: Tables are not updating when selecting another schemaDAP-41721

When configuring a Snowflake export or import job, the tables are now updated when changing the schema from the drop-down.

(tick) Bug fixed.


3

Workbook synchronisation: Sheet synchronization - Validation error is still showing even after update DAP-41476

After a formerly incorrect formula has been changed into a valid formula, the validation error is no longer displayed. 

(tick) Bug fixed.


4File Browser: Remove the 'Import Job' tab from the tab bar after the job has been deletedDAP-41635

The 'Import Job' tab is now deleted from the tab bar and is no longer displayed, after the job has been deleted. (tick) Bug fixed.


5File Browser: Job status tooltip for queued jobs is missing position informationDAP-41244

The tooltip now shows the position information for the queue status of a job, e.g. position 2 of 5 queued jobs.(tick) Bug fixed.


6Workbook: Active state of the 'encode column' button is brokenDAP-41317

When the 'Encode Column' view in the Workbook Inspector is enabled, the button is in an active state.(tick) Bug fixed.


7FileBrowser: Right-click in an empty area opens the Browser context menu instead of the Folder Tree context menuDAP-41652

Right-clicking in an empty area within the File Browser under the Folder Tree now opens the Folder Tree context menu.(tick) Bug fixed.


8Workbook Inspector: Encoding inspector fly out always shows "Empty Value"DAP-41722

The fly out within the encoding section in the Workbook Inspector now shows the correct value for the different chars.(tick) Bug fixed.


9Upgrading Datameer X: Datameer X stops serving HTTP requests and returns 504 Gateway timeout errorsDAP-41889

After a new fixed release, no more freezes happen and Datameer X works as expected after the upgrade.(tick) Bug fixed.


10Upgrading Datameer X: Upgrade scripts breaks at the ‘Drop Sink Data Table’ step - ‘A foreign key constraint fails’DAP-41955

The upgrading script has been updated to let the Datameer X upgrade work as expected.(tick) Bug fixed.


11Workbook: Fx function in Workbook is not case sensitiveDAP-41992

Selecting a Fx function in a Workbook highlights the function in the Sheet Inspector with upper or lowercase or mixed letters(tick) Bug fixed.


12Workbook: FilesystemRestController#moveFolder causes an endless loopDAP-41989

No endless loop of error messages is caused anymore when moving folders. When trying to move a folder into its own subfolder, an error message is displayed. (tick) Bug fixed.


13Connections: Snowflake - Jobs using the Snowflake connection are failing & exports are failing as wellDAP-41951

After fixing the Snowflake plug-in, the connections are working as expected and exports can be executed as expected.(tick) Bug fixed.


14REST API: JobExecutionRestControllerV2 does not release the EntityManagerDAP-41922

The REST API for job execution is working as expected again. Jobs can be triggered and stopped with REST API commands.(tick) Bug fixed.


15Workbook: SQL sheet - 'COUNT'/ 'SUM'/ 'AVG'/ ... (DISTINCT) aggregates are not supportedDAP-41878

Aggregates with DISTINCT quantifier work again in SQL sheets. Furthermore multiple DISTINCT aggregates in a single SELECT command on the same column are supported while multiple DISTINCT aggregates with multiple different columns are not supported.(tick) Bug fixed.


...

Section

Datameer X 11.1.2.3

Improvements

1

Admin Plug-ins: ‘plugin-tez’ - Upgrade to TEZ 0.10DAP-41279

After a plug-in patch, the 'plugin-tez' plug-in is now available for Datameer X distributions again.



...

Section

Datameer X 11.1.2.2

Bug Fixes

1

Upgrading Datameer X: Upgrade scripts breaks at the ‘Drop Sink Data Table’ step - ‘A foreign key constraint fails’DAP-41955

The upgrading script has been updated to let the Datameer X upgrade work as expected.

(tick) Bug fixed.


...

Section

Datameer X 11.1.2.1

Bug Fixes

1

Upgrading Datameer X: Datameer X stops serving HTTP requests and returns 504 Gateway timeout errorsDAP-41889

After a new fixed release, no more freezes happen and Datameer X works as expected after the upgrade.

(tick) Bug fixed.


2

Workbook: SQL sheet - 'COUNT'/ 'SUM'/ 'AVG'/ ... (DISTINCT) aggregates are not supportedDAP-41878

Aggregates with DISTINCT quantifier work again in SQL sheets. Furthermore multiple DISTINCT aggregates in a single SELECT command on the same column are supported while multiple DISTINCT aggregates with multiple different columns are not supported.

(tick) Bug fixed.



Section

Datameer X 11.1.2

Improvements

1

Supported Hadoop Distributions: Add support for Cloudera Private Cloud/ Cloudera Runtime 7.1.5.14DAP-41578

Datameer X now supports Cloudera Private Cloud/ Cloudera Runtime 7.1.5.14.



2

Upgrading Datameer X: Upgrade process - 'database.sh' script should print the details of its executionDAP-41882

The 'database.sh' script now contains the status of the database upgrade, when executed. Furthermore, the location of the backup which is created by script has changed. Now the full path to the database file is displayed. Also there are additional entries in the 'database-tool.log' file.



3

Housekeeping: Housekeeping: Data entity should store owner to enable Housekeeping to remove HDFS items even if associated job has been deleted alreadyDAP-41288

Housekeeping has no longer issues in removing HDFS items even if an associated job has already been deleted. Data from where the job configuration has already been deleted is cleaned up successfully without falling back to the system user. The 'data.owner' field receives the value of the current owner of the job configuration.


Bug Fixes

1

Workbook: Workbook toolbar buttons are not working when using them in the Internet ExplorerDAP-41864

The Datameer X Workbook toolbar now works with Internet Explorer.

(tick) Bug fixed.


2

Export: Amazon Redshift (Fast Load) export is dropping recordsDAP-41838

The data export into Amazon Redshift (Fast Load) is working correctly again.

(tick) Bug fixed.


3

Workbook: Workbook toolbar buttons are not working when using them in the latest Chrome versionDAP-41836

The Datameer X Workbook toolbar now works with Chrome version 89.0.4389.90 (Official Build) and newer.

(tick) Bug fixed.


4

Execution Engine: Datameer X on Amazon EMR/ Google Cloud Platform - Failed to activate the plug-in 'plugin-dwh'DAP-41816

Since 'plugin-doh' is a conductor-only plug-in, it is not being copied to the cluster anymore and does not impact any job execution.

(tick) Bug fixed.


5

User Interface Login: Intermittently login page is not refreshing after a successful loginDAP-41633

The correct login is working in all browsers for SAML, internal authentication as well as for external authentication (LDAP).

(tick) Bug fixed.


...

Section

Datameer X 11.1.1.2

Bug Fixes

1

Workbook: Workbook toolbar buttons are not working when using them in the Internet ExplorerDAP-41864

The Datameer X Workbook toolbar now works with Internet Explorer.

(tick) Bug fixed.


2

Workbook: Workbook toolbar buttons are not working when using them in the latest Chrome versionDAP-41836

The Datameer X Workbook toolbar now works with Chrome version 89.0.4389.90 (Official Build) and newer.

(tick) Bug fixed.


...

Section

Datameer X 11.1.1

New Features

1

Supported Hadoop Distributions: Add support for Amazon EMR 6.2.0DAP-41575

Datameer X now supports Amazon EMR 6.2.0.



2Supported Hadoop Distributions: Add support for Amazon EMR 5.32.0DAP-41574

Datameer X now supports Amazon EMR 5.32.0.


Improvements

1

Upgrading Datameer X: Improved upgrading process

DAP-41750 / DAP-41749 /
DAP-41697 


Datameer X has now an improved upgrading process for new upgrades.



2

Workbook: Auto-expand column header during "column edit" if the column name is partly invisibleDAP-41677

When renaming a column, the column width is now expanded fully visible without any truncation.



3

Upgrading Datameer X: Schedule out of order upgradesDAP-41626

The upgrade tool is now upgrading out of order upgrades to e.g. schedule new schema versions which have a lower value than the current one.



4

Supported Hadoop Distributions: Enable Apache Hadoop 2.8.5 supportDAP-41451

Datameer X now supports Apache Hadoop 2.8.5, also with Hive 2.3.8 as well as HBase 1.4.13.



Bug Fixes

1

Export: Snowflake - Export jobs failing with exceptionDAP-41557

Snowflake export jobs run successfully again after fixing the plug-in.

(tick) Bug fixed.


2

File Browser: Dependencies View artifact loses its color after selecting/ deselectingDAP-41322

In the Dependencies View a selected and then deselected artifact does not change the color to grey anymore.

(tick) Bug fixed.


3

Import: Amazon EMR - Import partitioned data link from S3 does not workDAP-40340

The data link from S3 is now working again as expected.

(tick) Bug fixed.


4

Documentation: Documentation URL should point to public spaceDAP-41713

The public user docs are now available on 'https://datameer.atlassian.net/wiki/display/DAS110'.

(tick) Bug fixed.


5

REST API v2: Remove save dialog when closing a WorkbookDAP-41730

After restoring a Workbook with REST API v2, closing that Workbook in the File Browser does not trigger the 'Save' dialog anymore.

(tick) Bug fixed.


6

File Browser Inspector: Config tab - Missing information for File UploadsDAP-41623

In the File Browser 'Config' tab, the information that scheduling is not supported for Connections and File Uploads is displayed.

(tick) Bug fixed.


7

REST API v2: Rest call leads to an illegal state exceptionDAP-40157

All entities are running in a row again, without any exceptions.

(tick) Bug fixed.


...