Versions Compared

Old Version 6

changes.mady.by.user Juliane Wetzel

Saved on

compared with

New Version Current

changes.mady.by.user Juliane Wetzel

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

7.4.13 Release Notes

Bug Fixes

1

Property API: Keyup event for property info input fields of the Property API is not workingDAP-39015

Keyup event now triggers the same actions as for example a change event.

(tick) Bug fixed.

2

Cannot export Runtime Analytics sheets to HiveDAP-39472

Runtime Analytics sheets can be exported to Hive again.

(tick) Bug fixed.

7.4.12 Release Notes

Improvements

1

Add Support for CDH 6.3.2DAP-39657

Datameer now supports Cloudera CDH 6.3.2.


Bug Fixes

1

REST API to download results doesn't return all records by setting 'rest.download-data.records-max=0'DAP-39386

Datameer respects the setting 'rest.download-data.records-max=0' and provides all records for the download.

(tick) Bug fixed.

2

'Workbook' tab doesn't close after 'Close & Save' DAP-39417

After closing and saving a workbook, the 'Workbook' tab closes and the user is redirected to the 'File Browser' tab.

(tick) Bug fixed.

3

Hive string queryTemplate for SHOW PARTITIONS is incorrect DAP-39438

The string for queryTemplate now shows the required syntax using back-ticks for every single part of the Hive query.

(tick) Bug fixed.

4

Workbook config: false errors on correct CRON patternDAP-39458

Datameer now recognizes a valid CRON pattern and does not throw an error on a valid pattern erroneously.

(tick) Bug fixed.

5

Scheduled jobs remain indefinitely in the processing queue if the Kerberos password is changedDAP-39474

A scheduled job occurring between a Kerberos password change no longer blocks the processing queue.

(tick) Bug fixed.

6

Workbook: save dialog doesn't open when user selects 'Close & Save'DAP-39509

Closing a new workbook from the file browser now redirects to the workbook save dialog.

(tick) Bug fixed.

7.4.11 Release Notes

Improvements

1

Workbook validity reportDAP-39389

Datameer provides report that identifies workbooks missing data sources or other similar issues.


...

3

Add Support for CDH 6.3.1DAP-39462

Datameer now supports CDH 6.3.1.


Bug Fixes

1

Backup/Restore does not completely store all artifacts
DAP-39297

Even if there are broken artifacts, a backup continues and logs the broken files.


(tick) Bug fixed.

...

3

Add Support for CDH 6.3.0DAP-39169

Datameer now supports CDH 6.3.0.


Bug Fixes

1

Upgrade scripts are ignored when using Maria DB
DAP-39293

For a fresh installation, the optional_upgrade table in Datameer's metadata database now gets filled, therefore all included optional upgrades for the current Datameer version are set as expected.


(tick) Bug fixed.

...

7

Can't read DECIMAL from an Avro file
DAP-39006

Datameer now imports Avro data with primitive type bytes logicaltype decimal as BIG_DECIMAL in Datameer.


(tick) Bug fixed.


7.4.9 Release Notes

Improvements

1

Improve responsiveness of UI for customers with large number of job executionsDAP-39030

Querying very large tables for job executions could take seconds, rendering the file browser UI unusable. Datameer now has an index for the job_status column in the metadata database to speed information queuing and display.

...

4

Merge Google Big Query Connection and Import Plugin into Datameer 7.4DAP-39139

Datameer can now import data from Google BigQuery data sources.

Bug Fixes

1

Datameer can't recognise Int32 and Int64 Decimal values on a Parquet File Ingestion
DAP-39110

Datameer now can handle Parquet files containing Binary, Fixed, INT32 and INT64, as well as DECIMAL column types


(tick) Bug fixed.

...

1

Re-enable Save button on workbook toolbar

DAP-38960


Save button is available on the workbook toolbar, right next to Add Data icon


Bug Fixes

1

SAML: Upload Metadata File Button is inactive and metadata JSP missing
DAP-38975

Uploading and downloading metadata information works as expected.


(tick) Bug fixed.

...

4

Creating / Overwriting job configurations with REST v2 does not handle capability for 'Hadoop properties'
DAP-38342

REST v2 API now respects the capability settings for 'Hadoop properties'.


(tick) Bug fixed.

7.4.7 Release Notes

Epics

1

Add Support for HDP 3.1.0*DAP-38207

*Currently in preview mode.


...

2

Native Multiuser: Introduce configurable properties to determine Kerberos salt from LDAP attribute and default realmDAP-38755

Datameer now allows you to specify and configure the Kerberos salt authentication during job execution.
Define salt settings on the LDAP Authenticator and Hadoop Settings configuration pages.

Bug Fixes

1

Fixed Width File Import: Can't ingest more than 1000 characters.
DAP-38316

Datameer can now import a fixed width format file with more than 1000 characters. The maximum number of imported characters can be configured with an advanced option in the job-level property.


(tick) Bug fixed.

...

4

Hive plugin: Improve Help Texts and Error Messages for Partition Location HandlingDAP-38646

Help text and error messages for working with Hive partitions have been extended and improved.

Bug Fixes

1

Hiveserver 2 Plugin: "Create new if not exists" - Export Doesn't Fail as Expected if Schema of Existing Table Doesn't Fit
DAP-38738

An export job now fails as expected if the schema for the target table (column number, column names) doesn't match the export job's schema.


(tick) Bug fixed.

...

1

Workbook Security UpdatesDAP-38178

Introduce a System Property to Configure the Source Permission Evaluation in Workbooks

DAP- 38188

Introduce a Evaluation Unit That Checks Readability of Workbook SourcesDAP- 38189

Use a Security Property Based Evaluation Within the Workbook Overwrite APIDAP- 38190

Use a Security Property Based Evaluation Within General Workbook ResponsesDAP- 38191

Use a Security Property Based Evaluation Within Browser Listings of WorkbooksDAP- 38192

Use a Security Property Based Evaluation Within the Add Data Dialog of WorkbooksDAP- 38193

Improvements

1

Show the Tooltip If a Column Name Is Longer than the Column SizeDAP-34634

During the mapping step of import and export jobs, the column widths can't be adjusted. Now, if you hover over a column name that is too long to fit, a tooltip message is displayed.


...

6

Add Support for CDH 6.2.0DAP-38674

Support added for CDH 6.2.0

Bug Fixes

1

In Workbooks, the Recommendation Dialog for Column Validation Is Missing
DAP-38112

It is no longer possible to submit changes if there are invalid columns in a workbook.


(tick) Bug fixed.

...

1

Workbook Security UpdatesDAP-38178

Introduce a New System Property to Configure the Source Permission Evaluation in WorkbooksDAP- 38188

Introduce an Evaluation Unit That Checks Readability of Workbook SourcesDAP- 38189

Use a Security Property Based Evaluation Within the Workbook Overwrite APIDAP- 38190

Use a Security Property Based Evaluation Within General Workbook ResponsesDAP- 38191

Improvements

1

Set a Default "Error Handling Mode" / "How to Handle Invalid Data Strategy" Globally for All ExecutionsDAP-38145

  • New custom properties have been added. In the default properties you can now set the default ErrorHandling mode for all workbooks and export jobs and the default How to handle invalid data strategy for import jobs and data links.
  • Datameer administrators can now set their own default ErrorHandling mode and How to handle invalid data strategy for every artifact type.

...

3

Auto-Sort Source Data While Exporting into a Partitioned Hive Table

DAP-38508

Data is now automatically sorted via partitioned columns before an export job.


Bug Fixes

1

Duplicating a Sheet Doesn't Copy the Sheet Description
DAP-38020

When a workbook sheet is duplicated, the description is now copied.


(tick) Bug fixed.

...

7

The DESCRIBE EXTENDED Call to Hive Is Not Being Impersonated
DAP-38564

The correct delegation token is now being returned and DESCRIBE EXTENDED is correctly being impersonated.


(tick) Bug fixed.

7.4.3 Release Notes

Improvements

1

Change EMR Cluster SettingsDAP-38357

Users can now choose between EMR Cluster ID, EMR Cluster Name, or YARN Resource Manager to decide which is the host cluster.

Bug Fixes

1

Workbooks Failing with Unkept SQL Sheets
DAP-38431

Workbooks now no longer fail even if running when some sheets in the workbook aren't marked as kept.

(tick) Bug fixed.

...

15

The Preview Record View Changes While Moving a Column
DAP-33298

The preview record view is now kept and doesn't change while moving a column.

(tick) Bug fixed.

7.4.2 Release Notes

Epics

1

Hive Performance ImprovementsDAP-30302

Hive Data Link Wizard Time Reduction DAP-30226

Don't Cache All Partitions If Filtered Partitions Are Selected DAP-30017

 Improve Logging of Hive Cache for Data Links DAP-30010

Improve Wizard Step Performance DAP-29162

Disable the Logging to Improve Performance for the Hive Cache DAP-30317

Reduce Partition Parsing for Local Hive Partitions DAP-28760

Fetching Partitions Processed with Orc Table Have Very Poor Performance Due to Fetching All the Partitions Even When Filtered DAP-29902

Removed HiveImportJobModel.fileMatcher(Matcher) DAP-30397

Partitions from a Hive Partitioned Table  Are Being Read over and Over DAP-28971

Data Link on Partitioned Hive Performance Tweaking DAP-29977

Remove Info Logging on Caching from Hive Data Links DAP-30834

2

Adding Data to WorkbooksDAP-37598

Created a New Data Warehouse From Top Level "+" Plus Menu DAP-38022

Duplicate / Copy-paste / Backup-restore Wasn't Working for Data Warehouse Connections DAP-38200

JDBC Passwords No Longer Saved in Clear Text in the Meta Database DAP-38153

On Logout, the Push Down Filter Usage is Recorded in the Job.log DAP-38074

Created Workbook from DWH File Browser Context Menu DAP-37599

Now Possible to Create a Workbook from the Data Warehouse in the File Browser DAP-38149

Complete Coverage of Filter Push Down DAP-38000

Deleted Data Warehouse JDBC  Dialects That Don't Have Official Support DAP-38146

Use the Data Warehouse Driver on Open Connections DAP-38003

Verified Consistency Between the Driver in DataWarehouseEntity and DbDriverImpl DAP-38001

Now Possible to Configure a Data Warehouse Connection in File Browser Inspector. DAP-37447

Data Warehouse FileBrowser Integration DAP-37461

Corrected the "Driver Not Found Issues" When Providing the Driver via the Ui DAP-37976

The Data Warehouse Sheet Doesn't Handle Unused Columns DAP-38123

Fixed "Operation Not Allowed after Resultset Closed" Error in the Workbook DAP-38072

Null Pointer Exception When Duplicate a Data Warehouse Sheet DAP-38154

Redshift/MySQL - Reserved Word as Column Name Leads to an Error DAP-38121

Workbook UNDO Now Working Correctly With a Data Warehouse Sheet DAP-38180

Insert Data Warehouse Sheet after Creating a Data Warehouse sheet from the Top Level "+" Plus Menu DAP-38259

Dialogs Now Open Correctly in the Workbook for IE and Edge Browsers DAP-37598

A "Select Table" Dialog Has Been Added to the Workbook When Adding Data From a DatabaseDAP-37462

Created a New Data Warehouse Option from the Top Level "+" Plus MenuDAP-38022

...

6

Add Support for CDH 5.15.2DAP-38270

Support added for CDH 5.15.2


Bug Fixes

1

Hive Data Link Wizard Time Reduction
DAP-30226

The wizard for data link creation run a long time when the cache is created. This process was optimized to take less time.


(tick) Bug fixed.

...