Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Datameer's release notes provide information and resolutions on Datameer's release notes provide information and resolutions on improvements, bug fixes, and visual changes for 7.1.x maintenance release versions.  

...

7.1.7 Release Notes

Improvements

1

Add support for MapR 6.0.1 along MEP 5.0
Upgrade Parquet to 1.8.3DAP-36793Support added for MapR 6.0.1 along MEP 5.0.

2

Back Port Redshift to 7.1 (Include Dependencies)DAP-37105
  • Export to S3 under Local, SmallJob, and Tez execution engines.
  • Export to Redshift.
337498

Datameer has upgraded to the more stable Parquet 1.8.3

2

Show User a Warning If the CSRF Token Is Expired - AJAXDAP-36969

  • If the CSRF token is expired/invalid an error message is displayed.
  • The option to cancel was added.
  • Datameer differentiates between handling between HTML and AJAX posted requests.

3

Show User a Warning If the CSRF Token Is Expired - HTML FormDAP-37041

  • If the CSRF token is expired/invalid an error message is displayed.
  • Datameer differentiates between handling between HTML and AJAX posted requests.
  • Users can now force to reach the page by using the URL  http://localhost:8100/general/invalid-session  or on invalidating the CSRF token between wizard pages jumps.

Datameer has upgraded to the more stable Parquet 1.8.3

4

Add Support for CDH 5.14.154DAP-3718337374

Support added for CDH 5.1514.4.Create CSRF Tokens Per RequestDAP-36910

REST API authentication now requires CSRF token when authenticating with session cookies.

5

Optimize the Creation of FileDescriptors During Index CreationDAP-36998
  • An IndexCreation benchmark now exists.
  • The metrics before and after optimization exist for EMR and MapR.
  • UHC tests the code and reports if the creation of the large index is stable and fast.

6

Add Snowflake Plug-in to Official Datameer ReleaseDAP-37121
Snowflake plug-in added to the official Datameer release.

7

Upgrade Plug-in Tensorflow to Use TensorFlow 1.7DAP-36948

The TensorFlow plug-in now supports TensorFlow 1.7.

8

Add Support for HDP 2.6.5DAP-37102

Support added for HDP 2.6.5

9

Upgrade Parquet to 1.8.3DAP-37498

Bug Fixes


1

Session TrappingDAP-22900

The session identifier always changes after a users successfully logs in.

(tick) Bug fixed.

2

Copying a String Values in the File Browser with CMD-C FailingDAP-34226Command CMD + C no longer blocked when selecting text.

(tick) Bug fixed.

3

Disab ling Partitioning on an Import Job or a Data Link Breaks the WorkbookDAP-36581

The workbook now shows the preview of the unpartitioned workbook and the partition button is disabled.

(tick) Bug fixed.

4

  Sort ing on a Real Time Analytics Sheet Doesn't Show Sorted Records in the PreviewDAP-36602

Sorted records are now shown correctly in the preview.

(tick) Bug fixed.

5

When a SQL Query is Incomplete in a Workbook There Is an Error on the Referenced SheetDAP-36622

The data source now correctly shows no error when a SQL query has been started but is not yet finished.

(tick) Bug fixed.

6

The Multiline Editor of a Workbook Is Empty When Users Try to Delete a DatasourceDAP-36730

The multiline editor now shows the correct formula as is no longer empty.

(tick) Bug fixed.

7

Workbooks Fail With a java.lang.IllegalArgumentException: Can Not Create a Path From an Empty StringDAP-36752

Parquet splits are now converted to FileSplit instances avoiding mixed types in GenericCombinedSplit.

(tick) Bug fixed.

8

Analyst Users Can't Change the Description of a Shared EntityDAP-36765

If a file is shared through view and edit, "others" can change the file's description via the browser inspector.

(tick) Bug fixed.

9

Partitioned Export Jobs Lead to Inconsistent Data in Negative Validation Cases with Hive 2DAP-36809

The expected data is now exported into Hive tables.

(tick) Bug fixed.

10

The Workbook Inspector Doesn't Adapt to a Browser's Resize Feature. Also, Clear and Add to Formula Buttons Are HiddenDAP-36817A browser's resize feature works correct with the workbook inspector and "Clear" and "Add to Formula" buttons are visible.

(tick) Bug fixed.

11

The In-place Filter on RTA Sheets Is Not Available after Duplicating the WorkbookDAP-36827

The in-place filter is now available on the RTA sheet after duplication.

(tick) Bug fixed.

12

It Isn't Possible in RTA to Drill When the Color-axis Value Is "None" For the Binned Date DAP-36869Drilling in RTA now working as expected.

(tick) Bug fixed.

13

There Is a Missing Loading Data Dialog When Switching Sheets the First Time in an Existing WorkbookDAP-36987

Loading dialog is now displayed.

(tick) Bug fixed.

14

Java.Lang.Stackoverflowerror Exception While Processing of GROUPBYGAPDAP-36995

GROUPBYGAP is now working as expected without errors.

(tick) Bug fixed.

15

Uninstallation of Runtime Analytics Plug-in FailsDAP-37011

Installation, uni nstallation, and configuration of the plug-in works without error.

(tick) Bug fixed.

16

A Label Is Present When No Data Point Is in a Line ChartDAP-37025

Labels are now only present where there are data points.

(tick) Bug fixed.

17

A 500 Error on Deinstallation of Plug-ins Isn't Handled By the UIDAP-37027

Errors are now handled by the UI code and a message is shown to the user.

(tick) Bug fixed.

18

Regression in Copy and Duplicate Functionality - Nested Dependencies Are Not Being UpdatedDAP-37044All references to subfolder artifacts are updated to point to the new copy when c reating a duplicate or copy of a folder structure

5

Avoid Flash Message in Case of Http-403 ErrorDAP-37472

The common CSRF-Token dialog is displayed for a 403-error. This improvement was made as a message is already displayed if the CSRF token has expired.


Bug Fixes

1

User Role Name Can't Be a Blank Space
DAP-31822

Users can no longer save a blank space as a valid username.


(tick) Bug fixed.

2

Admin Mail Server Settings: Missing Asterisk (*) on Required Fields
DAP-32535

All required fields for setting up admin mail server settings have an asterisk.

(tick) Bug fixed.

3

Analyst Role Can Change Ownership of Files with the REST API But Not UI
DAP-32715

Users now have the ability to change ownership of an artifact from the role of Analyst made consistent throughout the product by adding the ability to the UI.


(tick) Bug fixed.

4

Column Name Shows up Twice after Removing Another Column Name
DAP-34628

  • Column names are no longer duplicated after removing a previous column.
  • '1' is added to a column name when a column with same name is present after the previous column was deleted.

(tick) Bug fixed.

5

The Conductor.sh --profile-memory Isn't Creating Memory Profiling Snapshots
DAP-34913

A created snapshot now contains object allocation information. (snapshots are located in user home folder /Snapshots)


(tick) Bug fixed.

6

When Duplicating a Sheet with Formulas, References to the Original Sheet Remain in the Formulas of the New Sheet
DAP-36743

Now when copying sheets with formulas, the formulas with references to the sheet being copied are renamed on the new sheet to have the name of the new sheet.


(tick) Bug fixed.

7

Exports Fail on Kerberos Secured Impersonated Environment From HiveServer1
DAP-36787

Exports to Hive over a HiveServer1 connection on Kerberos Secured Cluster with impersonation are now able to create new table and export data.


(tick) Bug fixed.

8

There Is Meaningless Error Dialog When Users Add an Import Job with No Data into a Workbook
DAP-36823

Error dialog no longer displayed.


(tick) Bug fixed.

9

Error When Opening a Datasource Sheet Based on an Empty Partitioned Import


DAP-36824

  • Error message no longer displayed.
  • Status bar message is now consistent for a sheets between initial workbook load and switching to the sheet.
  • For sheets with empty (no data) partitions selected, the status bar renders a link to open the partition selection dialog.

(tick) Bug fixed.

10

Error While Processing a Workbook When One of the Partition Fields Is Left Blank
DAP-36871

The OK button is now disabled in the partition of sheet dialog if not all fields are configured.


(tick) Bug fixed.

11

Sheet Rename Breaks the Layout When an Empty Column Is Hidden
DAP-36873

The layout no longer breaks.


(tick) Bug fixed.

12

Worksheet Status Bars Shows Inconsistent an Message for the Same Sheet with an Error
DAP-36923

  • Sheet status bars now show consistent messages and colors.
  • Sheets with errors don't display the "Run Workbook" message or link.

(tick) Bug fixed.

13

SQL Sheets: No Error Shown When a Dependent Sheet Has a Column Error
DAP-36997

The SQL sheet is now in error state (red) when creating from a formula sheet with an error.


(tick) Bug fixed.

14

Error in js Console on the Details Page When "Rerun Migration" Is Available
DAP-37014

  • No longer an error in the js console.
  • No longer displaying the partition pie chart when a migration job fails.

(tick) Bug fixed.

15

 TopN Sort Functionality Doesn't Work on Visual Explorer Sheets
DAP-37036

TopN sort works correctly in Visual Explorer worksheets.


(tick) Bug fixed.

16

Show Detailed Information in Case of a Non-2xx Response in Visual Explorer
DAP-37047

  • An error dialog is displayed when opening Visual Explorer with a timed out session.
  • Error dialog isn't displayed when:
    • Users click on "Drill" context menu with a timed out session.
    • Users click on Undo/Redo buttons.
    • Users select a chart in the Chart Previews dialog
  • Error message says "401 Unauthorized".

(tick) Bug fixed.

17

Dependencies for Files in the File Browser Aren't Updated When Copy/Pasting a Folder Within the Root Folder
DAP-37096

Dependencies now update when copy/pasting a folder within the root folder to somewhere else in the root folder.


(tick) Bug fixed.

18

An Error Message Overlaps with the Inspector When Resizing the Browser or On a Small Screen
DAP-37109

Error message no longer can overlap the inspector.


(tick) Bug fixed.

19

Export Jobs Based on the Hive1 Connector Don't Have the Replacement_policy Property Added after a 6.1 -> 7.1 Upgrade
DAP-37168

Upgrade exports older than version 7.1 now migrate the old overwrite flag for HiveServer1 and HiveServer2 connections based the export job to replacement_policy.


(tick) Bug fixed.

20

Compaction Jobs Possibly Corrupting Source Data
DAP-37174

Issue resolved, compaction now working as intended.

(tick) Bug fixed.

21

License Upload in UI Isn't Secured by CSRF Token
DAP-37194

License uploads now secured by CSRF token in the UI.


(tick) Bug fixed.

22

The Info Dialog When Visual Explorer Can't Open Still Shows "Run Workbook" Button
DAP-37217

  • The dialog now shows a detailed message provided with the exploration status by either:
    • displaying the reason provided by the exploration status.
    • displaying a universal (neutral) message and has a collapsible section with a detailed message.
  • The "Run Workbook" button is only enabled when a workbook run fixes the missing requirement (e.g., no data available).

(tick) Bug fixed.

23

Infographic Charts Are Missing the Context Menu when Right Clicking
DAP-37227

The context menu now pops up with a right click for both empty and populated infographic charts.


(tick) Bug fixed.

24

Folder Copy and Duplication Feature Doesn't Update the Data Source for Infographics
DAP-37250

Using the copy or duplicate feature on a folder that contains all artifacts now updates all references in an infographic to use the new copy of the data source.


(tick) Bug fixed.

25

Post 7.1.5. Upgrade: Can't Submit Any Job Due to Java.Lang.OutOfMemoryError: Java Heap Space
DAP-37277

OutOfMemoryError problem has been corrected.


(tick) Bug fixed.

26

Adding Missing ID for Cascade Permission Dialog
DAP-37280

IDs have been added for the cascade permissions dialog.


(tick) Bug fixed.

27

TDE Export: Make the Temporary File Location Configurable
DAP-37284

  • The location where temporary TDE files should be stored is configurable via the properties file:
    • das.tde-export.temp-location=/path
  • If a property isn't set, the default system property  java.io.tmpdir is used.

(tick) Bug fixed.

28

Session Timeout: Login Redirection
DAP-37319

When logging in to Datameer, the session refreshes to ensure correct authentication procedures.

(tick) Bug fixed.

29

Remove Folder Group Permissions with the "X" Button in the Inspector Doesnt Work
DAP-37321

Removing group permissions for folder via x button works as expected.


(tick) Bug fixed.

30

Due to Broken Logic, upgrade_db.sh Isn't Reading default.properties
DAP-37327

The script now reads the default.properties correctly so users don't have to specify cli arguments if they have already configured their default.properties file.


(tick) Bug fixed.

31

upgrade_db.sh Logic for Reading system.property.db.password Doesn't Allow Special Characters
DAP-37328

Passwords containing "#", "!", or both now work with the script when it is reading the password from default.properties .


(tick) Bug fixed.

32

Copied Data-driven Workbooks Causes a Job Scheduler Issue When It's Triggered Together with the Original Artifact
DAP-37332

Copied workbooks no longer cause a Job Scheduler issues. If any problems arise, clear warnings are show about needed configuration changes.


(tick) Bug fixed.

33

After Submitting Formulas in the Formula Builder, the Workbook Doesn't Switch Back to the Formula Sheet If the Source Sheet Is Right of the Formula Sheet
DAP-37368

Users are navigated to a correct formula sheet after clicking the OK button in the formula builder.


(tick) Bug fixed.

34

A Hive JDBC Connector Configuration Is Lost after Upgrading from DM 7.1.5 to Dm 7.2.2
DAP-37396

Connection strings now remain as they were and the Database is cleaned up after upgrading.


(tick) Bug fixed.

35

Pop-up "Tips" In the Smart Analytics Dialog Appear Behind the Dialog Box
DAP-37415

Tool tips now appear over the preview dialog box as expected.


(tick) Bug fixed.

36

Datameer 7 with MapR 6 Packages Build with the Wrong MapR Version Jar Files
DAP-37422

Datameer 7.x versions are packaged with the correct MapR jar files.


(tick) Bug fixed.

37

The Run Workbook Button Is Displayed but Doesn't Work in the Info Dialog for Users with No Permissions
DAP-37486

The run workbook button is no longer present in info dialog for users with no permissions.


(tick) Bug fixed.

7.1.6 Release Notes

Improvements

1

Add Support for MapR 6.0.1 along MEP 5.0DAP-36793

Support added support for MapR 6.0.1 along MEP 5.0

...

29

 Undo Is Disabled When a User Adds a SQL Sheet into a Workbook
DAP-36786

Undo is now enabled when users add a SQL sheet into a workbook.


(tick) Bug fixed.

7.1.4 Release Notes

Improvements

1

Don't Show Any Label in Infographic Table Widgets for Data with Null ValuesDAP-36351

Null cells are displayed as blank in tables and pivot tables. This includes empty date cells displaying as empty instead of showing "Invalid Date".

...

27

Computing an Expression from a Datameer Function Is Leading to Bad Performances
DAP-36706

Computations are now much faster.


(tick) Bug fixed.

7.1.3 Release Notes

Improvements

1

Support Snowflake ImportDAP-35693

The Snowflake connector supports importing data.

...

53

Workbook Won't Open or Run after Upgrade
DAP-35783

After upgrading from 5.11.30 to 6.1.x to 6.3.5, workbooks fail to open or run and throw an error.

Resolution:

(tick) Bug fixed.

7.1.2 Release Notes

Epics

1

Hive 2.1 Hortonworks SupportDAP-32623

Make Hive 2.1 Default for HDP-2.6.X Distributions from V7.1 Onwards

DAP-34900

Enhance Existing Distribution Support for HDP 2.6. To Have Hive 2.1.X DAP-34076

Packaging of Hive Plug-in Should Select Proper Java Class Automatically DAP-34866

Update Hives2tasks.Createdefaultview() to Work with Hive 2 DAP-35183

2

Export into String Partitioned Hive Table and Storing as ParquetDAP-34136

Replace Export Partitioned Temp Table Approach by Write Data Directly into the Hdfs Partition Locations

DAP-35544

Use Existing Hive Type Specific ObjectInspectors to Write Data for Existing Table DAP-35097

Enable Export of Datameer Column into Hive Partitioned Table (Including Mapping) DAP-34106

Enable Preventing Schema Mismatch While Export into Hive Table DAP-34119

Enable Support for Different Parquet Versions on Export into Hive Table (Minimum CDH 5.11 and Parquet 2.1) DAP-34120

Support Custom Output Format (E.g. Parquet) When Exporting to an Existing Hive Table DAP-34461

Enable Type Mapping of Datameer Integer to Hive Bigint DAP-35967

Add Limitation for RecordWriter Cache to Prevent OOM Error DAP-36001

3

Implement New S3 Export AdapterDAP-34485

 Export to Redshift via S3 Exporter and RR Copy

DAP- 34887

Support Single Stream Multipart Uploading with Csv File Format DAP-34486

Support Avro File Format DAP-34886

Support IAM Role DAP-34888

Support Encrypted Buckets DAP-34889

Extract Utility Method to Create Amazon S3 DAP-35228

Make Plugin-S3 Available in Datameer 6.4, 7.0, And 7.1 DAP-35326

Provide Infrastructure That Jobflow Can Deal with Server Side Operations DAP-35863

Provide a DatameerJobLifeCycleListener DAP-36021

Improvements

1

Introduce the Databasecredentials Class That Holds All Properties Needed to Establish a Database Connection In SnowflakeDAP-36030

This is used for the import case so that the different database types can configure this object as needed.

...

57

Downloading Data via REST in Native Multi User Mode Doesn't Return Data, Only the Column Names


DAP-36283

Downloading data via REST is only returning the header information and not the data.

Resolution:

(tick) Bug fixed.

7.1.1 Release Notes

Improvements

1

Support Added for MapR 6.0DAP-34743

Datameer works in unsecured/secured MapR 6.0 environments.

...