Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 17 Next »

Datameer's release notes provide information and resolutions on improvements, bug fixes, and visual changes for 7.1.x maintenance release versions.  

Visit Datameer's Help Center for additional information or contact your customer service representative. 

7.1.9 Release Notes

Improvements

1

Support Encryption in S3 Connector to Avoid 403 Forbidden Error in Encrypted BucketDAP-37569

Encryption now supported for the S3 connector.

2

Speed Up the Upgrade ProcessDAP-37655

The upgrading speed has significantly improved.

3

Improve RecordSchema Builder PerformanceDAP-37662

The performance for building schemas in workbooks has been improved.

4

Improve Workbook Context PerformanceDAP-37683

The performance for building schemas in workbooks has been improved.

5

Add Support for CDH 5.15.1DAP-37718

Support added for CDH 5.15.1

Bug Fixes

1

Workbook Error-sheet: Font Color Switching When Hovering to Another Sheet Tab
DAP-36924

The font color now stays red as expected.

(tick) Bug fixed.

2

Twitter REST API: Unable to Generate Authentication Token
DAP-37139

The Twitter plug-in has been updated to allow for token authentication.

(tick) Bug fixed.

3

CAPTCHA Flag Isn't Cleared Properly
DAP-37151

CAPTCHA now working as expected.

(tick) Bug fixed.

4

Can't Set Full Result Permissions for Groups via Inspector Using Secure Impersonation
DAP-37322

It is now possible to set group permissions for full results.

(tick) Bug fixed.

5

Parquet Files with a Decimal(15,0) Column Can't Be Ingested
DAP-37432

Parquet files with this file type can now be ingested.

(tick) UI updated.

6

Intermittent java.io.FileNotFoundException While Running Jobs on an EMR Cluster
DAP-37492

The problem was found and corrected.

(tick) Bug fixed.

7

 Partition Dialog Shows an Error Message on a Valid Expressions
DAP-37526

No error message is shown for the valid expressions.


(tick) Bug fixed.

8

Smart Analytics and Format Cell Dialogs Don't Close in Case of a 403 Error
DAP-37530

If a 403 error occurs, the dialog closes or the warning appears on top of the dialog.


(tick) Bug fixed.

9

Can't Create a Data Link If the Import Job and the Modify Everything Capabilities Are Revoked for the Role
DAP-37574

The roles configuration now allows an administrator to revoke privileges to create import jobs but keeps the permission to create data links.


(tick) Bug fixed.

10

Renamed Columns Have the Old Name in the Join Dialog
DAP-37614

Renamed columns are now renamed in all dialogs immediately after the renaming occurs.

(tick) Bug fixed.

11

Export Job Maximum File Size Isn't Working with Parquet Files


DAP-37621

Users can now set an upper limit on Parquet files created by an export job.

(tick) Bug fixed.

12

Artifacts Are Missing When Upgrading the Git Plug-in
DAP-37658

Upgrade now works as expected.

(tick) Bug fixed.

13

Smart Analytics Dialog Doesn't Update Column Name After Column Rename
DAP-37660

Dialog now displays the latest column name.

(tick) Bug fixed.

14

Output Count of Union Sheets Change If Some Sheets Aren't Kept
DAP-37664

Output counts no longer differ if the source sheets aren't kept.

(tick) Bug fixed.

15

Setting a File Description Requires "Share with others" Permission
DAP-37675

"Sharing with others" permission no longer required to set a description on a file from the file browser.

(tick) Bug fixed.

16

Can't Open a Workbook with the REST API Due to Mission Sheet ID
DAP-37680

Upgrade/Posting/Putting workbooks with empty sheet IDs via REST now work as expected.

(tick) Bug fixed.

17

No Column Metrics Available After Renaming a Column
DAP-37690

Column metrics are now available.

(tick) Bug fixed.

18

Datameer's UI Becomes Unresponsive
DAP-37698

Datameer's UI no longer hangs.

(tick) Bug fixed.

19

Users Can't Upgrade Their MySQL database If NO_ZERO_IN_DATE and NO_ZERO_DATE Are Activated
DAP-37702

Database upgrades now work as expected.

(tick) Bug fixed.

20

Disable Default Immutable Object Interning
DAP-37738

Object interning is disable by default for generated immutables.

(tick) Bug fixed.

21

Verbose Error Messages Pose Possible Security Risks
DAP-37761

Verbose error reporting can now be disabled.

(tick) Bug fixed.

7.1.8 Release Notes

Epics

1

Cross-site Request Forgery (CSRF) Tokens Are IgnoredDAP-22902

Create CSRF Tokens per Request DAP-36910

A CSRF Token Should Have a Llfe Time DAP-36911

Show the User a Warning If the CSRF Token Is Expired - HTML Form DAP-37041

The License Upload in the UI Isn't Secured by a CSRF Token DAP-37194

Show the User a Warning If the CSRF Token Is Expired - AJAX DAP-36969

Workbook: 403 Responses Need to Be Handled Correctly DAP-37458

The External REST API Shouldn't Be Able to Work With a Valid Session Cookie DAP-36914

Avoid the Flash Message in Case of HTTP-403 Error DAP-37472

Improvements

1

Connect to S3 Via a Network ProxyDAP-37456

Datameer can now connect to S3 via a network proxy.

Bug Fixes

1

Anonymous Users Shouldn't Be Able to Reach the Datameer about Dialogue
DAP-32819

"About Datameer" is only displayed to users who have already logged in.


(tick) Bug fixed.

2

Manually Typing a Color Code in an Workbook Input Field Always Resets to #808080
DAP-33377

The input value is now retained correctly.

(tick) Bug fixed.

3

Restoring a Folder via REST Adds a Workbook History Entry
DAP-35460

A workbook history entry is no longer created when restoring a folder.


(tick) Bug fixed.

4

Unclear Log4j Error When Running Bin/Secure/Unsecure HDFS Tool
DAP-36325

The tool no longer produces an error.


(tick) Bug fixed.

5

Workbooks Fail When Using a Partitioned Data Link with the Setting "Defer Sample Generation to Workbook'
DAP-36590

When using a partitioned data link it is only possible to generate the sample immediately. Now, the "Defer Generation" option is unavailable.


(tick) UI updated.

6

Auto complete Doesn't Auto-close When Applying Formulas via Cmd-Enter
DAP-36755

Autocomplete now auto-closes after applying formulas via Cmd-Enter.


(tick) Bug fixed.

7

Close the Workbook Context Menu When Users Navigate to Another Column
DAP-36850

The context menu now closes when users navigate to another column.


(tick) Bug fixed.

8

Parlene Cache Isn't Evicting the Least Recently Used Indices in Visual Explorer 
DAP-36900

  • As memory start to get fully utilized, indices are now removed from memory per least recently used cache eviction policy.
  • If one index is using all of the memory, the least recently used columns are evicted.

(tick) Bug fixed.

9

Workbooks Fail with 'Timeout Waiting for Connection' Error


DAP-37249

The timeout error has been corrected.


(tick) Bug fixed.

10

Don't Allow a Blank SheetID via REST API PUT Command
DAP-37358

The API won't call to blank out sheetID since as it is a required field.


(tick) Bug fixed.

11

Workbooks Intermittently Fail after Upgrading with a "Container Is Running Beyond Physical Memory Limits" Exception
DAP-37395

The Parquet library has been updated to 1.8.3 to ensure OOM(s) don't occur from compression handler leaks.


(tick) Bug fixed.

12

Datameer /bin Scripts Encounter a Bug
DAP-37416

/bin scripts have been updated and are working as expected.


(tick) Bug fixed.

13

Blank Tables and Errors in the js Console on the Details Page of Workbooks and Export Jobs
DAP-37454

There are no longer any errors in the js console and the correct data is displayed on the details page of workbooks and export jobs.


(tick) Bug fixed.

14

Rename Workbook Columns with Broken Tab Key
DAP-37467

Pressing the tab key while the rename input field is active selects the next header to rename.


(tick) Bug fixed.

15

The Time Based Partition Icon Isn't Present on Settings Page in a Workbook after Reloading the Page
DAP-37477

It is now possible to set partitions on the workbook settings page and t he top header and the menu are present after a page reload.


(tick) Bug fixed.

16

"Others" Sub Menu Disappears after Changing from View to Edit Mode in Infographics
DAP-37484

The "Others" sub menu is now present at all times.


(tick) Bug fixed.

17

It Isn't Possible to Drag Widgets on the Canvas If a User Clicks on the Widget Icon in Infographics
DAP-37485

Now possible to drag widgets on the canvas at anytime.


(tick) Bug fixed.

18

An Error is Displayed in the UI If a Group Can't Access a Folder
DAP-37543

A warning rather than a error is now displayed when a group can't access a folder.


(tick) Bug fixed.

19

The Treemap Doesn't Have Tooltips
DAP-37567

Tooltips have been added to the treemap infographic.


(tick) Bug fixed.

20

Data Driven Jobs Aren't Triggered If a Dependency Triggers a Permissions Exception
DAP-37605

The scheduling and triggering of subsequent jobs is now working as expected. This update continues to ensure that sharing and permissions security is respected.

(tick) Bug fixed.

21

Schedule Inspector: Error in the Console When Saving
DAP-37626

No errors occur when saving with the schedule inspector.


(tick) Bug fixed.

7.1.7.1 Release Notes

Bug Fixes

1

The Time Based Partition Icon Isn't Present on Settings Page in a Workbook after Reloading the Page
DAP-37477

It is now possible to set partitions on the workbook settings page and the top header and the menu are present after a page reload.


(tick) Bug fixed.

2

Blank Tables and Errors in the js Console on the Details Page of Workbooks and Export Jobs
DAP-37454

There are no longer any errors in the js console and the correct data is displayed on the details page of workbooks and export jobs.


(tick) Bug fixed.

7.1.7 Release Notes

Improvements

1

Upgrade Parquet to 1.8.3DAP-37498

Datameer has upgraded to the more stable Parquet 1.8.3

2

Show User a Warning If the CSRF Token Is Expired - AJAXDAP-36969

  • If the CSRF token is expired/invalid an error message is displayed.
  • The option to cancel was added.
  • Datameer differentiates between handling between HTML and AJAX posted requests.

3

Show User a Warning If the CSRF Token Is Expired - HTML FormDAP-37041

  • If the CSRF token is expired/invalid an error message is displayed.
  • Datameer differentiates between handling between HTML and AJAX posted requests.
  • Users can now force to reach the page by using the URL  http://localhost:8100/general/invalid-session  or on invalidating the CSRF token between wizard pages jumps.

4

Add Support for CDH 5.14.4DAP-37374

Support added for CDH 5.14.4.

5

Avoid Flash Message in Case of Http-403 ErrorDAP-37472

The common CSRF-Token dialog is displayed for a 403-error. This improvement was made as a message is already displayed if the CSRF token has expired.


Bug Fixes

1

User Role Name Can't Be a Blank Space
DAP-31822

Users can no longer save a blank space as a valid username.


(tick) Bug fixed.

2

Admin Mail Server Settings: Missing Asterisk (*) on Required Fields
DAP-32535

All required fields for setting up admin mail server settings have an asterisk.

(tick) Bug fixed.

3

Analyst Role Can Change Ownership of Files with the REST API But Not UI
DAP-32715

Users now have the ability to change ownership of an artifact from the role of Analyst made consistent throughout the product by adding the ability to the UI.


(tick) Bug fixed.

4

Column Name Shows up Twice after Removing Another Column Name
DAP-34628

  • Column names are no longer duplicated after removing a previous column.
  • '1' is added to a column name when a column with same name is present after the previous column was deleted.

(tick) Bug fixed.

5

The Conductor.sh --profile-memory Isn't Creating Memory Profiling Snapshots
DAP-34913

A created snapshot now contains object allocation information. (snapshots are located in user home folder /Snapshots)


(tick) Bug fixed.

6

When Duplicating a Sheet with Formulas, References to the Original Sheet Remain in the Formulas of the New Sheet
DAP-36743

Now when copying sheets with formulas, the formulas with references to the sheet being copied are renamed on the new sheet to have the name of the new sheet.


(tick) Bug fixed.

7

Exports Fail on Kerberos Secured Impersonated Environment From HiveServer1
DAP-36787

Exports to Hive over a HiveServer1 connection on Kerberos Secured Cluster with impersonation are now able to create new table and export data.


(tick) Bug fixed.

8

There Is Meaningless Error Dialog When Users Add an Import Job with No Data into a Workbook
DAP-36823

Error dialog no longer displayed.


(tick) Bug fixed.

9

Error When Opening a Datasource Sheet Based on an Empty Partitioned Import


DAP-36824

  • Error message no longer displayed.
  • Status bar message is now consistent for a sheets between initial workbook load and switching to the sheet.
  • For sheets with empty (no data) partitions selected, the status bar renders a link to open the partition selection dialog.

(tick) Bug fixed.

10

Error While Processing a Workbook When One of the Partition Fields Is Left Blank
DAP-36871

The OK button is now disabled in the partition of sheet dialog if not all fields are configured.


(tick) Bug fixed.

11

Sheet Rename Breaks the Layout When an Empty Column Is Hidden
DAP-36873

The layout no longer breaks.


(tick) Bug fixed.

12

Worksheet Status Bars Shows Inconsistent an Message for the Same Sheet with an Error
DAP-36923

  • Sheet status bars now show consistent messages and colors.
  • Sheets with errors don't display the "Run Workbook" message or link.

(tick) Bug fixed.

13

SQL Sheets: No Error Shown When a Dependent Sheet Has a Column Error
DAP-36997

The SQL sheet is now in error state (red) when creating from a formula sheet with an error.


(tick) Bug fixed.

14

Error in js Console on the Details Page When "Rerun Migration" Is Available
DAP-37014

  • No longer an error in the js console.
  • No longer displaying the partition pie chart when a migration job fails.

(tick) Bug fixed.

15

 TopN Sort Functionality Doesn't Work on Visual Explorer Sheets
DAP-37036

TopN sort works correctly in Visual Explorer worksheets.


(tick) Bug fixed.

16

Show Detailed Information in Case of a Non-2xx Response in Visual Explorer
DAP-37047

  • An error dialog is displayed when opening Visual Explorer with a timed out session.
  • Error dialog isn't displayed when:
    • Users click on "Drill" context menu with a timed out session.
    • Users click on Undo/Redo buttons.
    • Users select a chart in the Chart Previews dialog
  • Error message says "401 Unauthorized".

(tick) Bug fixed.

17

Dependencies for Files in the File Browser Aren't Updated When Copy/Pasting a Folder Within the Root Folder
DAP-37096

Dependencies now update when copy/pasting a folder within the root folder to somewhere else in the root folder.


(tick) Bug fixed.

18

An Error Message Overlaps with the Inspector When Resizing the Browser or On a Small Screen
DAP-37109

Error message no longer can overlap the inspector.


(tick) Bug fixed.

19

Export Jobs Based on the Hive1 Connector Don't Have the Replacement_policy Property Added after a 6.1 -> 7.1 Upgrade
DAP-37168

Upgrade exports older than version 7.1 now migrate the old overwrite flag for HiveServer1 and HiveServer2 connections based the export job to replacement_policy.


(tick) Bug fixed.

20

Compaction Jobs Possibly Corrupting Source Data
DAP-37174

Issue resolved, compaction now working as intended.

(tick) Bug fixed.

21

License Upload in UI Isn't Secured by CSRF Token
DAP-37194

License uploads now secured by CSRF token in the UI.


(tick) Bug fixed.

22

The Info Dialog When Visual Explorer Can't Open Still Shows "Run Workbook" Button
DAP-37217

  • The dialog now shows a detailed message provided with the exploration status by either:
    • displaying the reason provided by the exploration status.
    • displaying a universal (neutral) message and has a collapsible section with a detailed message.
  • The "Run Workbook" button is only enabled when a workbook run fixes the missing requirement (e.g., no data available).

(tick) Bug fixed.

23

Infographic Charts Are Missing the Context Menu when Right Clicking
DAP-37227

The context menu now pops up with a right click for both empty and populated infographic charts.


(tick) Bug fixed.

24

Folder Copy and Duplication Feature Doesn't Update the Data Source for Infographics
DAP-37250

Using the copy or duplicate feature on a folder that contains all artifacts now updates all references in an infographic to use the new copy of the data source.


(tick) Bug fixed.

25

Post 7.1.5. Upgrade: Can't Submit Any Job Due to Java.Lang.OutOfMemoryError: Java Heap Space
DAP-37277

OutOfMemoryError problem has been corrected.


(tick) Bug fixed.

26

Adding Missing ID for Cascade Permission Dialog
DAP-37280

IDs have been added for the cascade permissions dialog.


(tick) Bug fixed.

27

TDE Export: Make the Temporary File Location Configurable
DAP-37284

  • The location where temporary TDE files should be stored is configurable via the properties file:
    • das.tde-export.temp-location=/path
  • If a property isn't set, the default system property  java.io.tmpdir is used.

(tick) Bug fixed.

28

Session Timeout: Login Redirection
DAP-37319

When logging in to Datameer, the session refreshes to ensure correct authentication procedures.

(tick) Bug fixed.

29

Remove Folder Group Permissions with the "X" Button in the Inspector Doesn't Work
DAP-37321

Removing group permissions for folder via x button works as expected.


(tick) Bug fixed.

30

Due to Broken Logic, upgrade_db.sh Isn't Reading default.properties
DAP-37327

The script now reads the default.properties correctly so users don't have to specify cli arguments if they have already configured their default.properties file.


(tick) Bug fixed.

31

upgrade_db.sh Logic for Reading system.property.db.password Doesn't Allow Special Characters
DAP-37328

Passwords containing "#", "!", or both now work with the script when it is reading the password from default.properties .


(tick) Bug fixed.

32

Copied Data-driven Workbooks Causes a Job Scheduler Issue When It's Triggered Together with the Original Artifact
DAP-37332

Copied workbooks no longer cause a Job Scheduler issues. If any problems arise, clear warnings are show about needed configuration changes.


(tick) Bug fixed.

33

After Submitting Formulas in the Formula Builder, the Workbook Doesn't Switch Back to the Formula Sheet If the Source Sheet Is Right of the Formula Sheet
DAP-37368

Users are navigated to a correct formula sheet after clicking the OK button in the formula builder.


(tick) Bug fixed.

34

A Hive JDBC Connector Configuration Is Lost after Upgrading from DM 7.1.5 to Dm 7.2.2
DAP-37396

Connection strings now remain as they were and the database is cleaned up after upgrading.


(tick) Bug fixed.

35

Pop-up "Tips" In the Smart Analytics Dialog Appear Behind the Dialog Box
DAP-37415

Tool tips now appear over the preview dialog box as expected.


(tick) Bug fixed.

36

Datameer 7 with MapR 6 Packages Build with the Wrong MapR Version Jar Files
DAP-37422

Datameer 7.x versions are packaged with the correct MapR jar files.


(tick) Bug fixed.

37

The Run Workbook Button Is Displayed but Doesn't Work in the Info Dialog for Users with No Permissions
DAP-37486

The run workbook button is no longer present in info dialog for users with no permissions.


(tick) Bug fixed.


7.1.6.1 Release Notes

Improvements

1

Upgrade Parquet to 1.8.3DAP-37498

Datameer has upgraded to the more stable Parquet 1.8.3

Bug Fixes

1

Copied Data-driven Workbooks Causes a Job Scheduler Issue When It's Triggered Together with the Original Artifact
DAP-37332

Copied workbooks no longer cause a Job Scheduler issues. If any problems arise, clear warnings are show about needed configuration changes.

(tick) Bug fixed.

1

Data Driven Jobs Aren't Triggered If a Dependency Triggers a Permissions Exception
DAP-37605

The scheduling and triggering of subsequent jobs is now working as expected. This update continues to ensure that sharing and permissions security is respected.


(tick) Bug fixed.

7.1.6 Release Notes

Improvements

1

Add Support for MapR 6.0.1 along MEP 5.0DAP-36793

Support added support for MapR 6.0.1 along MEP 5.0

2

Add Support to Redshift in 7.1DAP-37105

  • Exporting to S3 under Local, SmallJob, and Tez execution engines work in 7.1
  • Exporting to Redshift works in 7.1.

3

Add Snowflake Plug-in to Official Datameer ReleaseDAP-37121

Snowflake plug-in added to the official Datameer release.

4

Upgrade Plug-in Tensorflow to Use TensorFlow 1.7DAP-36948

The TensorFlow plug-in now supports TensorFlow 1.7.


5

Add Support for HDP 2.6.5DAP-37102

Support added for HDP 2.6.5


6

Add Support for CDH 5.15DAP-37183

Support added for CDH 5.15

7

Create CSRF Tokens Per RequestDAP-36910

REST API authentication now requires CSRF token when authenticating with session cookies.


Bug Fixes

1

Disabling Partitioning on an Import Job or a Data Link Breaks the Workbook
DAP-36581

The workbook now shows the preview of the unpartitioned workbook and the partition button is disabled.


(tick) Bug fixed.

2

 Sorting on a Real Time Analytics Sheet Doesn't Show Sorted Records in the Preview
DAP-36602

Sorted records are now shown correctly in the preview.

(tick) Bug fixed.

3

When a SQL Query is Incomplete in a Workbook There Is an Error on the Referenced Sheet
DAP-36622

The data source now correctly shows no error when a SQL query has been started but is not yet finished.


(tick) Bug fixed.

4

The Multiline Editor of a Workbook Is Empty When Users Try to Delete a Datasource
DAP-36730

The multiline editor now shows the correct formula as is no longer empty.


(tick) Bug fixed.

5

Workbooks Fail With a java.lang.IllegalArgumentException: Can Not Create a Path From an Empty String
DAP-36752

Parquet splits are now converted to FileSplit instances avoiding mixed types in GenericCombinedSplit.


(tick) Bug fixed.

6

Analyst Users Can't Change the Description of a Shared Entity
DAP-36765

If a file is shared through view and edit, "others" can change the file's description via the browser inspector.


(tick) Bug fixed.

7

Partitioned Export Jobs Lead to Inconsistent Data in Negative Validation Cases with Hive2
DAP-36809

The expected data is now exported into Hive tables.


(tick) Bug fixed.

8

The Workbook Inspector Doesn't Adapt to a Browser's Resize Feature.  Also, Clear and Add to Formula Buttons Are Hidden
DAP-36817

A browser's resize feature works correct with the workbook inspector and "Clear" and "Add to Formula" buttons are visible.


(tick) Bug fixed.

9

The In-place Filter on RTA Sheets Is Not Available after Duplicating the Workbook
DAP-36827

The in-place filter is now available on the RTA sheet after duplication.


(tick) Bug fixed.

10

It Isn't Possible in RTA to Drill When the Color-axis Value Is "None" For the Binned Date 
DAP-36869

Drilling in RTA now working as expected.

(tick) Bug fixed.

11

There Is a Missing Loading Data Dialog When Switching Sheets the First Time in an Existing Workbook
DAP-36987

Loading dialog is now displayed.


(tick) Bug fixed.

12

Java.Lang.Stackoverflowerror Exception While Processing of GROUPBYGAP
DAP-36995

GROUPBYGAP is now working as expected without errors.

(tick) Bug fixed.

13

Uninstallation of Runtime Analytics Plug-in Fails
DAP-37011

Installation, uninstallation, and configuration of the plugin works without error.


(tick) Bug fixed.

14

A Label Is Present When No Data Point Is in a Line Chart
DAP-37025

Labels are now only present where there are data points.


(tick) Bug fixed.

15

Regression in Copy and Duplicate Functionality - Nested Dependencies Are Not Being Updated
DAP-37044

All references to subfolder artifacts are updated to point to the new copy when creating a duplicate or copy of a folder structure.


(tick) Bug fixed.

16

Fix Upgrade_db.sh Script to Return with an Error Code in an Error Case
DAP-37089

Automatic upgrade scripts now return an error code in case of failure.


(tick) Bug fixed.

17

Session Trapping
DAP-22900

The session identifier always changes after a users successfully logs in.


(tick) Bug fixed.

18

Copying a String Values in the File Browser with CMD-C Failing
DAP-34226

Command CMD + C no longer blocked when selecting text.


(tick) Bug fixed.

19

A 500 Error on Deinstallation of Plug-ins Isn't Handled By the UI
DAP-37027

Errors are now handled by the UI code and a message is shown to the user.


(tick) Bug fixed.

7.1.5 Release Notes

Improvements

1

Added Origin and Record Count Statistics to workbook-preview-service.log FileDAP-36779

Origin and record count statistics added to the workbook-preview-service.log

2

WPS Should Log the Reason Why It Doesn't Download Data from the ClusterDAP-36808

Why data was or wasn't downloaded from the cluster is available in the logs/workbook-preview-service.log

3

Enabled SDK API to Provide Currently Logged in Datameer UsersDAP-36870

Datameer's SDK API provides support to get the currently logged in user "PerformingUser" and also has all Datameer groups attached.


4

Add More Details to a FileNotFoundException When a Command Fails During SSH ExportDAP-36958

Additional detail to error message added in order to make it more understandable.


Bug Fixes

1

Condense Fields "Host", "Port" And "Url Properties" on JDBC Connector
DAP-32572

JDBC connector fields updated.


(tick) Bug fixed.

2

The REST API Doesn't Respect the Role Permissions Not to Download Workbook Data
DAP-32729

  • REST downloads for workbooks and imports are now restricted if the user doesn't have the correct role permission.
  • UI downloads for workbooks and imports are now restricted if the user doesn't have the correct role permission.

(tick) Bug fixed.

3

When a Partitioned Import Job Results in No Data, the Workbook Status Bar Shows "Run Workbook for Full Results" Incorrectly
DAP-34791

After a job is run resulting in no data, the workbook status bar accurately displays this information.

(tick) Bug fixed.

4

Exception given When Dragging Several Files at Once in File Browser
DAP-35345

There are now no exceptions given when a user drags multiples files in the file browser.


(tick) Bug fixed.

5

Double Clicking on a File Opens the Details Page Instead of the Wizard on a Dependency Graph
DAP-35566

The wizard for a file now opens on double click in the dependency graph.

(tick) Bug fixed.

6

The Job Log on the Details Page Polls Without Waiting for the Previous Poll to Finish
DAP-35928

A poll will no longer happen before the previous poll has finished.


(tick) Bug fixed.

7

The Status Bar Shows Incorrect Info When Users Apply a Workbook Filter on RTA Sheets
DAP-36209

The status bar now shows correct info when a workbook filter is applied on unprocessed RTA sheet.


(tick) Bug fixed.

8

The Drop and Create New Table Field Doesn't Work in the HiveServer2 Export Job Wizard
DAP-36230

Now users can export an existing table with a different column schema.


(tick) Bug fixed.

9

Autocomplete and the Multiline Editor Have Issues with a Vertical Scrollbar
DAP-36346

Autocomplete and scrollbar fixed.

(tick) Bug fixed.

10

Splitting Logic Causes Excessive Info Logging for Parquet Files
DAP-36371

Excessive INFO messages relating to parquet split logic are no longer generated.


(tick) Bug fixed.

11

"Append with Sliding Time Window" Retention Policy is Causes a NullPointerException
DAP-36437

An import job now runs with empty and will keep at least N results  field.


(tick) Bug fixed.

12

A Failed Migration Job That Was Rerun Doesn't Work on the Import Job Details Page
DAP-36462

  • Clicking "Rerun all failed migration jobs" now triggers job execution.
  • Clicking "Rerun migration" icon now triggers job execution.
  • The two buttons are disabled if there is no execution permission.

(tick) Bug fixed.

13

The Column Name Automatically Changes Its Name on Applying Formula
DAP-36482

The column name no longer automatically changes when applying a formula.

(tick) Bug fixed.

14

An RTA Sheet Shows an Error after Some Exploration
DAP-36496

RTA sheets now showing valid data.


(tick) Bug fixed.

15

Can't Create an Export Job When the Formula Sheet Contains a Dummy/Empty Column
DAP-36558

Export jobs now working as expected.

(tick) Bug fixed.

16

Fix SQL Syntax Highlighting
DAP-36562

Queries that were experiencing problems no longer do so.


(tick) Bug fixed.

17

When Moving Artifacts to a Different Folder, the Name of the Last Moved File Is Taken for the Next File to Be Moved
DAP-36582

Moving files to a different folder now use the right names of the files to be moved.


(tick) Bug fixed.

18

The Add Datalink with Setting 'defer Sample Generation to Workbook' into Workbook Shows Can't Get the Master Kerberos Principal for Use as Renewer
DAP-36596

A workbook preview from a HiveServer2 datalink with setting "Defer sample generation to workbook" is now available.


(tick) Bug fixed.

19

Error Given on SQL Sheet If the Multiline Editor Is Left Empty
DAP-36600

Corrected. The behavior now mirrors an fx (calculation) sheet.

(tick) Bug fixed.

20

When Setting Permissions from UI, Too Many Events Are Thrown and Lead to Duplicate Permission Changes in the HDFS
DAP-36614

Reduced the permissions changes in the HDFS to a minimum.


(tick) Bug fixed.

21

Not Possible to Create SQL Sheets If One of the Unrelated Columns Is in an Error State
DAP-36618

It is now possible to create SQL sheet from an  fx column even if one of the columns (unrelated) on fx sheet is in an error state.


(tick) Bug fixed.

22

It Isn't Possible to Drill from None Binned Date to Date in Visual Explorer
DAP-36625

It is now possible to drill from None binned date into date.


(tick) Bug fixed.

23

Validate Column Names on an SQL Sheet When Renaming  Using a Backtick Characters
DAP-36657

Validate column renaming with AS statement. If the new column name contains a invalid character the correct sheet error is shown.

(tick) Bug fixed.

24

Error Dialog When Renaming a Column after Modifying a Formula in the Fx Editor
DAP-36705

Columns can now be successfully renamed.


(tick) Bug fixed.

25

A Join Sheet Doesn't Show Full Results Even after a Workbook Is Processed
DAP-36371

Join sheets are now based on the correct cluster samples.

(tick) Bug fixed.

26

No Space Between Cancel and save Button on Schedule Inspector
DAP-36753

Cancel and save button now have space between them.


(tick) Bug fixed.

27

With Internet Explorer 11, Parts of the Functionality are Broken on the Workbook Settings Page
DAP-36756

The top menu and the header (tabs) are now present and all sections of workbook settings work as expected.

(tick) Bug fixed.

28

EMR VPC Deployment Still Using External Connections
DAP-36772

When all components in a VPC are deployed, only internal addresses are now used.


(tick) Bug fixed.

29

 Undo Is Disabled When a User Adds a SQL Sheet into a Workbook
DAP-36786

Undo is now enabled when users add a SQL sheet into a workbook.


(tick) Bug fixed.

7.1.4 Release Notes

Improvements

1

Don't Show Any Label in Infographic Table Widgets for Data with Null ValuesDAP-36351

Null cells are displayed as blank in tables and pivot tables. This includes empty date cells displaying as empty instead of showing "Invalid Date".

2

Improve the Blurb next to Group Membership Attribute DAP-36561

The blurb now specifies the attribute used to determine a group's members.

Bug Fixes

1

Columns and Headers Highlight Don't Match After One of the Columns Is Resized Dynamically
DAP-32384

Columns and Headers now match correctly after resizing.


(tick) Bug fixed.

2

There Is an Unclear Error Message When Creating a Table with an Uppercase Letter
DAP-35120

The error message has been updated.


(tick) Bug fixed.

3

The Wrong REST Response is Given If the Session Is Timed out or Invalid
DAP-35929

The REST response now returns a proper 401 status when session is invalid or has timed out.


(tick) Bug fixed.

4

Enable Type Mapping of Datameer String to Hive CHAR to a Hive Table
DAP-35992

When exporting data into an existing Hive table, A Datameer string type can now be mapped today to Hive's CHAR type.


(tick) Bug fixed.

5

Users Can't Manually Type the Table Name in the Import Job Wizard Using Hive JDBC or Oracle Connectors
DAP-36135

Users can now manually type a desired table name for all connections where relevant.


(tick) Bug fixed.

6

Partition Values Must Be Validated for Null and Empty Values During a Hive Export
DAP-36174

Export jobs now drop invalid records that contains NULL, empty, or invalid values on the partition columns.


(tick) Bug fixed.

7

When Configuring Datameer with an EMR Cluster, the AWS S3 Access Secret Is Not Masked
DAP-36225

  • The AWS Access Key and Secret fields are masked and not visible when opening the HTML code of the Hadoop Cluster configuration.
  • The AWS Access Key and Secret fields are encrypted in the DAP database.

(tick) Bug fixed.

8

SQL Related Fx Sheets ARE in an Error State When the Referenced Column Is Renamed
DAP-36322

Fx sheets now work as expected when users rename referenced columns in a source sheet.


(tick) Bug fixed.

9

Incorrect Formulas on SQL Sheets after Closing Error Dialog
DAP-36419

After closing error dialogs on an unsuccessful source sheet deletion, SQL sheets now show the correct statement in the multiline editor.


(tick) Bug fixed.

10

Should Use 1-Based Index Values for the SQL Substring Function
DAP-36440

SQL string functions now use 1-based indexing.


(tick) Bug fixed.

11

Tooltips in the Workbook Obstruct the View with JSON Data
DAP-36453

Characters are now displayed the same way as in the cells. Escaped characters are no longer displayed.


(tick) Bug fixed.

12

The Description Field Is Disabled in the Information Inspector
DAP-36472

The owner or user with capabilities can now write text in the description field.

(tick) Bug fixed.

13

Parquet Can't See the Custom Filesystem Class from the Connection Plug-in
DAP-36499

Parquet can now see a custom filesystem class from the connection plug-in.


(tick) Bug fixed.

14

Unable to Open or Run Workbooks after the Upgrade Due to NullPointerException
DAP-36591

Workbooks now open and run normally after upgrading.


(tick) Bug fixed.

15

Missing the Loading Spinner after Duplicating a Sheet
DAP-36593

Added the spinner automation to show when the page has completely loaded.


(tick) Bug fixed.

16

Out-of-order Sheet Local References Aren't Reordered Properly
DAP-36605

Out-of-order column references on a group by sheet no longer fail.


(tick) Bug fixed.

17

Not Possible to Drill from Null-Boolean Bucket In Visual Explorer
DAP-36623

Now possible to drill from a null-Boolean bucket.


(tick) Bug fixed.

18

Incorrect Result When Drilling from Null-boolean Bucket
DAP-36624

Results are now correct when drilling from a null-Boolean bucket.


(tick) Bug fixed.

19

Workbooks are Failing with an IndexOutOfBoundsException
DAP-36626

Workbooks can now open correctly.


(tick) Bug fixed.

20

Pivot Tables Are Throwing JS Exceptions When the Aggregate or Pivot Column Has Null Values
DAP-36643

Pivot tables now show the correct outcome when adding supported data into charts.


(tick) Bug fixed.

21

Not Possible to Resize Columns in Table Widgets
DAP-36646

Now possible to resize columns in table and pivot table widgets.


(tick) Bug fixed.

22

Label for RTA Plug-in Configuration Unclear
DAP-36647

Updated the "Elasticsearch processors" label to "Limit processor capacity to configured vCPUs per container".


(tick) Bug fixed.

23

XSS Reflection Attack Found in the File Upload Filename Dialog.
DAP-36648

No longer possible to craft a filename that causes an XSS reflection attack.


(tick) Bug fixed.

24

After a Logout Due to Inactivity, Login Information May Leak into New HTTP Session and Log in Again
DAP-36649

A User logout after a certain time of inactivity now succeeds.

(tick) Bug fixed.

25

Unable to Start RTA in a Secured Cluster with No User Home Folder
DAP-36665

RTA can be started in a secure Hadoop cluster without a "/user/" folder.


(tick) Bug fixed.

26

Issues When Reordering Columns in Grouped Sheets
DAP-36675

Out-of-order expressions are now evaluated in the correct order. There are no longer error conditions nor NULL values on GROUPBY sheets.


(tick) Bug fixed.

27

Computing an Expression from a Datameer Function Is Leading to Bad Performances
DAP-36706

Computations are now much faster.


(tick) Bug fixed.

7.1.3 Release Notes

Improvements

1

Support Snowflake ImportDAP-35693

The Snowflake connector supports importing data.

2

Add Support for Cloudera CDH 5.9.1DAP-36183

Support added for Cloudera CDH 5.9.1.


3

Add Support for Cloudera CDH 5.14.2DAP-36568

Support added for Cloudera CDH 5.14.2.

4

Add Support for Cloudera CDH 5.13.3 DAP-36569

Support added for Cloudera CDH 5.13.3.


3

Upgrade Tez to 0.8.5DAP-33482

Upgrade Tez library to latest release of 0.8.5.

4

Verify Data Export into Partitioned Hive Table When CDH 5.11 Is UsedDAP-34127

Ability to export into existing Hive tables with CDH 5.11.


5

Change Label Values on Functions So the Formula Editor Can Parse ThemDAP-35028

In the UI, all invalid characters are replace in the label string with zero value characters. Only  [ a-z, A-Z, 0-9] and comma characters are valid.

6

Visualize a Possibility to Add Optional Arguments in the FX Inspector TabDAP-35124

User are shown that there are other optional arguments possible for the function.


7

Remove the Usage of the Partition Cache When Determining Partition LocationDAP-35817

When exporting into an existing partitioned table, the partition location is found for pre-existing partitions with the partition cache.

8

Add Support for MapR 5.2.x + MEP 3.0.2DAP-34077

Support added for a variant of the existing MapR 5.2 that targets the combination of MapR 5.2. + MEP 3.0.2 (Hive 2.1)


9

Automatically Insert a Function Template by Double Clicking on Function Name in the Formula InspectorDAP-34606

Quickly insert a function template into the formula editor by double clicking on a function name in the FX inspector tab.


10

Update STDDEVS and STDDEVP Functions to Run FasterDAP-34685

Implemented STDDEVS and STDDEVP computations on double precision computations.

11

Add Support for HDP 2.6.4DAP-35688

Support added for HDP 2.6.4.


12

Update That Formula Editor Data Isn't Submitted When Losing Focus On the ActionDAP-35718

If the formula editor loses focus (e.g., another action in the workbook is performed), the current formula is no longer automatically submitted.

13

Autocomplete Improvements In the Formula EditorDAP-35784

  • When a user on a formula sheet types any letter, autocomplete offers functions and column names together. When selecting a column from the autocomplete list, the column name with # char is added to the editor.
  • When a user on a formula sheet types "#", they see the autocomplete choices with only columns names.
  • When a user on a formula sheet is editing a formula that references another sheet, the autocomplete shows only columns from the current and referenced sheet.


14

Add Documentation Links to the Formula Editor InspectorDAP-36423

Users can view the documentation about the functions available in the formula inspector.


Bug Fixes

1

Column Mapping Shall Be Persistent When Editing Jobs to Existing Tables
DAP-34011

 Ability to edit an export job configured in "Use Existing" mode, so that it isn't needed to define the mapping step again.

Resolution:

(tick) Bug fixed.

2

Infinity Is Not a Valid Double Value as per Json Specification in the Column Inspector
DAP-34312

If a column contains a column infinity, no visualization for the Flip Sheet can be created.

Resolution:

(tick) Bug fixed.

3

 The Focus Changes to the Last Sheet When Updating a Union Sheet of a Workbook
DAP-34816

If currently on a union sheet, after updating a workbook, the user should still be on the union sheet.

Resolution:

(tick) Bug fixed.

4

Renaming a Column in a Source Sheet of an SQL Sheet Breaks In-place Filter/Sort of That SQL Sheet
DAP-35286

The renaming of a colunm in formula sheet breakes any in-place filter on SQL sheets

Resolution:

(tick) Bug fixed.

5

Bigdecimal Column Exports with Scale 10 in Snowflake
DAP-35481

Exporting bigdecimal values to snowflake database cuts after 10 digits. The solution was to keep same as Hive, map bigdecimal to decimal (38,18).

Resolution:

(tick) Bug fixed.

6

Disable the Search Function in the Multiline Editor on Formula/SQL Sheets
DAP-35747

Using the search function in the multiline editor causes errors.

Resolution:

(tick) Bug fixed.

7

There Is a Warning in the Console When Adding Data into a Workbook
DAP-

Updated old plugins so that the warning isn't displayed in the console.

Resolution:

(tick) Bug fixed.

8

The Zoom Out Button in Visual Explorer Should Be Disabled When It's Not Possible to Zoom Anymore
DAP-35796

When it isn't possible to zoom out any more, the zoom out button should be disabled. (Line and Scatterplot).

Resolution:

(tick) Bug fixed.

9

A Strange Symbol Is Displayed When Typing Backtick in the Formula Editor
DAP-35820

Typing a backtick or a single/double quote character displays a strange symbol. This was happening on any keyboards that expect another character after a backtick. 

Resolution:

(tick) Bug fixed.

10

Inconsistent Formatting of Time Stamp on the X-Axis Label in Visual Explorer
DAP-35830

Fix the formatting for the time stamp in Visual Explorer.

Resolution:

(tick) Bug fixed.

11

The Formula's Placeholder Should Be Selected When Clicked in a Workbook.
DAP-35898

After choosing a function from autocomplete, the functions placeholders aren't interactive.

Resolution:

(tick) Bug fixed.

12

Datameer Type LIST(INTEGER), LIST<BIGINTEGER> Can't Be mapped to the Compatible Hive Type Array<int,bigint>
DAP-35913

Mapping validation must allow:

  • List<INTEGER> to Hive type array<int>
  • List<BIG_INTEGER> to Hive type array<bigint>

Resolution:

(tick) Bug fixed.

13

 Cases of Explorer Auto Closing When Selecting a Column in Drill Preview Dialog of Visual Explorer
DAP-35918

Explorer auto closes when a user selects a column in Drill Preview dialog.

Resolution:

(tick) Bug fixed.

14

The Value Slider Not Working In Smart Analytic Dialog Boxes
DAP-35960

The slider handle should be visible and adjustable. It represents the number in the input field to the right in the Smart Analytic settings.

Resolution:

(tick) Bug fixed.

15

Update Help Text in Connection Wizard for the Database Field
DAP-36016

Text has been updated to be more understandable.

Resolution:

(tick) Bug fixed.

16

Formulas in the Formula Editor of Multiline Mode Have to Be Deleted Twice to Delete Them
DAP-36022

When a formula is selected and the back key is pressed or a character is typed, the selection should be deleted or overwritten.

Resolution:

(tick) Bug fixed.

17

Impossible to Drill from String to String When Using a Stacked or Grouped Bar
DAP-36130

Chart type doesn't auto change during drilling so drilling from string to string is possible.

Resolution:

(tick) Bug fixed.

18

Updating a Workbook in a Workbook Chain Should Not Invalidate Transitive Downstream Workbooks
DAP-36132

The preview of an external sheet should not get invalidated if one of the referenced workbook sheets gets updated.

Resolution:

(tick) Bug fixed.

19

The Panning Cursor Is Displayed When the Toolbar Icon Is Disabled in Visual Explorer
DAP-36136

The panning cursor should be displayed only when the panning icon is enabled.

Resolution:

(tick) Bug fixed.

20

The Preview Shows the Number of Records on the Y-axis Even When Three Columns Are Selected in Visual Explorer
DAP-36139

For three columns, users should see x, y, and color aspects assigned to a column.

Resolution:

(tick) Bug fixed.

21

Correct the On-chart Filter Status after Drilling into a Range on a Line Chart in Visual Explorer
DAP-36164

The on chart filter status should show string values followed by "," and not by "...".

Resolution:

(tick) Bug fixed.

22

The Undo Feature Doesn't Work on the Max Bar Configuration in Visual Explorer
DAP-36185

The max bars configuration is an undoable action.

Resolution:

(tick) Bug fixed.

23

Exporting into a Hive Table with over 50 Partitions Fails with Too Many Open Files
DAP-36235

All partitions must be created and available.

Resolution:

(tick) Bug fixed.

24

Remove Remote Data Browser Feature Flag
DAP-36251

The Remote Data Browser feature is not avialable in this Datameer verison.

Resolution:

(tick) Bug fixed.

25

Splitting of Parquet Files Is Slow Because Due to Multiple Requests to the Namenode for Each File
DAP-36270

Workbooks show performance degradation as splitting Parquet files is taking a long time when there are many input files or if the namenode is busy. 

Resolution:

(tick) Bug fixed.

26

Use a Qualified Table Name in Snowflake SQL
DAP-36278

Exports to Snowflake only work for the default schema. The fix was to use a qualified table name in Snowflake SQLs.

Resolution:

(tick) Bug fixed.

27

Exporting to a Partitioned Hive Table Is Missing Records When Using Append Mode
DAP-36281

The export jobs runs successfully but not all records are accessible on the Hive side.

Resolution:

(tick) Bug fixed.

28

Downloading Workbook Data via Rest in NMU Does Not Return Data, Only the Column Names
DAP-36284

Downloading workbook data using the API with NMU now returns data.

Resolution:

(tick) Bug fixed.

29

The Workbook Is Missing the Horizontal Scrollbar on SQL and Formula Sheets Using the Multiline Editor
DAP-36316

The horizontal scrollbar isn't not visiable with SQL/formula sheets that use the multiline editor.

Resolution:

(tick) Bug fixed.

30

Record#copyColumn() Performance Regression
DAP-36317

Performance issues for joined sheets since the implementation causes getValue() to be called unnecessarily when copying fields into the join's result records.

Resolution:

(tick) Bug fixed.

31

Exporting to a Partitioned Hive Table Is Missing Records When Using Overwrite Mode
DAP-36324

The export jobs runs successfully but not all records are accessible on the Hive side.

Resolution:

(tick) Bug fixed.

32

Renaming a Source Sheet Breaks SQL sheets When Using a Statement Like 'SELECT Sheet1.* FROM Sheet1'
DAP-36327

Making a statement like this SELECT Sheet1.* FROM Sheet1and then renaming the source sheet makes the SQL sheet invalid.

Resolution:

(tick) Bug fixed.

33

Cell Background Color Not Restored after Mouseover for Table Widget
DAP-36340

The background color of cells should be restored when user is no longer mousing over the cell.

Resolution:

(tick) Bug fixed.

34

Pivot Table Widget Rows Display Incorrect Values After the First Row
DAP-36352

Display the correct data value for all cells in the Pivot Table widget.

Resolution:

(tick) Bug fixed.

35

The Multiline Editor Adds an Unnecessary Space after the Formula
DAP-36359

There should be no additional space added after the formula.

Resolution:

(tick) Bug fixed.

36

SmallJob Ignores "das Das.Job.Map-task.Memory" and Defaults to Run with a 1GB Container Size
DAP-36374

"das das.job.map-task.memory" can be used to configure the SmallJob task container size.

Resolution:

(tick) Bug fixed.

37

Reduce-Side Join Performance Regression
DAP-36388

Reduce-Side join had some performance regressions that cause it to spend too much time when spilling to disk. Performance has been increased.

Resolution:

(tick) Bug fixed.

38

Removing an Existing Formula Is Not Submited When Switching the Sheet/Column
DAP-36429

Removing a formula should submit when switching the focus the sheet or column.

Resolution:

(tick) Bug fixed.

39

The GROUPTTEST Function Template Is Highlighted in Red
DAP-36431

The template of values should use the standard black coloring.

Resolution:

(tick) Bug fixed.

40

Event Bus Threads Are Being Blocked. Advancedschedulingservice Is Not Triggering Jobs
DAP-36458

Datameer isn't triggering Data Driven jobs regularly following a recent change to activate Kerberos and Secure Impersonation.

Resolution:

(tick) Bug fixed.

41

Task Temporary Files/Directories Should Not Be Generated by Localdirallocator
DAP-36465

The LocalDirAllocator from Hadoop common are being used for allocating temporary files and directories in our cluster tasks, which is unnecessary.

Resolution:

(tick) Bug fixed.

42

Users Unable to Save Cluster Configuraiton Changes After Editing
DAP-36466

The settings in the cluster configuration settings were not savings after being edited.

Resolution:

(tick) Bug fixed.

43

Unknown Host Exceptions on EMR Relating to Visual Explorer
DAP-36467

Visual Explorer can now start on EMR without exceptions.

Resolution:

(tick) Bug fixed.

44

Exceptions During Job State Changes Lead to Blocked a Job Queue
DAP-36471

Job with errors register as errors and the job queue is no longer blocked.

Resolution:

(tick) Bug fixed.

45

The Explore Contect Menu Is Not Working As Expected
DAP-36478

"Explore" from the context menu in Visual Explorer now skips the Chart Previews dialog and shows charts with the selected column in the x-axis.

Resolution:

(tick) Bug fixed.

46

Visual Explorer Backend Fails When Driling from Null-Date Bucket
DAP-36479

VE now produces the correct results.

Resolution:

(tick) Bug fixed.

47

The Realtime Analytics Engine Fails to Start with High Availability Configuration
DAP-36547

When using an HDFS HA configuration, RTA no longer fails to start.

Resolution:

(tick) Bug fixed.

48

Empty Hive Table Import via a Data Link Leading to Division by Zero in Splitter
DAP-36552

Users should be able to set up a data link on in an empty Hive table.

Resolution:

(tick) Bug fixed.

49

Reorded Columns on a Unkept Sheet Showing the Wrong Results on the Referenced Sheet after a Workbook Run
DAP-36544

When reordering columns on a unkept sheet, the results on the referenced sheets are incorrect.

Resolution:

(tick) Bug fixed.

50

IF Function with Integer and Null Arguments Resolve to Float Type on Cluster Side When Used in an Aggregation Sheet
DAP-36387

Using an IF statement with a NULL value as the condition was causing workbooks to fail.

Resolution:

(tick) Bug fixed.

51

Unable to Configure Export Jobs Due to Inconsistent Config Instructions
DAP-36219

Updated the following configuation instructions:

  • In the field "Quote character"
    • change the field name to "Quote character:" (remove the "*")
    • make the field not mandatory (it's possible to leave blank)
  • In the field "Escape character"
    • change the field name to "Escape character:" (remove the "*")
    • make field not mandatory (it's possible to leave blank)
    • add the following infotext a second sentence "Or leave blank to not support escape characters."

Resolution:

(tick) Bug fixed.

52

JSON Plug-in Malfunctioning so That Artifacts Fail
DAP-36061

Correct functionality in the JSON plug-in. Test that artifacts from related plug-ins work correctly.

Resolution:

(tick) Bug fixed.

53

Workbook Won't Open or Run after Upgrade
DAP-35783

After upgrading from 5.11.30 to 6.1.x to 6.3.5, workbooks fail to open or run and throw an error.

Resolution:

(tick) Bug fixed.

7.1.2 Release Notes

Epics

1

Hive 2.1 Hortonworks SupportDAP-32623

Make Hive 2.1 Default for HDP-2.6.X Distributions from V7.1 Onwards

 DAP-34900

Enhance Existing Distribution Support for HDP 2.6. To Have Hive 2.1.X DAP-34076

Packaging of Hive Plug-in Should Select Proper Java Class Automatically DAP-34866

Update Hives2tasks.Createdefaultview() to Work with Hive 2 DAP-35183

2

Export into String Partitioned Hive Table and Storing as ParquetDAP-34136

Replace Export Partitioned Temp Table Approach by Write Data Directly into the Hdfs Partition Locations

 DAP-35544

Use Existing Hive Type Specific ObjectInspectors to Write Data for Existing Table DAP-35097

Enable Export of Datameer Column into Hive Partitioned Table (Including Mapping) DAP-34106

Enable Preventing Schema Mismatch While Export into Hive Table DAP-34119

Enable Support for Different Parquet Versions on Export into Hive Table (Minimum CDH 5.11 and Parquet 2.1) DAP-34120

Support Custom Output Format (E.g. Parquet) When Exporting to an Existing Hive Table DAP-34461

Enable Type Mapping of Datameer Integer to Hive Bigint DAP-35967

Add Limitation for RecordWriter Cache to Prevent OOM Error DAP-36001

3

Implement New S3 Export AdapterDAP-34485

 Export to Redshift via S3 Exporter and RR Copy

 DAP- 34887

Support Single Stream Multipart Uploading with Csv File Format DAP-34486

Support Avro File Format DAP-34886

Support IAM Role DAP-34888

Support Encrypted Buckets DAP-34889

Extract Utility Method to Create Amazon S3 DAP-35228

Make Plugin-S3 Available in Datameer 6.4, 7.0, And 7.1 DAP-35326

Provide Infrastructure That Jobflow Can Deal with Server Side Operations DAP-35863

Provide a DatameerJobLifeCycleListener DAP-36021

Improvements

1

Introduce the Databasecredentials Class That Holds All Properties Needed to Establish a Database Connection In SnowflakeDAP-36030

This is used for the import case so that the different database types can configure this object as needed.

2

Add Support for Cloudera CDH 5.14.0DAP-35499

Support added for Cloudera CDH 5.14.0


3

Add Support for Amazon EMR v5.11DAP-35505

Support added for Amazon EMR v5.11

4

Remove "Warning" Label from License WarningDAP-34259

Warnings should not be labeled as "Warning". This is inferred from the color (orange) and the warning icon.


5

Update Compaction Thresholds to Run More OftenDAP-34621

Default daily/monthly thresholds for running compaction have been updated.

6

Enable Type Mapping of Datameer Integer to Hive BigintDAP-35967

Exporting data into an existing Hive table, the Datameer Integer now maps to the Hive BigInt data type.


7

The Snowflake Database Should Only Be Configurable on the Data Store LevelDAP-35970

This helps simplify and keep imports running smoothly.

8

Add support for Cloudera CDH 5.13.2DAP-36063

Support added for Cloudera CDH 5.13.2.


Bug Fixes

1

Export Wizard Step "Mapping" Doesn't Have Type and Name Mapping Validation
DAP-34748

The wizard step "Mapping" of Datameer's Hive export has no validation.

Resolution:

(tick) Bug fixed.

2

Fix Unclear Error Messages for "Mapping Errors" On Hive Export Wizard
DAP-35181

Make error messages on the mapping step of the wizard more human readable.

Resolution:

(tick) Bug fixed.

3

Hive Export in Overwrite Mode Isn't Working
DAP-35723

If the mode "Overwrite" is used, Datameer doesn't replace the existing partition where the data will be added.

Resolution:

(tick) Bug fixed.

4

Partitioned Hive Exports Are Dropping Records with Empty Data Values
DAP-36157

Partitioned exports are dropping records with empty values.

Resolution:

(tick) Bug fixed.

5

 "Create New If Not Exist" Hive Exports Fail in Case the Table Doesn't Exist
DAP-36160

It should be possible to create a table while exporting into Hive.

Resolution:

(tick) Bug fixed.

6

Visual Explorer: Chart Level Filters Get Lost on Exploration Sheets
DAP-34841

When reopening Visual Exploration from an Exploration sheet, on chart filters (coming from a drill down or zoom) are no longer available. 

Resolution:

(tick) Bug fixed.

7

Visual Explorer: Custom Sort Order Doesn't Persist, When User Drills into Stacked/Grouped Bar
DAP-35571

Custom sort order should persist when user drills into stacked/grouped bar charts.

Resolution:

(tick) Bug fixed.

8

Visual Explorer: Undo and Redo Stack Should Reset on Re-open
DAP-35780

  • When users re-open Explorer, Undo and Redo stack resets.
  • The Undo should be disabled when users open Explorer via context menu.

Resolution:

(tick) Bug fixed.

9

Visual Explorer: Legends Overlap with the Widget When Changing from Simple to Stacked Bar
DAP-35804

Chart and legends should never overlap.

Resolution:

(tick) Bug fixed.

10

Visual Explorer: Drill Preview Shows Incorrect Date Binning Information 
DAP-35850

Drill Preview should show correct date binning.

Resolution:

(tick) Bug fixed.

11

Visual Explorer: Empty Label Isn't Displayed in the Chart and the Tooltip
DAP-35883

An empty label should be displayed in x-axis at all times.

Resolution:

(tick) Bug fixed.

12

Visual Explorer: Onhover State Doesn't Appear When a User Hovers Too Quickly to Unselected Element on Bar Charts
DAP-35909

The OnHover state should appear immediately.

Resolution:

(tick) Bug fixed.

13

Visual Explorer: Help Text Isn't Present in the Line Chart
DAP-35914

  • Help text should be present when users move their mouse inside of the chart.
  • When users change columns on the x-axis [date-integer and back to date], date column is binned.

Resolution:

(tick) Bug fixed.

14

Not Possible to Open Visual Explorer If RTA Sheet Are Created Before the Animation Is Finished
DAP-35917

Create sheet and Update sheet buttons should be disabled until the data is fully loaded.

Resolution:

(tick) Bug fixed.

15

Visual Explorer: Bar Doesn't Show Data after Drilling
DAP-35934

Chart should show data at all times.

Resolution:

(tick) Bug fixed.

16

Visual Explorer: Two Identical Conditions Are Added at the Same Time If Users Enter the Space Before the Actual Value
DAP-35936

  • The user is able to add a unique value only one at time.
  • If a user enters the same value twice, the custom text search displays it only once.

Resolution:

(tick) Bugs fixed.

17

Visual Explorer: Preview Doesn't Show Categories
DAP-35947

Even if preview is based on 5% of data, the category info should be displayed.

Resolution:

(tick) Bugs fixed.

18

Visual Explorer: Processed RTA Sheet Shows No Records Sometimes
DAP-35950

A processed RTA sheet should show valid information.

Resolution:

(tick) Bug fixed.

19

Visual Explorer: The X-Axis Changed Its Width on Bar Hover in Safari
DAP-35951

The X-axis should not change its width on bar hover.

Resolution:

(tick) Bug fixed.

20

Visual Explorer: Multiple Exceptions When a User Changes Column On the Y-Axis or X-Axis
DAP-35966

There should be no exceptions when users:

  • Change columns in any of the axis across all chart types.
  • Interact with config menus (change aggregation, sort order, etc).
  • Switch chart type.

Resolution:

(tick) Bug fixed.

21

Visual Explorer: Truncation Is Missing in the Preview When Using Internet Explorer for a Date Column
DAP-36037

Truncation is present when the preview shows two unbanned date columns.

Resolution:

(tick) Bug fixed.

22

Visual Explorer: Drill Down Leads to an Incorrect Result When Drilling into Special Char and (Empty)
DAP-36060

The same three bars should be displayed as a result when users select all three bars and drill into the same dimension.

Resolution:

(tick) Bug fixed.

23

Visual Explorer: A Scatterplot Preview Displays the Aggregation Function on the Y-axis
DAP-36065

The Scatterplot preview chart in the chart previews dialog should only show the column names, but not an aggregation function.

Resolution:

(tick) Bug fixed.

24

Visual Explorer: The Line Chart Shows Incorrect Colors for Color-Axis Column
DAP-36071

The line chart should show expected colors for a selected color-axis column.

Resolution:

(tick) Bug fixed.

25

Visual Explorer: Inconsistent Tooltip Implementation of Undo/Redo Vs Chart Type Icons
DAP-36126

Inconsistent implementation of Undo/Redo vs Chart type icons.

Resolution:

(tick) Bug fixed.

26

Visual Explorer: Preview Shows Incorrect Information for the Selected Segment
DAP-36127

The preview should show the correct information when users select a segment of data and drill.

Resolution:

(tick) Bug fixed.

27

Visual Explorer: Endless Loading When Using Undo If the User Changed Columns on the Axis
DAP-36137

The Undo feature should work as expected and undo one step only.

Resolution:

(tick) Bug fixed.

28

Non Processed Datalinks are Disabled in the Exchange Data Dialog in Workbooks
DAP-35215

A not triggered data link without preview data stored should be enabled in the exchange data dialog.

Resolution:

(tick) Bug fixed.

29

Missing Artifacts in the Git Plug-in
DAP-35249

When attempting to rollback a Workbook to a previous state using the enabled Git Plugin, it was observed that it was not represented in the Git Repo. 

Resolution:

(tick) Bug fixed.

30

Include Column Mapping Configuration Getting Lost While Duplicating/Copying Jobs
DAP-35254

  • Column mapping configuration should be accurate after duplicating/copying an export job.
  • Column mapping configuration should be accurate after backup/restoreing an export job.
  • Column mapping configuration should be accurate after downloading and injecting via restv2 api of an export job.

Resolution:

(tick) Bug fixed.

31

Computing of Subset of Columns in a Referenced Formula Sheet Results in Wrong Record Types
DAP-35280

For a special set up of referenced columns of non kept formula sheets, the workbook execution will fail. This is caused by incorrect computing of used columns in FormulaSheetBuilder.

Resolution:

(tick) Bug fixed.

32

 Restoring a Previously Deleted Sheet Should Respect the Previous Sheet Ordering
DAP-35306

Restoring a previously deleted sheet should respect the previous sheet ordering.

Resolution:

(tick) Bug fixed.

33

Problem When Toggling Empty Columns in a Workbook
DAP-35543

The UI looks abnormal when trying to hide empty columns of a workbook.

Resolution:

(tick) Bug fixed.

34

Sharing Unprocessed Job-configurations with Others Doesn't Sync Permissions to HDFS after Triggering with Another Analyst
DAP-35638

The permission sync to the HDFS folder isn't working correctly after an analyst runs a shared workbook.

Resolution:

(tick) Bug fixed.

35

Exceptions When Dragging a Column All the Way to the Right
DAP-35648

There should be no exceptions when dragging columns in a workbook.

Resolution:

(tick) Bug fixed.

36

Problems with Non Standard Latin Characters in the Multiline Formula Editor
DAP-35694

The font size for non latin characters should be the same as for latin characters.

Resolution:

(tick) Bug fixed.

37

Secure Validation Job Fails with - No Groups Found for User Datameer
DAP-35722

The secure validation job on the Hadoop page fails for the system user when LDAP is configured as authentication.

Resolution:

(tick) Bug fixed.

38

Column Metrics Incorrect for High Cardinality String Columns
DAP-35756

The numbers indicated on the histogram are much higher than the actual counts.

Resolution:

(tick) Bug fixed.

39

 Browse All Data for a Workbook with a Sorted Sheet Fails
DAP-35770

The numbers indicated on the histogram are much higher than the actual counts.

Resolution:

(tick) Bug fixed.

40

Copy/Pasting a Folder Doesn't Create the Right Dependencies
DAP-35814

A copied workbook has the dependencies to a original job when it should have dependencies to the new copied job.

Resolution:

(tick) Bug fixed.

41

Downloading Data via REST in Native Multi User Mode Doesn't Return Data, Only the Column Names
DAP-35852

Downloading data via REST is only returning the header information and not the data.

Resolution:

(tick) Bug fixed.

42

The Sort Dialog Doesn't Close with the Esc Key in a Workbook
DAP-35858

Every dialog should be able to be closed with the Esc key In a workbook.

Resolution:

(tick) Bug fixed.

43

Can't Navigate to the Input Field When Renaming a Column or Sheet
DAP-35859

It should be possible to navigate through the name input field for sheets and columns.

Resolution:

(tick) Bug fixed.

44

 Infographics Loading but Can't Be Edited
DAP-35871

The Infographics editing process was trying to execute before the infographic fully loaded.

Resolution:

(tick) Bug fixed.

45

Unable to Create Artifacts on Datameer on a Mac after Upgrading from 6.4 to 7.1
DAP-35899

Updating from Datameer 6.4 to 7.1 is showing a blank sceen upon completing.

Resolution:

(tick) Bug fixed.

46

Malformed Query While Accessing LDAP via SSL
DAP-35957

The LDAP plugin should still be able to connect to a LDAP server that supports pagination.

Resolution:

(tick) Bug fixed.

47

Parallel Index Creation from Different Users Can Lead to Wrong User in Index Metadata
DAP-35958

When Datameer creates an index, an existing ParleneSettings object is used. Change the user/token object in it and use it to serialize it to IndexSettings.

Resolution:

(tick) Bug fixed.

48

There is An Unnecessary Error Message Under Extension Points In Plug-in Configuration
DAP-35982

When opening the Admin Page -> Plug-ins page, an error message is displayed under "Extension Points".

Resolution:

(tick) Bug fixed.

49

Upgrade_db.sh Fails If the Database Is Not Named "dap"
DAP-35983

Running upgrade_db.sh on a database named 'foo' should work.

Resolution:

(tick) Bug fixed.

50

Auto Compaction and Migration Jobs Trigger Workbooks
DAP-35993

Workbooks shouldn't be triggered after compaction/migration jobs finish.

Resolution:

(tick) Bug fixed.

51

Null Pointer Exception on Cluster When Exporting to Snowflake
DAP-36029

Snowflake export in cluster mode should work.

Resolution:

(tick) Bug fixed.

52

Users/Group/Roles Sections in the Admin Tab Aren't Loading
DAP-36047

When trying to load Users/Groups/Roles sections at Datameer Admin tab, the page doesn't load properly.

Resolution:

(tick) Bug fixed.

53

Set Default Data Link Sampling Size to 5GB
DAP-36068

Samples run faster with 5GB sampling as compared to 50gb sampling that was the default.

Resolution:

(tick) Bug fixed.

54

Upgrading Leads to Incorrect Icons All Over the Datameer App
DAP-36080

After an upgrade (6.3.7 -> 6.4.6 -> 7.1.2, etc), icons all over the app are misplaced.

Resolution:

(tick) Bug fixed.

55

Upgrade to 6.4.3/7.1.2: ArrayIndexOutOfBounds on Multiple Workbooks
DAP-36110

After upgrading to version 6.4.3/7.1.2, an ArryIndexOutOfBounds error was given in the workbook execution.

Resolution:

(tick) Bug fixed.

56

Prevent Infinite Loop in SQL Query Planning
DAP-36131

Query planning shouldn't result in an infinite loop.

Resolution:

(tick) Bug fixed.

57

Downloading Data via REST in Native Multi User Mode Doesn't Return Data, Only the Column Names


DAP-36283

Downloading data via REST is only returning the header information and not the data.

Resolution:

(tick) Bug fixed.

7.1.1 Release Notes

Improvements

1

Support Added for MapR 6.0DAP-34743

Datameer works in unsecured/secured MapR 6.0 environments.

2

The Export Partitioned Temp Table Approach Has Been Replaced by Writing Data Directly into the HDFS Partition LocationsDAP-35544

Datameer has replaced the temp table approach and writes the data directly into the HDFS partition location in the expected table format.


3

Removal of the S3 Block ConnectorDAP-30808

This connector product is no longer available and removed from Datameer as an option.


4

Support Added to Bundle Datameer for MapR-5.2.2DAP-33817

Support for MapR-5.2.2 added.

5

Support Added to Bundle Datameer for HDP-2.5.5 and HDP-2.5.6DAP-33938

Support for HDP-2.5.5 and HDP-2.5.6 added.


6

Support Added to bundle Datameer for HDP-2.6.1 and HDP-2.6.2DAP-34130

Support for HDP-2.6.1 and HDP-2.6.2 added.

7

Support Added for Cloudera CDH 5.12.2DAP-35474

Support for Cloudera CDH 5.12.2 added.

8

Support Added for Cloudera CDH 5.13.1DAP-35339

Support for Cloudera CDH 5.13.1 added.


9

Limit the Usage of Userauthenticationdetails to Reduce Potential Password ExposuresDAP-35553

Remove the chance of an information leak of a password by not extending UserAuthenticationDetails from the User.

10

Provide the User Who Is Executing a Job Within the JobExecutionStartedEventDAP-35585

The log shows who triggered a job when subscribing to a JobExecutionStartedEvent


11

Increased Workbook Info Text VisiblityDAP-35695

The workbook info text indicating whether a sheet is being kept and the text indicating whether the sheet is partitioned have been made more visible.

Bug Fixes

1

Removed Columns Appear in the "Included Columns" Section in Join/Range Join Dialog
DAP-32034

If a column in a sheet is deleted, where the sheet is part of a join but the column is not, the column is still listed in the "included columns" section in the join dialog.

Resolution:

(tick) Bug fixed.

2

The BigInteger and BigDecimal Data Type Should Indicate That Min/Max/Mean are Approximate Values
DAP-33927

Show that these values are approximate values with use if the "~" symbol.

Resolution:

(tick) Bug fixed.

3

When the Date Column Contains Nulls the Workbook Shows an Error in a Binned Bucket
DAP-33999

A calculated sheet should display a blank bucket and respective count or group sum depending on aggregation selection for the measure.

Resolution:

(tick) Bug fixed.

4

The File Menu Contains Different Entries From the Browser Context Menu for Data Links
DAP-34114

"Configure" in the file menu should only be enabled if the selected file has "Configure" in its context menu.

Resolution:

(tick) Bug fixed.

5

Proper Info Dialog Missing in Workbooks When Smart Analytics Is Not Available Due to the License
DAP-34590

Info dialog should be disabled when the user tries to create a Smart Analytics sheet if the license doesn't include the feature.

Resolution:

(tick) Bug fixed.

6

Can't Rename an Artifact in the File Browser When an Uppercase Letter Is Replaced by a Lowercase and Vice Versa
DAP-34938

It should be possible to replace upper case letters with lower case letters and vice versa.

Resolution:

(tick) Bug fixed.

7

The Workbook Inspector Is Empty If No Preview Data Is Stored for a Datalink When Using Ranger/Sentry
DAP-35217

Workbook inspector isn't empty if a datalink with the option "don't store preview data" is selected.

Resolution:

(tick) Bug fixed.

8

An Outer Left Join Doesn't Display All Values from the Left Sheet
DAP-35407

An Outer Left join doesn't show expected behaviour and returns only matching values from two sheets (like an Inner join) instead of all values from the left side and matching values from the right one.

Resolution:

(tick) Bug fixed.

9

 Deleting the Formula in the Last Column in a Workbook Also Deletes the First Column
DAP-35492

Deleting formula from last column shouldn't affect other columns.

Resolution:

(tick) Bug fixed.

10

 Inspector Doesn't Refresh after Closing the Dependency View in the File Browser
DAP-35545

After switching back from dependency view to the file browser the file inspector should refresh and show the information for the current selected entity.

Resolution:

(tick) Bug fixed.

11

End Progress after Ignored Cascade Permission Setting During Main Rest Call
DAP-35551

The GET call has the state "End" after an ignore event.

Resolution:

(tick) Bug fixed.

12

Flipsheet Isn't Being Disabled When User Has No Permissions to View Full Data
DAP-35559

Disable the flipsheet button and show warning message to user when they don't have the correct permissions.

Resolution:

(tick) Bug fixed.

13

 ClusterSession Cleanup Fails to Delete Tez Recovery Files
DAP-35567

 In the EMR environment, jobs that completed successfully might see a failure in ClusterSession cleanup.

Resolution:

(tick) Bug fixed.

14

An Analyst Can Change Permissions on Other Job-Configurations Owners
DAP-35568

A non-owner without the capability "user can modify every file and folder" shouldn't be able to change permissions of other user's files.

Resolution:

(tick) Bug fixed.

15

An Analyst User Can't Execute Group Shared Job Configurations with Ldap Authentication
DAP-35574

An external user (that was imported as a user and not via group) should have execute permissions if their group has execute permissions.

Resolution:

(tick) Bug fixed.

16

The Pivot Table Widget Shows Unexpected Behavior
DAP-35584

  • When users uncheck RowTotal checkbox, the very right column should not disappear.
  • When users add several columns into the Measure field, the Pivot table should populate data in columnA, columnB, etc.
  • When Total is present (data is added into Pivot Dimension field) and users uncheck the RowTotal checkbox, the very right Total column should disappear.

Resolution:

(tick) Bugs fixed.

17

Excel Import Format Isn't Closing Open File Handles Correctly
DAP-35653

  • Clearn up the file handle after generating the preview.
  • Delete the temporary file after generating the preview.
  • The parser goes away after generating the preview.

Resolution:

(tick) Bugs fixed.

18

Remove Enable Impersonation from View on the Hadoop Cluster Page for Native Multi User Mode
DAP-35657

The Hadoop cluster page shows the Enable Impersonation disabled in native multi user mode. This might confuse the user because they could disable or enable it manuallly.

Resolution:

(tick) Bug fixed.

19

Move Checkbox about Preview Data in Data Link Wizard to save a Step
DAP-35659

Move the checkbox about preview generation to save step in the data link wizard.

Resolution:

(tick) Bug fixed.

20

Recordinspector Don't Support All Hive Column Types for a Partitioned Export
DAP-35662

Each Hive column type must be supported.

Resolution:

(tick) Bug fixed.

21

UserGroupInformationCache Doesn't Work as Intended with Native Multi User
DAP-35697

Add an expiration time to UserGroupInformationCache so it doesn't cause the cache to return instances of UserGroupInformation where the Kerberos TGT has been expired, resulting in failing job runs/HDFS accesses.

Resolution:

(tick) Bug fixed.

22

Don't Recompute the Sample on Column Rename Unless the Dependent Column Has an Error
DAP-35706

The sheet hash creation is using the column names which causes the sample to be recomputed if a user renames a column. This creates an unnecessary performance issue.

Resolution:

(tick) Bug fixed.

23

Ctrl-z (Undo) Also Undoes Workbook Operations
DAP-35742

Disable workbook hotkeys when Virtual Explorer is open.

Resolution:

(tick) Bug fixed.

24

The STARTOFWEEK and STARTOFMONTH Functions Don't Work on the Result of Group Operations
DAP-35751

Workbooks that have been created in Datameer versions before 6.4 and contain STARTOFWEEK or STARTOFMONTH functions applied to the result of GROUPBY should continue to work without a reconfiguration.

Resolution:

(tick) Bug fixed.

25

Enabling/Disabling Hot Keys Doesn't Work on Workbook
DAP-35771

All action related hot keys shouldn't be available when any workbook dialog is opened.

Resolution:

(tick) Bug fixed.

26

Drilling Multiple Levels in a Chart Causes Duplicate Filters in Query
DAP-35799

Filters for each drill level should only be sent once.

Resolution:

(tick) Bug fixed.

27

User Can't Select Data in a Line Chart after Switching from a Bar Chart
DAP-35800

Users should be able to select/brush data in line a chart after switching from a bar chart.

Resolution:

(tick) Bug fixed.

28

Disconnect Not Executed on ExportRecordProcessor When an Exception Is Thrown
DAP-35816

If an exception is thrown during a record procession in ExportRecordProcessor, the connection is never closed.

Resolution:

(tick) Bug fixed.







  • No labels