Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 6 Next »

Datameer's release notes provide information and resolutions on improvements, bug fixes, and visual changes for 7.1.x maintenance release versions.  

Visit Datameer's Help Center for additional information or contact your customer service representative. 

7.1.4 Release Notes

Improvements

1

Don't Show Any Label in Infographic Table Widgets for Data with Null ValuesDAP-36351

Null cells are displayed as blank in tables and pivot tables. This includes empty date cells displaying as empty instead of showing "Invalid Date".

2

Improve the Blurb next to Group Membership Attribute DAP-36561

The blurb now specifies the attribute used to determine a group's members.

Bug Fixes

1

Columns and Headers Highlight Don't Match After One of the Columns Is Resized Dynamically
DAP-32384

Columns and Headers now match correctly after resizing.


(tick) Bug fixed.

2

There Is an Unclear Error Message When Creating a Table with an Uppercase Letter
DAP-35120

The error message has been updated.


(tick) Bug fixed.

3

The Wrong REST Response is Given If the Session Is Timed out or Invalid
DAP-35929

The REST response now returns a proper 401 status when session is invalid or has timed out.


(tick) Bug fixed.

4

Enable Type Mapping of Datameer String to Hive CHAR to a Hive Table
DAP-35992

When exporting data into an existing Hive table, A Datameer string type can now be mapped today to Hive's CHAR type.


(tick) Bug fixed.

5

Users Can't Manually Type the Table Name in the Import Job Wizard Using Hive JDBC or Oracle Connectors
DAP-36135

Users can now manually type a desired table name for all connections where relevant.


(tick) Bug fixed.

6

Partition Values Must Be Validated for Null and Empty Values During a Hive Export
DAP-36174

Export jobs now drop invalid records that contains NULL, empty, or invalid values on the partition columns.


(tick) Bug fixed.

7

When Configuring Datameer with an EMR Cluster, the AWS S3 Access Secret Is Not Masked
DAP-36225

  • The AWS Access Key and Secret fields are masked and not visible when opening the HTML code of the Hadoop Cluster configuration.
  • The AWS Access Key and Secret fields are encrypted in the DAP database.

(tick) Bug fixed.

8

SQL Related Fx Sheets ARE in an Error State When the Referenced Column Is Renamed
DAP-36322

Fx sheets now work as expected when users rename referenced columns in a source sheet.


(tick) Bug fixed.

9

Incorrect Formulas on SQL Sheets after Closing Error Dialog
DAP-36419

After closing error dialogs on an unsuccessful source sheet deletion, SQL sheets now show the correct statement in the multiline editor.


(tick) Bug fixed.

10

Should Use 1-Based Index Values for the SQL Substring Function
DAP-36440

SQL string functions now use 1-based indexing.


(tick) Bug fixed.

11

Tooltips in the Workbook Obstruct the View with JSON Data
DAP-36453

Characters are now displayed the same way as in the cells. Escaped characters are no longer displayed.


(tick) Bug fixed.

12

The Description Field Is Disabled in the Information Inspector
DAP-36472

The owner or user with capabilities can now write text in the description field.

(tick) Bug fixed.

13

Parquet Can't See the Custom Filesystem Class from the Connection Plug-in
DAP-36499

Parquet can now see a custom filesystem class from the connection plug-in.


(tick) Bug fixed.

14

Unable to Open or Run Workbooks after the Upgrade Due to NullPointerException
DAP-36591

Workbooks now open and run normally after upgrading.


(tick) Bug fixed.

15

Missing the Loading Spinner after Duplicating a Sheet
DAP-36593

Added the spinner automation to show when the page has completely loaded.


(tick) Bug fixed.

16

Out-of-order Sheet Local References Aren't Reordered Properly
DAP-36605

Out-of-order column references on a group by sheet no longer fail.


(tick) Bug fixed.

17

Not Possible to Drill from Null-Boolean Bucket In Visual Explorer
DAP-36623

Now possible to drill from a null-Boolean bucket.


(tick) Bug fixed.

18

Incorrect Result When Drilling from Null-boolean Bucket
DAP-36624

Results are now correct when drilling from a null-Boolean bucket.


(tick) Bug fixed.

19

Workbooks are Failing with an IndexOutOfBoundsException
DAP-36626

Workbooks can now open correctly.


(tick) Bug fixed.

20

Pivot Tables Are Throwing JS Exceptions When the Aggregate or Pivot Column Has Null Values
DAP-36643

Pivot tables now show the correct outcome when adding supported data into charts.


(tick) Bug fixed.

21

Not Possible to Resize Columns in Table Widgets
DAP-36646

Now possible to resize columns in table and pivot table widgets.


(tick) Bug fixed.

22

Label for RTA Plug-in Configuration Unclear
DAP-36647

Updated the "Elasticsearch processors" label to "Limit processor capacity to configured vCPUs per container".


(tick) Bug fixed.

23

XSS Reflection Attack Found in the File Upload Filename Dialog.
DAP-36648

No longer possible to craft a filename that causes an XSS reflection attack.


(tick) Bug fixed.

24

After a Logout Due to Inactivity, Login Information May Leak into New HTTP Session and Log in Again
DAP-36649

A User logout after a certain time of inactivity now succeeds.

(tick) Bug fixed.

25

Unable to Start RTA in a Secured Cluster with No User Home Folder
DAP-36665

RTA can be started in a secure Hadoop cluster without a "/user/" folder.


(tick) Bug fixed.

26

Issues When Reordering Columns in Grouped Sheets
DAP-36675

Out-of-order expressions are now evaluated in the correct order. There are no longer error conditions nor NULL values on GROUPBY sheets.


(tick) Bug fixed.

27

Computing an Expression from a Datameer Function Is Leading to Bad Performances
DAP-36706

Computations are now much faster.


(tick) Bug fixed.

7.1.3 Release Notes

Improvements

1

Support Snowflake ImportDAP-35693

The Snowflake connector supports importing data.

2

Add Support for Cloudera CDH 5.9.1DAP-36183

Support added for Cloudera CDH 5.9.1.


3

Add Support for Cloudera CDH 5.14.2DAP-36568

Support added for Cloudera CDH 5.14.2.

4

Add Support for Cloudera CDH 5.13.3 DAP-36569

Support added for Cloudera CDH 5.13.3.


3

Upgrade Tez to 0.8.5DAP-33482

Upgrade Tez library to latest release of 0.8.5.

4

Verify Data Export into Partitioned Hive Table When CDH 5.11 Is UsedDAP-34127

Ability to export into existing Hive tables with CDH 5.11.


5

Change Label Values on Functions So the Formula Editor Can Parse ThemDAP-35028

In the UI, all invalid characters are replace in the label string with zero value characters. Only  [ a-z, A-Z, 0-9] and comma characters are valid.

6

Visualize a Possibility to Add Optional Arguments in the FX Inspector TabDAP-35124

User are shown that there are other optional arguments possible for the function.


7

Remove the Usage of the Partition Cache When Determining Partition LocationDAP-35817

When exporting into an existing partitioned table, the partition location is found for pre-existing partitions with the partition cache.

8

Add Support for MapR 5.2.x + MEP 3.0.2DAP-34077

Support added for a variant of the existing MapR 5.2 that targets the combination of MapR 5.2. + MEP 3.0.2 (Hive 2.1)


9

Automatically Insert a Function Template by Double Clicking on Function Name in the Formula InspectorDAP-34606

Quickly insert a function template into the formula editor by double clicking on a function name in the FX inspector tab.


10

Update STDDEVS and STDDEVP Functions to Run FasterDAP-34685

Implemented STDDEVS and STDDEVP computations on double precision computations.

11

Add Support for HDP 2.6.4DAP-35688

Support added for HDP 2.6.4.


12

Update That Formula Editor Data Isn't Submitted When Losing Focus On the ActionDAP-35718

If the formula editor loses focus (e.g., another action in the workbook is performed), the current formula is no longer automatically submitted.

13

Autocomplete Improvements In the Formula EditorDAP-35784

  • When a user on a formula sheet types any letter, autocomplete offers functions and column names together. When selecting a column from the autocomplete list, the column name with # char is added to the editor.
  • When a user on a formula sheet types "#", they see the autocomplete choices with only columns names.
  • When a user on a formula sheet is editing a formula that references another sheet, the autocomplete shows only columns from the current and referenced sheet.


14

Add Documentation Links to the Formula Editor InspectorDAP-36423

Users can view the documentation about the functions available in the formula inspector.


Bug Fixes

1

Column Mapping Shall Be Persistent When Editing Jobs to Existing Tables
DAP-34011

 Ability to edit an export job configured in "Use Existing" mode, so that it isn't needed to define the mapping step again.

Resolution:

(tick) Bug fixed.

2

Infinity Is Not a Valid Double Value as per Json Specification in the Column Inspector
DAP-34312

If a column contains a column infinity, no visualization for the Flip Sheet can be created.

Resolution:

(tick) Bug fixed.

3

 The Focus Changes to the Last Sheet When Updating a Union Sheet of a Workbook
DAP-34816

If currently on a union sheet, after updating a workbook, the user should still be on the union sheet.

Resolution:

(tick) Bug fixed.

4

Renaming a Column in a Source Sheet of an SQL Sheet Breaks In-place Filter/Sort of That SQL Sheet
DAP-35286

The renaming of a colunm in formula sheet breakes any in-place filter on SQL sheets

Resolution:

(tick) Bug fixed.

5

Bigdecimal Column Exports with Scale 10 in Snowflake
DAP-35481

Exporting bigdecimal values to snowflake database cuts after 10 digits. The solution was to keep same as Hive, map bigdecimal to decimal (38,18).

Resolution:

(tick) Bug fixed.

6

Disable the Search Function in the Multiline Editor on Formula/SQL Sheets
DAP-35747

Using the search function in the multiline editor causes errors.

Resolution:

(tick) Bug fixed.

7

There Is a Warning in the Console When Adding Data into a Workbook
DAP-

Updated old plugins so that the warning isn't displayed in the console.

Resolution:

(tick) Bug fixed.

8

The Zoom Out Button in Visual Explorer Should Be Disabled When It's Not Possible to Zoom Anymore
DAP-35796

When it isn't possible to zoom out any more, the zoom out button should be disabled. (Line and Scatterplot).

Resolution:

(tick) Bug fixed.

9

A Strange Symbol Is Displayed When Typing Backtick in the Formula Editor
DAP-35820

Typing a backtick or a single/double quote character displays a strange symbol. This was happening on any keyboards that expect another character after a backtick. 

Resolution:

(tick) Bug fixed.

10

Inconsistent Formatting of Time Stamp on the X-Axis Label in Visual Explorer
DAP-35830

Fix the formatting for the time stamp in Visual Explorer.

Resolution:

(tick) Bug fixed.

11

The Formula's Placeholder Should Be Selected When Clicked in a Workbook.
DAP-35898

After choosing a function from autocomplete, the functions placeholders aren't interactive.

Resolution:

(tick) Bug fixed.

12

Datameer Type LIST(INTEGER), LIST<BIGINTEGER> Can't Be mapped to the Compatible Hive Type Array<int,bigint>
DAP-35913

Mapping validation must allow:

  • List<INTEGER> to Hive type array<int>
  • List<BIG_INTEGER> to Hive type array<bigint>

Resolution:

(tick) Bug fixed.

13

 Cases of Explorer Auto Closing When Selecting a Column in Drill Preview Dialog of Visual Explorer
DAP-35918

Explorer auto closes when a user selects a column in Drill Preview dialog.

Resolution:

(tick) Bug fixed.

14

The Value Slider Not Working In Smart Analytic Dialog Boxes
DAP-35960

The slider handle should be visible and adjustable. It represents the number in the input field to the right in the Smart Analytic settings.

Resolution:

(tick) Bug fixed.

15

Update Help Text in Connection Wizard for the Database Field
DAP-36016

Text has been updated to be more understandable.

Resolution:

(tick) Bug fixed.

16

Formulas in the Formula Editor of Multiline Mode Have to Be Deleted Twice to Delete Them
DAP-36022

When a formula is selected and the back key is pressed or a character is typed, the selection should be deleted or overwritten.

Resolution:

(tick) Bug fixed.

17

Impossible to Drill from String to String When Using a Stacked or Grouped Bar
DAP-36130

Chart type doesn't auto change during drilling so drilling from string to string is possible.

Resolution:

(tick) Bug fixed.

18

Updating a Workbook in a Workbook Chain Should Not Invalidate Transitive Downstream Workbooks
DAP-36132

The preview of an external sheet should not get invalidated if one of the referenced workbook sheets gets updated.

Resolution:

(tick) Bug fixed.

19

The Panning Cursor Is Displayed When the Toolbar Icon Is Disabled in Visual Explorer
DAP-36136

The panning cursor should be displayed only when the panning icon is enabled.

Resolution:

(tick) Bug fixed.

20

The Preview Shows the Number of Records on the Y-axis Even When Three Columns Are Selected in Visual Explorer
DAP-36139

For three columns, users should see x, y, and color aspects assigned to a column.

Resolution:

(tick) Bug fixed.

21

Correct the On-chart Filter Status after Drilling into a Range on a Line Chart in Visual Explorer
DAP-36164

The on chart filter status should show string values followed by "," and not by "...".

Resolution:

(tick) Bug fixed.

22

The Undo Feature Doesn't Work on the Max Bar Configuration in Visual Explorer
DAP-36185

The max bars configuration is an undoable action.

Resolution:

(tick) Bug fixed.

23

Exporting into a Hive Table with over 50 Partitions Fails with Too Many Open Files
DAP-36235

All partitions must be created and available.

Resolution:

(tick) Bug fixed.

24

Remove Remote Data Browser Feature Flag
DAP-36251

The Remote Data Browser feature is not avialable in this Datameer verison.

Resolution:

(tick) Bug fixed.

25

Splitting of Parquet Files Is Slow Because Due to Multiple Requests to the Namenode for Each File
DAP-36270

Workbooks show performance degradation as splitting Parquet files is taking a long time when there are many input files or if the namenode is busy. 

Resolution:

(tick) Bug fixed.

26

Use a Qualified Table Name in Snowflake SQL
DAP-36278

Exports to Snowflake only work for the default schema. The fix was to use a qualified table name in Snowflake SQLs.

Resolution:

(tick) Bug fixed.

27

Exporting to a Partitioned Hive Table Is Missing Records When Using Append Mode
DAP-36281

The export jobs runs successfully but not all records are accessible on the Hive side.

Resolution:

(tick) Bug fixed.

28

Downloading Workbook Data via Rest in NMU Does Not Return Data, Only the Column Names
DAP-36284

Downloading workbook data using the API with NMU now returns data.

Resolution:

(tick) Bug fixed.

29

The Workbook Is Missing the Horizontal Scrollbar on SQL and Formula Sheets Using the Multiline Editor
DAP-36316

The horizontal scrollbar isn't not visiable with SQL/formula sheets that use the multiline editor.

Resolution:

(tick) Bug fixed.

30

Record#copyColumn() Performance Regression
DAP-36317

Performance issues for joined sheets since the implementation causes getValue() to be called unnecessarily when copying fields into the join's result records.

Resolution:

(tick) Bug fixed.

31

Exporting to a Partitioned Hive Table Is Missing Records When Using Overwrite Mode
DAP-36324

The export jobs runs successfully but not all records are accessible on the Hive side.

Resolution:

(tick) Bug fixed.

32

Renaming a Source Sheet Breaks SQL sheets When Using a Statement Like 'SELECT Sheet1.* FROM Sheet1'
DAP-36327

Making a statement like this SELECT Sheet1.* FROM Sheet1and then renaming the source sheet makes the SQL sheet invalid.

Resolution:

(tick) Bug fixed.

33

Cell Background Color Not Restored after Mouseover for Table Widget
DAP-36340

The background color of cells should be restored when user is no longer mousing over the cell.

Resolution:

(tick) Bug fixed.

34

Pivot Table Widget Rows Display Incorrect Values After the First Row
DAP-36352

Display the correct data value for all cells in the Pivot Table widget.

Resolution:

(tick) Bug fixed.

35

The Multiline Editor Adds an Unnecessary Space after the Formula
DAP-36359

There should be no additional space added after the formula.

Resolution:

(tick) Bug fixed.

36

SmallJob Ignores "das Das.Job.Map-task.Memory" and Defaults to Run with a 1GB Container Size
DAP-36374

"das das.job.map-task.memory" can be used to configure the SmallJob task container size.

Resolution:

(tick) Bug fixed.

37

Reduce-Side Join Performance Regression
DAP-36388

Reduce-Side join had some performance regressions that cause it to spend too much time when spilling to disk. Performance has been increased.

Resolution:

(tick) Bug fixed.

38

Removing an Existing Formula Is Not Submited When Switching the Sheet/Column
DAP-36429

Removing a formula should submit when switching the focus the sheet or column.

Resolution:

(tick) Bug fixed.

39

The GROUPTTEST Function Template Is Highlighted in Red
DAP-36431

The template of values should use the standard black coloring.

Resolution:

(tick) Bug fixed.

40

Event Bus Threads Are Being Blocked. Advancedschedulingservice Is Not Triggering Jobs
DAP-36458

Datameer isn't triggering Data Driven jobs regularly following a recent change to activate Kerberos and Secure Impersonation.

Resolution:

(tick) Bug fixed.

41

Task Temporary Files/Directories Should Not Be Generated by Localdirallocator
DAP-36465

The LocalDirAllocator from Hadoop common are being used for allocating temporary files and directories in our cluster tasks, which is unnecessary.

Resolution:

(tick) Bug fixed.

42

Users Unable to Save Cluster Configuraiton Changes After Editing
DAP-36466

The settings in the cluster configuration settings were not savings after being edited.

Resolution:

(tick) Bug fixed.

43

Unknown Host Exceptions on EMR Relating to Visual Explorer
DAP-36467

Visual Explorer can now start on EMR without exceptions.

Resolution:

(tick) Bug fixed.

44

Exceptions During Job State Changes Lead to Blocked a Job Queue
DAP-36471

Job with errors register as errors and the job queue is no longer blocked.

Resolution:

(tick) Bug fixed.

45

The Explore Contect Menu Is Not Working As Expected
DAP-36478

"Explore" from the context menu in Visual Explorer now skips the Chart Previews dialog and shows charts with the selected column in the x-axis.

Resolution:

(tick) Bug fixed.

46

Visual Explorer Backend Fails When Driling from Null-Date Bucket
DAP-36479

VE now produces the correct results.

Resolution:

(tick) Bug fixed.

47

The Realtime Analytics Engine Fails to Start with High Availability Configuration
DAP-36547

When using an HDFS HA configuration, RTA no longer fails to start.

Resolution:

(tick) Bug fixed.

48

Empty Hive Table Import via a Data Link Leading to Division by Zero in Splitter
DAP-36552

Users should be able to set up a data link on in an empty Hive table.

Resolution:

(tick) Bug fixed.

49

Reorded Columns on a Unkept Sheet Showing the Wrong Results on the Referenced Sheet after a Workbook Run
DAP-36544

When reordering columns on a unkept sheet, the results on the referenced sheets are incorrect.

Resolution:

(tick) Bug fixed.

50

IF Function with Integer and Null Arguments Resolve to Float Type on Cluster Side When Used in an Aggregation Sheet
DAP-36387

Using an IF statement with a NULL value as the condition was causing workbooks to fail.

Resolution:

(tick) Bug fixed.

51

Unable to Configure Export Jobs Due to Inconsistent Config Instructions
DAP-36219

Updated the following configuation instructions:

  • In the field "Quote character"
    • change the field name to "Quote character:" (remove the "*")
    • make the field not mandatory (it's possible to leave blank)
  • In the field "Escape character"
    • change the field name to "Escape character:" (remove the "*")
    • make field not mandatory (it's possible to leave blank)
    • add the following infotext a second sentence "Or leave blank to not support escape characters."

Resolution:

(tick) Bug fixed.

52

JSON Plug-in Malfunctioning so That Artifacts Fail
DAP-36061

Correct functionality in the JSON plug-in. Test that artifacts from related plug-ins work correctly.

Resolution:

(tick) Bug fixed.

53

Workbook Won't Open or Run after Upgrade
DAP-35783

After upgrading from 5.11.30 to 6.1.x to 6.3.5, workbooks fail to open or run and throw an error.

Resolution:

(tick) Bug fixed.

7.1.2 Release Notes

Epics

1

Hive 2.1 Hortonworks SupportDAP-32623

Make Hive 2.1 Default for HDP-2.6.X Distributions from V7.1 Onwards

 DAP-34900

Enhance Existing Distribution Support for HDP 2.6. To Have Hive 2.1.X DAP-34076

Packaging of Hive Plug-in Should Select Proper Java Class Automatically DAP-34866

Update Hives2tasks.Createdefaultview() to Work with Hive 2 DAP-35183

2

Export into String Partitioned Hive Table and Storing as ParquetDAP-34136

Replace Export Partitioned Temp Table Approach by Write Data Directly into the Hdfs Partition Locations

 DAP-35544

Use Existing Hive Type Specific ObjectInspectors to Write Data for Existing Table DAP-35097

Enable Export of Datameer Column into Hive Partitioned Table (Including Mapping) DAP-34106

Enable Preventing Schema Mismatch While Export into Hive Table DAP-34119

Enable Support for Different Parquet Versions on Export into Hive Table (Minimum CDH 5.11 and Parquet 2.1) DAP-34120

Support Custom Output Format (E.g. Parquet) When Exporting to an Existing Hive Table DAP-34461

Enable Type Mapping of Datameer Integer to Hive Bigint DAP-35967

Add Limitation for RecordWriter Cache to Prevent OOM Error DAP-36001

3

Implement New S3 Export AdapterDAP-34485

 Export to Redshift via S3 Exporter and RR Copy

 DAP- 34887

Support Single Stream Multipart Uploading with Csv File Format DAP-34486

Support Avro File Format DAP-34886

Support IAM Role DAP-34888

Support Encrypted Buckets DAP-34889

Extract Utility Method to Create Amazon S3 DAP-35228

Make Plugin-S3 Available in Datameer 6.4, 7.0, And 7.1 DAP-35326

Provide Infrastructure That Jobflow Can Deal with Server Side Operations DAP-35863

Provide a DatameerJobLifeCycleListener DAP-36021

Improvements

1

Introduce the Databasecredentials Class That Holds All Properties Needed to Establish a Database Connection In SnowflakeDAP-36030

This is used for the import case so that the different database types can configure this object as needed.

2

Add Support for Cloudera CDH 5.14.0DAP-35499

Support added for Cloudera CDH 5.14.0


3

Add Support for Amazon EMR v5.11DAP-35505

Support added for Amazon EMR v5.11

4

Remove "Warning" Label from License WarningDAP-34259

Warnings should not be labeled as "Warning". This is inferred from the color (orange) and the warning icon.


5

Update Compaction Thresholds to Run More OftenDAP-34621

Default daily/monthly thresholds for running compaction have been updated.

6

Enable Type Mapping of Datameer Integer to Hive BigintDAP-35967

Exporting data into an existing Hive table, the Datameer Integer now maps to the Hive BigInt data type.


7

The Snowflake Database Should Only Be Configurable on the Data Store LevelDAP-35970

This helps simplify and keep imports running smoothly.

8

Add support for Cloudera CDH 5.13.2DAP-36063

Support added for Cloudera CDH 5.13.2.


Bug Fixes

1

Export Wizard Step "Mapping" Doesn't Have Type and Name Mapping Validation
DAP-34748

The wizard step "Mapping" of Datameer's Hive export has no validation.

Resolution:

(tick) Bug fixed.

2

Fix Unclear Error Messages for "Mapping Errors" On Hive Export Wizard
DAP-35181

Make error messages on the mapping step of the wizard more human readable.

Resolution:

(tick) Bug fixed.

3

Hive Export in Overwrite Mode Isn't Working
DAP-35723

If the mode "Overwrite" is used, Datameer doesn't replace the existing partition where the data will be added.

Resolution:

(tick) Bug fixed.

4

Partitioned Hive Exports Are Dropping Records with Empty Data Values
DAP-36157

Partitioned exports are dropping records with empty values.

Resolution:

(tick) Bug fixed.

5

 "Create New If Not Exist" Hive Exports Fail in Case the Table Doesn't Exist
DAP-36160

It should be possible to create a table while exporting into Hive.

Resolution:

(tick) Bug fixed.

6

Visual Explorer: Chart Level Filters Get Lost on Exploration Sheets
DAP-34841

When reopening Visual Exploration from an Exploration sheet, on chart filters (coming from a drill down or zoom) are no longer available. 

Resolution:

(tick) Bug fixed.

7

Visual Explorer: Custom Sort Order Doesn't Persist, When User Drills into Stacked/Grouped Bar
DAP-35571

Custom sort order should persist when user drills into stacked/grouped bar charts.

Resolution:

(tick) Bug fixed.

8

Visual Explorer: Undo and Redo Stack Should Reset on Re-open
DAP-35780

  • When users re-open Explorer, Undo and Redo stack resets.
  • The Undo should be disabled when users open Explorer via context menu.

Resolution:

(tick) Bug fixed.

9

Visual Explorer: Legends Overlap with the Widget When Changing from Simple to Stacked Bar
DAP-35804

Chart and legends should never overlap.

Resolution:

(tick) Bug fixed.

10

Visual Explorer: Drill Preview Shows Incorrect Date Binning Information 
DAP-35850

Drill Preview should show correct date binning.

Resolution:

(tick) Bug fixed.

11

Visual Explorer: Empty Label Isn't Displayed in the Chart and the Tooltip
DAP-35883

An empty label should be displayed in x-axis at all times.

Resolution:

(tick) Bug fixed.

12

Visual Explorer: Onhover State Doesn't Appear When a User Hovers Too Quickly to Unselected Element on Bar Charts
DAP-35909

The OnHover state should appear immediately.

Resolution:

(tick) Bug fixed.

13

Visual Explorer: Help Text Isn't Present in the Line Chart
DAP-35914

  • Help text should be present when users move their mouse inside of the chart.
  • When users change columns on the x-axis [date-integer and back to date], date column is binned.

Resolution:

(tick) Bug fixed.

14

Not Possible to Open Visual Explorer If RTA Sheet Are Created Before the Animation Is Finished
DAP-35917

Create sheet and Update sheet buttons should be disabled until the data is fully loaded.

Resolution:

(tick) Bug fixed.

15

Visual Explorer: Bar Doesn't Show Data after Drilling
DAP-35934

Chart should show data at all times.

Resolution:

(tick) Bug fixed.

16

Visual Explorer: Two Identical Conditions Are Added at the Same Time If Users Enter the Space Before the Actual Value
DAP-35936

  • The user is able to add a unique value only one at time.
  • If a user enters the same value twice, the custom text search displays it only once.

Resolution:

(tick) Bugs fixed.

17

Visual Explorer: Preview Doesn't Show Categories
DAP-35947

Even if preview is based on 5% of data, the category info should be displayed.

Resolution:

(tick) Bugs fixed.

18

Visual Explorer: Processed RTA Sheet Shows No Records Sometimes
DAP-35950

A processed RTA sheet should show valid information.

Resolution:

(tick) Bug fixed.

19

Visual Explorer: The X-Axis Changed Its Width on Bar Hover in Safari
DAP-35951

The X-axis should not change its width on bar hover.

Resolution:

(tick) Bug fixed.

20

Visual Explorer: Multiple Exceptions When a User Changes Column On the Y-Axis or X-Axis
DAP-35966

There should be no exceptions when users:

  • Change columns in any of the axis across all chart types.
  • Interact with config menus (change aggregation, sort order, etc).
  • Switch chart type.

Resolution:

(tick) Bug fixed.

21

Visual Explorer: Truncation Is Missing in the Preview When Using Internet Explorer for a Date Column
DAP-36037

Truncation is present when the preview shows two unbanned date columns.

Resolution:

(tick) Bug fixed.

22

Visual Explorer: Drill Down Leads to an Incorrect Result When Drilling into Special Char and (Empty)
DAP-36060

The same three bars should be displayed as a result when users select all three bars and drill into the same dimension.

Resolution:

(tick) Bug fixed.

23

Visual Explorer: A Scatterplot Preview Displays the Aggregation Function on the Y-axis
DAP-36065

The Scatterplot preview chart in the chart previews dialog should only show the column names, but not an aggregation function.

Resolution:

(tick) Bug fixed.

24

Visual Explorer: The Line Chart Shows Incorrect Colors for Color-Axis Column
DAP-36071

The line chart should show expected colors for a selected color-axis column.

Resolution:

(tick) Bug fixed.

25

Visual Explorer: Inconsistent Tooltip Implementation of Undo/Redo Vs Chart Type Icons
DAP-36126

Inconsistent implementation of Undo/Redo vs Chart type icons.

Resolution:

(tick) Bug fixed.

26

Visual Explorer: Preview Shows Incorrect Information for the Selected Segment
DAP-36127

The preview should show the correct information when users select a segment of data and drill.

Resolution:

(tick) Bug fixed.

27

Visual Explorer: Endless Loading When Using Undo If the User Changed Columns on the Axis
DAP-36137

The Undo feature should work as expected and undo one step only.

Resolution:

(tick) Bug fixed.

28

Non Processed Datalinks are Disabled in the Exchange Data Dialog in Workbooks
DAP-35215

A not triggered data link without preview data stored should be enabled in the exchange data dialog.

Resolution:

(tick) Bug fixed.

29

Missing Artifacts in the Git Plug-in
DAP-35249

When attempting to rollback a Workbook to a previous state using the enabled Git Plugin, it was observed that it was not represented in the Git Repo. 

Resolution:

(tick) Bug fixed.

30

Include Column Mapping Configuration Getting Lost While Duplicating/Copying Jobs
DAP-35254

  • Column mapping configuration should be accurate after duplicating/copying an export job.
  • Column mapping configuration should be accurate after backup/restoreing an export job.
  • Column mapping configuration should be accurate after downloading and injecting via restv2 api of an export job.

Resolution:

(tick) Bug fixed.

31

Computing of Subset of Columns in a Referenced Formula Sheet Results in Wrong Record Types
DAP-35280

For a special set up of referenced columns of non kept formula sheets, the workbook execution will fail. This is caused by incorrect computing of used columns in FormulaSheetBuilder.

Resolution:

(tick) Bug fixed.

32

 Restoring a Previously Deleted Sheet Should Respect the Previous Sheet Ordering
DAP-35306

Restoring a previously deleted sheet should respect the previous sheet ordering.

Resolution:

(tick) Bug fixed.

33

Problem When Toggling Empty Columns in a Workbook
DAP-35543

The UI looks abnormal when trying to hide empty columns of a workbook.

Resolution:

(tick) Bug fixed.

34

Sharing Unprocessed Job-configurations with Others Doesn't Sync Permissions to HDFS after Triggering with Another Analyst
DAP-35638

The permission sync to the HDFS folder isn't working correctly after an analyst runs a shared workbook.

Resolution:

(tick) Bug fixed.

35

Exceptions When Dragging a Column All the Way to the Right
DAP-35648

There should be no exceptions when dragging columns in a workbook.

Resolution:

(tick) Bug fixed.

36

Problems with Non Standard Latin Characters in the Multiline Formula Editor
DAP-35694

The font size for non latin characters should be the same as for latin characters.

Resolution:

(tick) Bug fixed.

37

Secure Validation Job Fails with - No Groups Found for User Datameer
DAP-35722

The secure validation job on the Hadoop page fails for the system user when LDAP is configured as authentication.

Resolution:

(tick) Bug fixed.

38

Column Metrics Incorrect for High Cardinality String Columns
DAP-35756

The numbers indicated on the histogram are much higher than the actual counts.

Resolution:

(tick) Bug fixed.

39

 Browse All Data for a Workbook with a Sorted Sheet Fails
DAP-35770

The numbers indicated on the histogram are much higher than the actual counts.

Resolution:

(tick) Bug fixed.

40

Copy/Pasting a Folder Doesn't Create the Right Dependencies
DAP-35814

A copied workbook has the dependencies to a original job when it should have dependencies to the new copied job.

Resolution:

(tick) Bug fixed.

41

Downloading Data via REST in Native Multi User Mode Doesn't Return Data, Only the Column Names
DAP-35852

Downloading data via REST is only returning the header information and not the data.

Resolution:

(tick) Bug fixed.

42

The Sort Dialog Doesn't Close with the Esc Key in a Workbook
DAP-35858

Every dialog should be able to be closed with the Esc key In a workbook.

Resolution:

(tick) Bug fixed.

43

Can't Navigate to the Input Field When Renaming a Column or Sheet
DAP-35859

It should be possible to navigate through the name input field for sheets and columns.

Resolution:

(tick) Bug fixed.

44

 Infographics Loading but Can't Be Edited
DAP-35871

The Infographics editing process was trying to execute before the infographic fully loaded.

Resolution:

(tick) Bug fixed.

45

Unable to Create Artifacts on Datameer on a Mac after Upgrading from 6.4 to 7.1
DAP-35899

Updating from Datameer 6.4 to 7.1 is showing a blank sceen upon completing.

Resolution:

(tick) Bug fixed.

46

Malformed Query While Accessing LDAP via SSL
DAP-35957

The LDAP plugin should still be able to connect to a LDAP server that supports pagination.

Resolution:

(tick) Bug fixed.

47

Parallel Index Creation from Different Users Can Lead to Wrong User in Index Metadata
DAP-35958

When Datameer creates an index, an existing ParleneSettings object is used. Change the user/token object in it and use it to serialize it to IndexSettings.

Resolution:

(tick) Bug fixed.

48

There is An Unnecessary Error Message Under Extension Points In Plug-in Configuration
DAP-35982

When opening the Admin Page -> Plug-ins page, an error message is displayed under "Extension Points".

Resolution:

(tick) Bug fixed.

49

Upgrade_db.sh Fails If the Database Is Not Named "dap"
DAP-35983

Running upgrade_db.sh on a database named 'foo' should work.

Resolution:

(tick) Bug fixed.

50

Auto Compaction and Migration Jobs Trigger Workbooks
DAP-35993

Workbooks shouldn't be triggered after compaction/migration jobs finish.

Resolution:

(tick) Bug fixed.

51

Null Pointer Exception on Cluster When Exporting to Snowflake
DAP-36029

Snowflake export in cluster mode should work.

Resolution:

(tick) Bug fixed.

52

Users/Group/Roles Sections in the Admin Tab Aren't Loading
DAP-36047

When trying to load Users/Groups/Roles sections at Datameer Admin tab, the page doesn't load properly.

Resolution:

(tick) Bug fixed.

53

Set Default Data Link Sampling Size to 5GB
DAP-36068

Samples run faster with 5GB sampling as compared to 50gb sampling that was the default.

Resolution:

(tick) Bug fixed.

54

Upgrading Leads to Incorrect Icons All Over the Datameer App
DAP-36080

After an upgrade (6.3.7 -> 6.4.6 -> 7.1.2, etc), icons all over the app are misplaced.

Resolution:

(tick) Bug fixed.

55

Upgrade to 6.4.3/7.1.2: ArrayIndexOutOfBounds on Multiple Workbooks
DAP-36110

After upgrading to version 6.4.3/7.1.2, an ArryIndexOutOfBounds error was given in the workbook execution.

Resolution:

(tick) Bug fixed.

56

Prevent Infinite Loop in SQL Query Planning
DAP-36131

Query planning shouldn't result in an infinite loop.

Resolution:

(tick) Bug fixed.

57

Downloading Data via REST in Native Multi User Mode Doesn't Return Data, Only the Column Names


DAP-36283

Downloading data via REST is only returning the header information and not the data.

Resolution:

(tick) Bug fixed.

7.1.1 Release Notes

Improvements

1

Support Added for MapR 6.0DAP-34743

Datameer works in unsecured/secured MapR 6.0 environments.

2

The Export Partitioned Temp Table Approach Has Been Replaced by Writing Data Directly into the HDFS Partition LocationsDAP-35544

Datameer has replaced the temp table approach and writes the data directly into the HDFS partition location in the expected table format.


3

Removal of the S3 Block ConnectorDAP-30808

This connector product is no longer available and removed from Datameer as an option.


4

Support Added to Bundle Datameer for MapR-5.2.2DAP-33817

Support for MapR-5.2.2 added.

5

Support Added to Bundle Datameer for HDP-2.5.5 and HDP-2.5.6DAP-33938

Support for HDP-2.5.5 and HDP-2.5.6 added.


6

Support Added to bundle Datameer for HDP-2.6.1 and HDP-2.6.2DAP-34130

Support for HDP-2.6.1 and HDP-2.6.2 added.

7

Support Added for Cloudera CDH 5.12.2DAP-35474

Support for Cloudera CDH 5.12.2 added.

8

Support Added for Cloudera CDH 5.13.1DAP-35339

Support for Cloudera CDH 5.13.1 added.


9

Limit the Usage of Userauthenticationdetails to Reduce Potential Password ExposuresDAP-35553

Remove the chance of an information leak of a password by not extending UserAuthenticationDetails from the User.

10

Provide the User Who Is Executing a Job Within the JobExecutionStartedEventDAP-35585

The log shows who triggered a job when subscribing to a JobExecutionStartedEvent


11

Increased Workbook Info Text VisiblityDAP-35695

The workbook info text indicating whether a sheet is being kept and the text indicating whether the sheet is partitioned have been made more visible.

Bug Fixes

1

Removed Columns Appear in the "Included Columns" Section in Join/Range Join Dialog
DAP-32034

If a column in a sheet is deleted, where the sheet is part of a join but the column is not, the column is still listed in the "included columns" section in the join dialog.

Resolution:

(tick) Bug fixed.

2

The BigInteger and BigDecimal Data Type Should Indicate That Min/Max/Mean are Approximate Values
DAP-33927

Show that these values are approximate values with use if the "~" symbol.

Resolution:

(tick) Bug fixed.

3

When the Date Column Contains Nulls the Workbook Shows an Error in a Binned Bucket
DAP-33999

A calculated sheet should display a blank bucket and respective count or group sum depending on aggregation selection for the measure.

Resolution:

(tick) Bug fixed.

4

The File Menu Contains Different Entries From the Browser Context Menu for Data Links
DAP-34114

"Configure" in the file menu should only be enabled if the selected file has "Configure" in its context menu.

Resolution:

(tick) Bug fixed.

5

Proper Info Dialog Missing in Workbooks When Smart Analytics Is Not Available Due to the License
DAP-34590

Info dialog should be disabled when the user tries to create a Smart Analytics sheet if the license doesn't include the feature.

Resolution:

(tick) Bug fixed.

6

Can't Rename an Artifact in the File Browser When an Uppercase Letter Is Replaced by a Lowercase and Vice Versa
DAP-34938

It should be possible to replace upper case letters with lower case letters and vice versa.

Resolution:

(tick) Bug fixed.

7

The Workbook Inspector Is Empty If No Preview Data Is Stored for a Datalink When Using Ranger/Sentry
DAP-35217

Workbook inspector isn't empty if a datalink with the option "don't store preview data" is selected.

Resolution:

(tick) Bug fixed.

8

An Outer Left Join Doesn't Display All Values from the Left Sheet
DAP-35407

An Outer Left join doesn't show expected behaviour and returns only matching values from two sheets (like an Inner join) instead of all values from the left side and matching values from the right one.

Resolution:

(tick) Bug fixed.

9

 Deleting the Formula in the Last Column in a Workbook Also Deletes the First Column
DAP-35492

Deleting formula from last column shouldn't affect other columns.

Resolution:

(tick) Bug fixed.

10

 Inspector Doesn't Refresh after Closing the Dependency View in the File Browser
DAP-35545

After switching back from dependency view to the file browser the file inspector should refresh and show the information for the current selected entity.

Resolution:

(tick) Bug fixed.

11

End Progress after Ignored Cascade Permission Setting During Main Rest Call
DAP-35551

The GET call has the state "End" after an ignore event.

Resolution:

(tick) Bug fixed.

12

Flipsheet Isn't Being Disabled When User Has No Permissions to View Full Data
DAP-35559

Disable the flipsheet button and show warning message to user when they don't have the correct permissions.

Resolution:

(tick) Bug fixed.

13

 ClusterSession Cleanup Fails to Delete Tez Recovery Files
DAP-35567

 In the EMR environment, jobs that completed successfully might see a failure in ClusterSession cleanup.

Resolution:

(tick) Bug fixed.

14

An Analyst Can Change Permissions on Other Job-Configurations Owners
DAP-35568

A non-owner without the capability "user can modify every file and folder" shouldn't be able to change permissions of other user's files.

Resolution:

(tick) Bug fixed.

15

An Analyst User Can't Execute Group Shared Job Configurations with Ldap Authentication
DAP-35574

An external user (that was imported as a user and not via group) should have execute permissions if their group has execute permissions.

Resolution:

(tick) Bug fixed.

16

The Pivot Table Widget Shows Unexpected Behavior
DAP-35584

  • When users uncheck RowTotal checkbox, the very right column should not disappear.
  • When users add several columns into the Measure field, the Pivot table should populate data in columnA, columnB, etc.
  • When Total is present (data is added into Pivot Dimension field) and users uncheck the RowTotal checkbox, the very right Total column should disappear.

Resolution:

(tick) Bugs fixed.

17

Excel Import Format Isn't Closing Open File Handles Correctly
DAP-35653

  • Clearn up the file handle after generating the preview.
  • Delete the temporary file after generating the preview.
  • The parser goes away after generating the preview.

Resolution:

(tick) Bugs fixed.

18

Remove Enable Impersonation from View on the Hadoop Cluster Page for Native Multi User Mode
DAP-35657

The Hadoop cluster page shows the Enable Impersonation disabled in native multi user mode. This might confuse the user because they could disable or enable it manuallly.

Resolution:

(tick) Bug fixed.

19

Move Checkbox about Preview Data in Data Link Wizard to save a Step
DAP-35659

Move the checkbox about preview generation to save step in the data link wizard.

Resolution:

(tick) Bug fixed.

20

Recordinspector Don't Support All Hive Column Types for a Partitioned Export
DAP-35662

Each Hive column type must be supported.

Resolution:

(tick) Bug fixed.

21

UserGroupInformationCache Doesn't Work as Intended with Native Multi User
DAP-35697

Add an expiration time to UserGroupInformationCache so it doesn't cause the cache to return instances of UserGroupInformation where the Kerberos TGT has been expired, resulting in failing job runs/HDFS accesses.

Resolution:

(tick) Bug fixed.

22

Don't Recompute the Sample on Column Rename Unless the Dependent Column Has an Error
DAP-35706

The sheet hash creation is using the column names which causes the sample to be recomputed if a user renames a column. This creates an unnecessary performance issue.

Resolution:

(tick) Bug fixed.

23

Ctrl-z (Undo) Also Undoes Workbook Operations
DAP-35742

Disable workbook hotkeys when Virtual Explorer is open.

Resolution:

(tick) Bug fixed.

24

The STARTOFWEEK and STARTOFMONTH Functions Don't Work on the Result of Group Operations
DAP-35751

Workbooks that have been created in Datameer versions before 6.4 and contain STARTOFWEEK or STARTOFMONTH functions applied to the result of GROUPBY should continue to work without a reconfiguration.

Resolution:

(tick) Bug fixed.

25

Enabling/Disabling Hot Keys Doesn't Work on Workbook
DAP-35771

All action related hot keys shouldn't be available when any workbook dialog is opened.

Resolution:

(tick) Bug fixed.

26

Drilling Multiple Levels in a Chart Causes Duplicate Filters in Query
DAP-35799

Filters for each drill level should only be sent once.

Resolution:

(tick) Bug fixed.

27

User Can't Select Data in a Line Chart after Switching from a Bar Chart
DAP-35800

Users should be able to select/brush data in line a chart after switching from a bar chart.

Resolution:

(tick) Bug fixed.

28

Disconnect Not Executed on ExportRecordProcessor When an Exception Is Thrown
DAP-35816

If an exception is thrown during a record procession in ExportRecordProcessor, the connection is never closed.

Resolution:

(tick) Bug fixed.




  • No labels