Versions Compared

Old Version 4

changes.mady.by.user Charles Bishop (Deactivated)

Saved on

compared with

New Version 5

changes.mady.by.user Charles Bishop (Deactivated)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Datameer's release notes provide information and resolutions on improvements, bug fixes, and visual changes for 7.1.x maintenance release versions.  

Visit Datameer's Help Center for additional information or contact your customer service representative. 

tocDatameer's release notes provide information and resolutions on improvements, bug fixes, and visual changes for 7.1.x maintenance release versions.  

Visit Datameer's Help Center for additional information or contact your customer service representative. 

Table of Contents

7.1.3 Release Notes

Improvements

1

Support Snowflake ImportDAP-35693

The Snowflake connector supports importing data.

2

Add Support for Cloudera CDH 5.9.1DAP-36183

Support added for Cloudera CDH 5.9.1.


3

Add Support for Cloudera CDH 5.14.2DAP-36568

Support added for Cloudera CDH 5.14.2.

4

Add Support for Cloudera CDH 5.13.3 DAP-36569

Support added for Cloudera CDH 5.13.3.


3

Upgrade Tez to 0.8.5DAP-33482

Upgrade Tez library to latest release of 0.8.5.

4

Verify Data Export into Partitioned Hive Table When CDH 5.11 Is UsedDAP-34127

Ability to export into existing Hive tables with CDH 5.11.


5

Change Label Values on Functions So the Formula Editor Can Parse ThemDAP-35028

In the UI, all invalid characters are replace in the label string with zero value characters. Only  [ a-z, A-Z, 0-9] and comma characters are valid.

6

Visualize a Possibility to Add Optional Arguments in the FX Inspector TabDAP-35124

User are shown that there are other optional arguments possible for the function.


7

Remove the Usage of the Partition Cache When Determining Partition LocationDAP-35817

When exporting into an existing partitioned table, the partition location is found for pre-existing partitions with the partition cache.

8

Add Support for MapR 5.2.x + MEP 3.0.2DAP-34077

Support added for a variant of the existing MapR 5.2 that targets the combination of MapR 5.2. + MEP 3.0.2 (Hive 2.1)


9

Automatically Insert a Function Template by Double Clicking on Function Name in the Formula InspectorDAP-34606

Quickly insert a function template into the formula editor by double clicking on a function name in the FX inspector tab.


10

Update STDDEVS and STDDEVP Functions to Run FasterDAP-34685

Implemented STDDEVS and STDDEVP computations on double precision computations.

11

Add Support for HDP 2.6.4DAP-35688

Support added for HDP 2.6.4.


12

Update That Formula Editor Data Isn't Submitted When Losing Focus On the ActionDAP-35718

If the formula editor loses focus (e.g., another action in the workbook is performed), the current formula is no longer automatically submitted.

13

Autocomplete Improvements In the Formula EditorDAP-35784

  • When a user on a formula sheet types any letter, autocomplete offers functions and column names together. When selecting a column from the autocomplete list, the column name with # char is added to the editor.
  • When a user on a formula sheet types "#", they see the autocomplete choices with only columns names.
  • When a user on a formula sheet is editing a formula that references another sheet, the autocomplete shows only columns from the current and referenced sheet.


14

Add Documentation Links to the Formula Editor InspectorDAP-36423

Users can view the documentation about the functions available in the formula inspector.


Bug Fixes

1

Column Mapping Shall Be Persistent When Editing Jobs to Existing Tables
DAP-34011

 Ability to edit an export job configured in "Use Existing" mode, so that it isn't needed to define the mapping step again.

Resolution:

(tick) Bug fixed.

2

Infinity Is Not a Valid Double Value as per Json Specification in the Column Inspector
DAP-34312

If a column contains a column infinity, no visualization for the Flip Sheet can be created.

Resolution:

(tick) Bug fixed.

3

 The Focus Changes to the Last Sheet When Updating a Union Sheet of a Workbook
DAP-34816

If currently on a union sheet, after updating a workbook, the user should still be on the union sheet.

Resolution:

(tick) Bug fixed.

4

Renaming a Column in a Source Sheet of an SQL Sheet Breaks In-place Filter/Sort of That SQL Sheet
DAP-35286

The renaming of a colunm in formula sheet breakes any in-place filter on SQL sheets

Resolution:

(tick) Bug fixed.

5

Bigdecimal Column Exports with Scale 10 in Snowflake
DAP-35481

Exporting bigdecimal values to snowflake database cuts after 10 digits. The solution was to keep same as Hive, map bigdecimal to decimal (38,18).

Resolution:

(tick) Bug fixed.

6

Disable the Search Function in the Multiline Editor on Formula/SQL Sheets
DAP-35747

Using the search function in the multiline editor causes errors.

Resolution:

(tick) Bug fixed.

7

There Is a Warning in the Console When Adding Data into a Workbook
DAP-

Updated old plugins so that the warning isn't displayed in the console.

Resolution:

(tick) Bug fixed.

8

The Zoom Out Button in Visual Explorer Should Be Disabled When It's Not Possible to Zoom Anymore
DAP-35796

When it isn't possible to zoom out any more, the zoom out button should be disabled. (Line and Scatterplot).

Resolution:

(tick) Bug fixed.

9

A Strange Symbol Is Displayed When Typing Backtick in the Formula Editor
DAP-35820

Typing a backtick or a single/double quote character displays a strange symbol. This was happening on any keyboards that expect another character after a backtick. 

Resolution:

(tick) Bug fixed.

10

Inconsistent Formatting of Time Stamp on the X-Axis Label in Visual Explorer
DAP-35830

Fix the formatting for the time stamp in Visual Explorer.

Resolution:

(tick) Bug fixed.

11

The Formula's Placeholder Should Be Selected When Clicked in a Workbook.
DAP-35898

After choosing a function from autocomplete, the functions placeholders aren't interactive.

Resolution:

(tick) Bug fixed.

12

Datameer Type LIST(INTEGER), LIST<BIGINTEGER> Can't Be mapped to the Compatible Hive Type Array<int,bigint>
DAP-35913

Mapping validation must allow:

  • List<INTEGER> to Hive type array<int>
  • List<BIG_INTEGER> to Hive type array<bigint>

Resolution:

(tick) Bug fixed.

13

 Cases of Explorer Auto Closing When Selecting a Column in Drill Preview Dialog of Visual Explorer
DAP-35918

Explorer auto closes when a user selects a column in Drill Preview dialog.

Resolution:

(tick) Bug fixed.

14

The Value Slider Not Working In Smart Analytic Dialog Boxes
DAP-35960

The slider handle should be visible and adjustable. It represents the number in the input field to the right in the Smart Analytic settings.

Resolution:

(tick) Bug fixed.

15

Update Help Text in Connection Wizard for the Database Field
DAP-36016

Text has been updated to be more understandable.

Resolution:

(tick) Bug fixed.

16

Formulas in the Formula Editor of Multiline Mode Have to Be Deleted Twice to Delete Them
DAP-36022

When a formula is selected and the back key is pressed or a character is typed, the selection should be deleted or overwritten.

Resolution:

(tick) Bug fixed.

17

Impossible to Drill from String to String When Using a Stacked or Grouped Bar
DAP-36130

Chart type doesn't auto change during drilling so drilling from string to string is possible.

Resolution:

(tick) Bug fixed.

18

Updating a Workbook in a Workbook Chain Should Not Invalidate Transitive Downstream Workbooks
DAP-36132

The preview of an external sheet should not get invalidated if one of the referenced workbook sheets gets updated.

Resolution:

(tick) Bug fixed.

19

The Panning Cursor Is Displayed When the Toolbar Icon Is Disabled in Visual Explorer
DAP-36136

The panning cursor should be displayed only when the panning icon is enabled.

Resolution:

(tick) Bug fixed.

20

The Preview Shows the Number of Records on the Y-axis Even When Three Columns Are Selected in Visual Explorer
DAP-36139

For three columns, users should see x, y, and color aspects assigned to a column.

Resolution:

(tick) Bug fixed.

21

Correct the On-chart Filter Status after Drilling into a Range on a Line Chart in Visual Explorer
DAP-36164

The on chart filter status should show string values followed by "," and not by "...".

Resolution:

(tick) Bug fixed.

22

The Undo Feature Doesn't Work on the Max Bar Configuration in Visual Explorer
DAP-36185

The max bars configuration is an undoable action.

Resolution:

(tick) Bug fixed.

23

Exporting into a Hive Table with over 50 Partitions Fails with Too Many Open Files
DAP-36235

All partitions must be created and available.

Resolution:

(tick) Bug fixed.

24

Remove Remote Data Browser Feature Flag
DAP-36251

The Remote Data Browser feature is not avialable in this Datameer verison.

Resolution:

(tick) Bug fixed.

25

Splitting of Parquet Files Is Slow Because Due to Multiple Requests to the Namenode for Each File
DAP-36270

Workbooks show performance degradation as splitting Parquet files is taking a long time when there are many input files or if the namenode is busy. 

Resolution:

(tick) Bug fixed.

26

Use a Qualified Table Name in Snowflake SQL
DAP-36278

Exports to Snowflake only work for the default schema. The fix was to use a qualified table name in Snowflake SQLs.

Resolution:

(tick) Bug fixed.

27

Exporting to a Partitioned Hive Table Is Missing Records When Using Append Mode
DAP-36281

The export jobs runs successfully but not all records are accessible on the Hive side.

Resolution:

(tick) Bug fixed.

28

Downloading Workbook Data via Rest in NMU Does Not Return Data, Only the Column Names
DAP-36284

Downloading workbook data using the API with NMU now returns data.

Resolution:

(tick) Bug fixed.

29

The Workbook Is Missing the Horizontal Scrollbar on SQL and Formula Sheets Using the Multiline Editor
DAP-36316

The horizontal scrollbar isn't not visiable with SQL/formula sheets that use the multiline editor.

Resolution:

(tick) Bug fixed.

30

Record#copyColumn() Performance Regression
DAP-36317

Performance issues for joined sheets since the implementation causes getValue() to be called unnecessarily when copying fields into the join's result records.

Resolution:

(tick) Bug fixed.

31

Exporting to a Partitioned Hive Table Is Missing Records When Using Overwrite Mode
DAP-36324

The export jobs runs successfully but not all records are accessible on the Hive side.

Resolution:

(tick) Bug fixed.

32

Renaming a Source Sheet Breaks SQL sheets When Using a Statement Like 'SELECT Sheet1.* FROM Sheet1'
DAP-36327

Making a statement like this SELECT Sheet1.* FROM Sheet1and then renaming the source sheet makes the SQL sheet invalid.

Resolution:

(tick) Bug fixed.

33

Cell Background Color Not Restored after Mouseover for Table Widget
DAP-36340

The background color of cells should be restored when user is no longer mousing over the cell.

Resolution:

(tick) Bug fixed.

34

Pivot Table Widget Rows Display Incorrect Values After the First Row
DAP-36352

Display the correct data value for all cells in the Pivot Table widget.

Resolution:

(tick) Bug fixed.

35

The Multiline Editor Adds an Unnecessary Space after the Formula
DAP-36359

There should be no additional space added after the formula.

Resolution:

(tick) Bug fixed.

36

SmallJob Ignores "das Das.Job.Map-task.Memory" and Defaults to Run with a 1GB Container Size
DAP-36374

"das das.job.map-task.memory" can be used to configure the SmallJob task container size.

Resolution:

(tick) Bug fixed.

37

Reduce-Side Join Performance Regression
DAP-36388

Reduce-Side join had some performance regressions that cause it to spend too much time when spilling to disk. Performance has been increased.

Resolution:

(tick) Bug fixed.

38

Removing an Existing Formula Is Not Submited When Switching the Sheet/Column
DAP-36429

Removing a formula should submit when switching the focus the sheet or column.

Resolution:

(tick) Bug fixed.

39

The GROUPTTEST Function Template Is Highlighted in Red
DAP-36431

The template of values should use the standard black coloring.

Resolution:

(tick) Bug fixed.

40

Event Bus Threads Are Being Blocked. Advancedschedulingservice Is Not Triggering Jobs
DAP-36458

Datameer isn't triggering Data Driven jobs regularly following a recent change to activate Kerberos and Secure Impersonation.

Resolution:

(tick) Bug fixed.

41

Task Temporary Files/Directories Should Not Be Generated by Localdirallocator
DAP-36465

The LocalDirAllocator from Hadoop common are being used for allocating temporary files and directories in our cluster tasks, which is unnecessary.

Resolution:

(tick) Bug fixed.

42

Users Unable to Save Cluster Configuraiton Changes After Editing
DAP-36466

The settings in the cluster configuration settings were not savings after being edited.

Resolution:

(tick) Bug fixed.

43

Unknown Host Exceptions on EMR Relating to Visual Explorer
DAP-36467

Visual Explorer can now start on EMR without exceptions.

Resolution:

(tick) Bug fixed.

44

Exceptions During Job State Changes Lead to Blocked a Job Queue
DAP-36471

Job with errors register as errors and the job queue is no longer blocked.

Resolution:

(tick) Bug fixed.

45

The Explore Contect Menu Is Not Working As Expected
DAP-36478

"Explore" from the context menu in Visual Explorer now skips the Chart Previews dialog and shows charts with the selected column in the x-axis.

Resolution:

(tick) Bug fixed.

46

Visual Explorer Backend Fails When Driling from Null-Date Bucket
DAP-36479

VE now produces the correct results.

Resolution:

(tick) Bug fixed.

47

The Realtime Analytics Engine Fails to Start with High Availability Configuration
DAP-36547

When using an HDFS HA configuration, RTA no longer fails to start.

Resolution:

(tick) Bug fixed.

48

Empty Hive Table Import via a Data Link Leading to Division by Zero in Splitter
DAP-36552

Users should be able to set up a data link on in an empty Hive table.

Resolution:

(tick) Bug fixed.

49

Reorded Columns on a Unkept Sheet Showing the Wrong Results on the Referenced Sheet after a Workbook Run
DAP-36544

When reordering columns on a unkept sheet, the results on the referenced sheets are incorrect.

Resolution:

(tick) Bug fixed.

50

IF Function with Integer and Null Arguments Resolve to Float Type on Cluster Side When Used in an Aggregation Sheet
DAP-36387

Using an IF statement with a NULL value as the condition was causing workbooks to fail.

Resolution:

(tick) Bug fixed.

51

Unable to Configure Export Jobs Due to Inconsistent Config Instructions
DAP-36219

Updated the following configuation instructions:

  • In the field "Quote character"
    • change the field name to "Quote character:" (remove the "*")
    • make the field not mandatory (it's possible to leave blank)
  • In the field "Escape character"
    • change the field name to "Escape character:" (remove the "*")
    • make field not mandatory (it's possible to leave blank)
    • add the following infotext a second sentence "Or leave blank to not support escape characters."

Resolution:

(tick) Bug fixed.

52

JSON Plug-in Malfunctioning so That Artifacts Fail
DAP-36061

Correct functionality in the JSON plug-in. Test that artifacts from related plug-ins work correctly.

Resolution:

(tick) Bug fixed.

53

Workbook Won't Open or Run after Upgrade
DAP-35783

After upgrading from 5.11.30 to 6.1.x to 6.3.5, workbooks fail to open or run and throw an error.

Resolution:

(tick) Bug fixed.

7.1.2 Release Notes

Epics

1

Hive 2.1 Hortonworks SupportDAP-32623

Make Hive 2.1 Default for HDP-2.6.X Distributions from V7.1 Onwards

 DAP-34900

Enhance Existing Distribution Support for HDP 2.6. To Have Hive 2.1.X DAP-34076

Packaging of Hive Plug-in Should Select Proper Java Class Automatically DAP-34866

Update Hives2tasks.Createdefaultview() to Work with Hive 2 DAP-35183

2

Export into String Partitioned Hive Table and Storing as ParquetDAP-34136

Replace Export Partitioned Temp Table Approach by Write Data Directly into the Hdfs Partition Locations

 DAP-35544

Use Existing Hive Type Specific ObjectInspectors to Write Data for Existing Table DAP-35097

Enable Export of Datameer Column into Hive Partitioned Table (Including Mapping) DAP-34106

Enable Preventing Schema Mismatch While Export into Hive Table DAP-34119

Enable Support for Different Parquet Versions on Export into Hive Table (Minimum CDH 5.11 and Parquet 2.1) DAP-34120

Support Custom Output Format (E.g. Parquet) When Exporting to an Existing Hive Table DAP-34461

Enable Type Mapping of Datameer Integer to Hive Bigint DAP-35967

Add Limitation for RecordWriter Cache to Prevent OOM Error DAP-36001

3

Implement New S3 Export AdapterDAP-34485

 Export to Redshift via S3 Exporter and RR Copy

 DAP- 34887

Support Single Stream Multipart Uploading with Csv File Format DAP-34486

Support Avro File Format DAP-34886

Support IAM Role DAP-34888

Support Encrypted Buckets DAP-34889

Extract Utility Method to Create Amazon S3 DAP-35228

Make Plugin-S3 Available in Datameer 6.4, 7.0, And 7.1 DAP-35326

Provide Infrastructure That Jobflow Can Deal with Server Side Operations DAP-35863

Provide a DatameerJobLifeCycleListener DAP-36021

Improvements

1

Introduce the Databasecredentials Class That Holds All Properties Needed to Establish a Database Connection In SnowflakeDAP-36030

This is used for the import case so that the different database types can configure this object as needed.

...

8

Add support for Cloudera CDH 5.13.2DAP-36063

Support added for Cloudera CDH 5.13.2.


Bug Fixes

1

Export Wizard Step "Mapping" Doesn't Have Type and Name Mapping Validation
DAP-34748

The wizard step "Mapping" of Datameer's Hive export has no validation.

Resolution:

(tick) Bug fixed.

...

45

Unable to Create Artifacts on Datameer on a Mac after Upgrading from 6.4 to 7.1
DAP-35899

Updating from Datameer 6.4 to 7.1 is showing a blank sceen upon completing.

Resolution:

(tick) Bug fixed.

46

Malformed Query While Accessing LDAP via SSL
DAP-35957

The LDAP plugin should still be able to connect to a LDAP server that supports pagination.

Resolution:

(tick) Bug fixed.

...

54

Upgrading Leads to Incorrect Icons All Over the Datameer App
DAP-36080

After an upgrade (6.3.7 -> 6.4.6 -> 7.1.2, etc), icons all over the app are misplaced.

Resolution:

(tick) Bug fixed.

55

Upgrade to 76.4.3/7.1.2: ArrayIndexOutOfBounds on Multiple Workbooks
DAP-36110

After upgrading to version 6.4.3/7.1.2, an ArryIndexOutOfBounds error was given in the workbook execution.

Resolution:

(tick) Bug fixed.

...

57

Downloading Data via REST in Native Multi User Mode Doesn't Return Data, Only the Column Names


DAP-36283

Downloading data via REST is only returning the header information and not the data.

Resolution:

(tick) Bug fixed.

7.1.1 Release Notes

Improvements

1

Support Added for MapR 6.0DAP-34743

Datameer works in unsecured/secured MapR 6.0 environments.

...

11

Increased Workbook Info Text VisiblityDAP-35695

The workbook info text indicating whether a sheet is being kept and the text indicating whether the sheet is partitioned have been made more visible.

Bug Fixes

1

Removed Columns Appear in the "Included Columns" Section in Join/Range Join Dialog
DAP-32034

If a column in a sheet is deleted, where the sheet is part of a join but the column is not, the column is still listed in the "included columns" section in the join dialog.

Resolution:

(tick) Bug fixed.

...