INFO
Within these release notes Datameer provides information and resolutions on improvements, bug fixes, and visual changes for 10.0.x maintenance release versions.
Visit Datameer's Help Center for additional information or contact your customer service representative.
Datameer 10.0.5
Improvements
1 | Add HBase 2.0 support for HDP 3.1.0 and HDP 3.1.4 | DAP-39823 |
|---|---|---|
Datameer now supports importing HBase data for HDP 3.1.0 and 3.1.4 based distributions Both are shipped with HBase 2.0 support. |
2 | Add Support for Amazon EMR v5.28.1 | DAP-39877 |
|---|---|---|
Datameer now supports Amazon EMR 5.28.1. |
3 | Add Support for Amazon EMR v5.29.0 | DAP-39878 |
|---|---|---|
Datameer now supports Amazon EMR 5.29.0. |
4 | Remove 'superuser' related properties from 'live.properties' | DAP-39910 |
|---|---|---|
The 'das.superuser.*' properties are now listed in the default properties only (disabled per default). |
Bug fixes
1 | Property API: Key-up event for property info input fields of property API not working | DAP-39015 |
|---|---|---|
A key-up event now gets recognized as a proper event and triggers the same actions as a general change event for input fields. |
|
Bug fixed.2 | Hive Export: Drop & Create new tables doesn't work for partitioned tables | DAP-39390 |
|---|---|---|
Datameer now validates Hive export definitions for partitioned tables and rejects those for 'Drop and create new table' as an unsupported operation. |
|
3 | Browser Search: Search results don't show correct results when changing the folder | DAP-39556 |
|---|---|---|
Datameer now updates the search results for folders if another folder from the file browser is selected. |
|
4 | Partition data table should be indexed for efficient group by queries | DAP-39662 |
|---|---|---|
To improve application performance and decrease load from Datameer's metadata database, indexes for 'data_partition.relative_path' and 'data_partition.index_key' have been added to the metadata database. Upgrade scripts persist the changes in Datameer's metadata database accordingly. |
|
5 | Hive 3.1: Can not create ZooKeeper Hive JDBC connection | DAP-39947 |
|---|---|---|
Hive JDBC connection with ZooKeeper can now be created and used for imports. |
|
Datameer 10.0.4
Improvements
1 | Workbook: SQL Editor should provide hint for all keyword types | DAP-39583 |
|---|---|---|
The autocomplete list now provides a hint if the selected keyword is a SQL statement, SQL function or SQL data type. |
Bug fixes
1 | Hive datalink to partitioned table with defer sampling shows an empty preview in the workbook | DAP-38816 |
|---|---|---|
Including partition columns when editing a datalink shows a preview in a workbook. |
|
2 | Cannot export Runtime Analytics sheet to Hive | DAP-39472 |
|---|---|---|
Runtime Analytic sheets can now be exported to Hive. |
|
3 | File Browser: Subfolders inside user's home folder also have home folder icon | DAP-39524 |
|---|---|---|
Only the user's home folder has the home icon. |
|
4 | LDAP users with more than 1,500 members in their group are not recognized | DAP-39680 |
|---|---|---|
All users within a group of more than 1,500 members can now be authenticated. |
|
5 | Workbook: 'Sheet has no column' error on filtered, sorted, encoding or pivot sheets when renaming column in a source sheet | DAP-39726 |
|---|---|---|
Renaming a column does not break the referenced sheet anymore. This affects all transform and data mining sheets. |
|
6 | 'Server error' message in File Browser when selecting the user's home folder | DAP-39767 |
|---|---|---|
The aforementioned error message isn't rendered anymore. |
|
7 | Import or export job run details page should not display 'Production Mode' information | DAP-39786 |
|---|---|---|
Import and export job run details pages don't render the 'Production Mode' information, as this is not relevant for these types. |
|
8 | Changing a formula will add an additional equals sign every time to the formula string | DAP-39830 |
|---|---|---|
Changing a formula doesn't add additional characters, like an equals (=) sign, anymore. |
|
9 | Plug-in Hive-JDBC: Include correct Hive JARs for EMR distributions | DAP-39843 |
|---|---|---|
The correct httpclient and httpcore JAR dependencies are now packaged with the plugin hive-jdbc for EMR distributions. |
|
Datameer 10.0.3
Improvements
1 | Add support for Hortonworks HDP 3.1.4 | DAP-39350 |
|---|---|---|
Datameer now supports Hortonworks HDP 3.1.4. |
Bug fixes
1 | Hive 2 Plug-in: Show an error when list of databases or tables fails or is empty | DAP-38408 |
|---|---|---|
Datameer shows a corresponding error message in the user interface if tables are not available from the Hive Metastore database or cannot be derived. |
|
2 | Admin Page → Job Details Page: 'Show Logfile' shows log in the same window | DAP-39520 |
|---|---|---|
Clicking the 'Show Logfile' button now shows the log file in a new tab. |
|
3 | Open Data Format: Can't delete sync table for one sheet and set table with the same name for another sheet | DAP-39525 |
|---|---|---|
Removing and adding a synchronization for another sheet with the same name is now possible in one step. |
|
4 | Workbook: Adding more than 5,000 characters string in the formula is always trimmed to 5,000 which causes the formula editor to highlight as error | DAP-39542 |
|---|---|---|
Datameer now returns the non-trimmed value for the raw formula to be displayed in the formula editor. |
|
5 | Visual Explorer: Opening the Visual Explorer in a workbook which contains only a formula sheet leads to an error | DAP-39621 |
|---|---|---|
Visual Explorer now opens without an error. |
|
6 | 'Migrating from one Hadoop cluster to another' link on admin Hadoop cluster page points to wrong version space | DAP-39734 |
|---|---|---|
The link now points to the correct version of the Datameer product documentation. |
|
7 | Google Data Proc: (Un)secure hdfs tool doesn't work | DAP-39757 |
|---|---|---|
The 'unsecure_hdfs_tool.sh' and 'secure_hdfs_tool.sh' scripts now work with Google Data Proc environments as well as with non-Google distributions. |
|
8 | WorkbookHealthCheck fails with java.lang.StackOverflowError exception | DAP-39805 |
|---|---|---|
Datameer's WorkbookHealthCheck can now run for a large number of workbooks in an environment (e.g. 15,000 workbooks or more). |
|
Datameer 10.0.2
Improvements
1 | Tableau Hyper Export: correct libstdc++ library version loading | DAP-39115 |
|---|---|---|
Datameer now injects the path to Tableau's native libraries into LD_LIBRARY_PATH for Tez environments when Tableau Server Datastores are used. This can be controlled via the custom property: das.tableau.hyper.native-library-path-injection={true | false}
|
2 | FileSplitter & InternalDatameerFileSplitter should use Hadoop FileSystem#listLocatedFileStatus for performance reasons | DAP-39516 |
|---|---|---|
| Datameer now shows improved performance when large numbers of files get imported via an import job or Datalink. |
3 | Add support for Cloudera CDH 6.3.2 | DAP-39657 |
|---|---|---|
| Datameer now supports Cloudera CDH 6.3.2. |
4 | Add support for Amazon EMR 5.28.0 | DAP-39695 |
|---|---|---|
| Datameer now supports Amazon EMR 5.28.0. |
Bug fixes
1 | Workbook: Context menu doesn't popup on double click on a value sometimes | DAP-38301 |
|---|---|---|
The context menu is opened when a workbook record entry gets double-clicked. |
|
2 | JDBC connection fails due to hardcoded unicode property | DAP-38958 |
|---|---|---|
The definition of 'useUnicode', 'characterEncoding' and 'charSet' as optional parameters for JDBC based connections is now allowed. The checkbox 'Enable Character Encoding' is now visible in the UI. |
|
3 | Admin page: Plug-ins can not be paused or disabled in Firefox version 69.0 | DAP-39398 |
|---|---|---|
A plug-in now can be paused, deleted and restarted again when using Firefox version 69.0 as web browser. |
|
4 | Workbook: Buttons are enabled in File Browser Dialog when they shouldn't | DAP-39495 |
|---|---|---|
Datameer now ensures that the 'Add Data' button, 'Exchange Data' button and 'Open Workbook' are enabled in the correct context only. |
|
5 | Workbook: When the 'Add Data' dialog is shown for a new workbook, it is not modal | DAP-39510 |
|---|---|---|
The 'Add Data' dialog is now modal. |
|
6 | Incorrect Daylight Saving Time (DST) related date value conversion during Hive import | DAP-39569 |
|---|---|---|
Datameer now properly handles DST related conversions while importing data values from Hive. |
|
7 | HDFS BlockLocations topology paths lost when converting BlockLocation into FileBlockLocation | DAP-39581 |
|---|---|---|
TopologyAwareAlgorithm now can optimize split combine operations depending on the data locality. |
|
8 | Workbook: Renaming the source column of an Encoding sheet leads to an error if submitted by sheet switch | DAP-39622 |
|---|---|---|
Renaming of a workbook column is handled when doing a sheet switch. |
|
9 | Workbook: Jump to Column does not work correctly | DAP-39655 |
|---|---|---|
The correct workbook column position is recognized when using 'Jump to Column' dialog. |
|
10 | Hardcoded Docu links should point to docu space configured in default.properties ('docu.url' ) | DAP-39693 |
|---|---|---|
Documentation links within Datameer now point to the correct page within the Datameer user documentation. |
|
Datameer 10.0.1
Improvements
1 | Remember previous column position when switching sheets in a workbook | DAP-22392 |
|---|---|---|
| After switching sheets or opening other workbooks, Datameer now switches back to the workbook sheet, row and column you were previously on. |
2 | File browser: show clickable links in dependency graph | DAP-38886 |
|---|---|---|
| When a node representing a Datameer artifact is clicked in the dependency graph the file browser navigates to the folder in which the artifact is stored. |
3 | Improve record encoding for Datameer's Big Integer and Big Decimal to be Hive compatible | DAP-39367 |
|---|---|---|
| Newly written and synced Parquet files are now compatible with and readable by Hive. |
4 | Housekeeping Service: encapsulate each Housekeeping task in its own exception handling. | DAP-39506 |
|---|---|---|
| Each Housekeeping task now encapsulates its own exception handling. |
5 | Optimize multimap value removal code in CombineOnlyDataLocalAlgorithm | DAP-39565 |
|---|---|---|
| Combining splits performance has been improved especially for a large number of splits to combine. |
Bug fixes
1 | Scheduled jobs remain indefinitely in the processing queue if the Kerberos password is changed | DAP-39474 |
|---|---|---|
A scheduled job occurring between a Kerberos password change no longer blocks the processing queue. |
|
2 | Hot deployment of a plug-in fails if the plug-in contains a DataStoreType implementation | DAP-38885 |
|---|---|---|
A plug-in containing a DataStoreType can now be installed and uninstalled in the 'Admin' tab section, (e.g. Hive plug-in.) |
|
3 | Deploy via Cloud Formation Template in AWS: Injected Examples aren't working | DAP-39160 |
|---|---|---|
Injected Examples are now backed by data sources in S3 and work for deployments on AWS EC2 instances as well. |
|
4 | Housekeeping performance degradation | DAP-39283 |
|---|---|---|
Improved robustness and traceability for housekeeping service allowing for the configuration of the number of HDFS artifacts to delete. |
|
5 | REST API to download results doesn't return all records by setting 'rest.download-data.records-max=0' | DAP-39386 |
|---|---|---|
Datameer respects the setting 'rest.download-data.records-max=0' and provides all records for the download. |
|
6 | Hive 2 plug-in: ImportJobs and Datalinks are failing on Hadoop Namenode and Resourcemanager high availability environments | DAP-39397 |
|---|---|---|
Hive 2 plug-in based Importjobs and Datalinks now runs successfully on high availability environments. |
|
7 | Workbook config: false errors on correct CRON pattern | DAP-39458 |
|---|---|---|
Datameer now recognizes a valid CRON pattern and does not throw an error on a valid pattern. |
|
8 | Visual Explorer should dismiss dialogs in order on 'Escape' | DAP-39504 |
|---|---|---|
Pressing 'Escape' dismisses the respective front dialog (e.g. x-y-axes definition dialog instead of closing the whole Visual Explorer dialog). (CT- "Escape" use double quotes ") |
|