INFO
Within these release notes Datameer X provides information and resolutions on improvements, bug fixes, and visual changes for 11.1.x maintenance release versions.
Visit Datameer's Help Center for additional information or contact your customer service representative.
Datameer X 11.1.13
Improvements
| 1 | Supported Hadoop Distributions: Add support for Amazon EMR 5.34.0 | DAP-42336 |
|---|---|---|
Datameer X now supports Amazon EMR version 5.34.0. |
| 2 | REST API: Cascading permissions can be triggered via the REST API | DAP-42337 |
|---|---|---|
Cascade permissions can now be triggered via the REST API call. Example: curl -v -u '<username>:<password>' -X POST -H "Content-Type:application/json" -d '{"owner":"<ownername>","resetGroupPermissions":true,"sharedGroups":[{"group":"<groupname>","readable":true,"writable":true,"executable":true,"readFullData":true}],"others":{"<groupname>":"All Users","readable":true,"writable":false,"executable":false,"readFullData":false}}' 'http://<Datameer-serverIP>:<port-number>/api/filesystem/folders/<folderID>/permission/recursive'
|
Bug Fixes
| 1 | Workbook: Job Graph shows wrong Workbook Details | DAP-42306 |
|---|---|---|
The Job graph now displays the details for the correct Workbook execution it belongs to. |
|
| 2 | JSON: JSON Parser should not update the preview for every checkbox selected/ deselected | DAP-42313 |
|---|---|---|
Clicking the new "Update Preview" button now refreshes the preview, so the user can select/ deselect as many nodes as they want without having to wait for a UI refresh each time. |
|
| 3 | Security: Bulk permissions dialog must prevent owner changes if there is job data or job history | DAP-42323 |
|---|---|---|
The bulk permissions change dialog only permits changing the owner if there is no associated import/ workbook job data/ history. |  Bug fixed. |
| 4 | Security: SAML plugin - Group sharing does not work | DAP-42329 |
|---|---|---|
| After fixing the plugin, members of a user group should have appropriate access to files and folders in the Datameer UI that have been shared within this group. | Bug fixed. |
| 5 | Import/Export: Compute 'bytes_processed' column from scratch from the data objects | DAP-42332 |
|---|---|---|
| When creating the usage statistics report, the values from column ‘bytes_processed’ are now measured correctly. | Bug fixed. |
| 6 | Workbook: Can't start 'Create New Workbook' dialog in the folder that has a '+' in the name. | DAP-42339 |
|---|---|---|
| A user can start the 'Create New Workbook' dialog although the folder name contains a '+'. | Bug fixed. |
| 7 | Workbook: Missing documentation reference for several Workbook functions | DAP-42320 |
|---|---|---|
The documentation links for the following Workbook functions have been added to the function tab:
| Bug fixed. |
Datameer X 11.1.12
Improvements
| 1 | Workbook: Allow ADDTODATE function to use a non-static value as a second argument | DAP-42322 |
|---|---|---|
The ADDTODATE function now takes a non-static value as a second argument with the new syntax: ADDTODATE(<date>; <string/another column + date constant> |
| 2 | Import/ Export: Implement %partition% in Export Job file mapping for Parquet and Avro files | DAP-42311 |
|---|---|---|
| As of now, an Avro/ Parquet export of a time-partitioned sheet directly to the HDFS works with the '/myexport/%partition%/myfile' path when using %partition% as a file name placeholder. |
Bug Fixes
| 1 | Authentication: SAML authentication - Invalid User Role Exception | DAP-42318 |
|---|---|---|
An active Datameer X user can always log in regardless of the permissions assigned to the role. |
|
| 2 | Import: HBase Plug-in - Connection/ Import Job failure | DAP-42315 |
|---|---|---|
After improving the HBase plugin, the connection as well as Import Jobs are working again. |
|
| 3 | External Systems: Incorrect mapping for BIG_DECIMAL columns | DAP-42309 |
|---|---|---|
Datameer X BIG_DECIMAL columns are not supported for Hive table mapping when a workbook sheet is synced via the External System feature to Hive. For that, the Hive table must not contain BIG_DECIMAL columns. | Bug fixed. |
| 4 | Import/ Export: Can't create the Postgres database driver when Datameer X is using Java11 | DAP-42325 |
|---|---|---|
| The Postgres database driver can be created when using Java11version. | Bug fixed. |
Datameer X 11.1.11
Improvements
| 1 | Connections: Google BigQuery - DataLink queries all records from a target table | DAP-42283 |
|---|---|---|
When creating a data link to a Google BigQuery connection, Datameer now only uses the amount of records that is needed to create the sample. For that, select "FIRST_N_RECORDS" in the 'Sampling Mode' section from the 'Scheduling' tab. This functionality is useful to reduce the cost of transferring data from the database to the cloud. |
| 2 | Export: Add seconds and milliseconds as file path placeholders | DAP-40874 |
|---|---|---|
Datameer now provides the file path placeholder support for seconds (pattern: %sec%) as well as for milliseconds (%ms%) for file exports. |
Bug Fixes
| 1 | Workbook: Variables are highlighted red in the Formula Builder | DAP-42290 |
|---|---|---|
Variables are not highlighted in red in the Formula Builder unless there is a syntax error. |
|
| 2 | Security: Update event logging plug-in regarding log4shell/ log4j and retire RTA plug-in | DAP-42307 |
|---|---|---|
The event logging plug-in has been fixed regarding the log4shell functionality. Furthermore the RTA plug-in has been retired. |
|
| 3 | JSON Parsing: JSON parser tool should automatically deselect child nodes if the parent node is deselected | DAP-42299 |
|---|---|---|
| When deselecting a parent node within the JSON array, all child nodes are automatically deselected for the user. |
|
Datameer X 11.1.10
Improvements
| 1 | Connections: JDBC connection - Data Link queries all or a subset of records from a target table | DAP-42276 |
|---|---|---|
Datameer X can now limit the number of selected records to the first n records of a table (n as the configured number of sample records). |
| 2 | Supported Hadoop Distributions: Add Support for Cloudera Private Cloud / Cloudera Runtime 7.1.7 | DAP-42296 |
|---|---|---|
Datameer X now supports Cloudera CDP/ Cloudera Runtime 7.1.7. |
Bug Fixes
| 1 | Security: Log4j v2 security breach (CVE-2021-44228) | DAP-42300 |
|---|---|---|
Datameer X now has added {nolookups} tag to log output patterns of log4j v2. |
|
| 2 | Import: Datameer drops trailing spaces from the string | DAP-42291 |
|---|---|---|
Datameer X does not drop space characters at the end of a string anymore while parsing it as a 'Fixed Width' object. |
|
| 3 | Plug-ins: BigQuery - unable to list tables if a table with "SNAPSHOT" type exists in the dataset | DAP-42285 |
|---|---|---|
'Com.google.cloud' client libraries have been updated to version 1.32.2, therefore they can handle the "SNAPSHOT" type. |
|
| 4 | Import/ Export: BigQuery view import & JDBC exports create temporary tables with "Datameer" in its name | DAP-42284 |
|---|---|---|
Datameer X does not use "Datameer" as substring during table creation anymore. |
|
| 5 | Export: Cluster execution of PowerBI ExportJob fails | DAP-42281 |
|---|---|---|
A PowerBI export now succeeds while executed as job executed on the cluster. |
|
| 6 | Import: HBase - 'NoSuchColumnFamilyException' and Zookeeper connects to localhost with Tez job | DAP-42280 |
|---|---|---|
Datameer X runs HBase import jobs successfully in secured and unsecured cluster environments. |
|
| 7 | Export: Datameer database export jobs randomly fail because of HDFS permissions issue | DAP-42275 |
|---|---|---|
Datameer export jobs now work reliable again in secured cluster environments. |
|
| 8 | Execution Engine: Job that processes broken a GZIP file never completes | DAP-42269 |
|---|---|---|
Datameer X now handles corrupted GZIP compressed files gracefully and terminates after importing all readable records. |
|
| 9 | FileBrowser: Forbid users to create directories at the top-level folder | DAP-42214 |
|---|---|---|
Datameer X does not revert the FileBrowser's root folder permission during a restart. |
|
Datameer X 11.1.9
Improvements
| 1 | Security: Implement Proxy for Azure Blob Storage (wasb/ wasbs) | DAP-42265 |
|---|---|---|
You can now implement properties for routing wasb/ wasbs traffic from the Datameer Application server and Data Nodes via a proxy server when connecting to the Azure Blob Storage. |
| 2 | Supported Hadoop Distributions: Add support for Amazon EMR v6.4.0 | DAP-42268 |
|---|---|---|
| Datameer X now supports Amazon EMR version 6.4.0. |
Bug Fixes
| 1 | Datameer on Amazon EMR: Job logs are accumulated in the local temp folder before pushed to Amazon S3 | DAP-42271 |
|---|---|---|
The customer switched to Hadoop’s S3A protocol for the EMR grid mode & metadata reads/ writes, log streaming etc. The DatameerS3 protocol is still in use for imports/ exports due to backward compatibility and all various DatameerS3 & Amazon S3 connection settings (region, endpoint, IAM with assumed role mode, …). |
|
Datameer X 11.1.8
Bug Fixes
| 1 | Security: 'SSLHandshakeException' - Protocol is not appropriate | DAP-42262 |
|---|---|---|
| Creating a SSL-secured IMAP connection can now be established after updating the libraries. |
|
| 2 | UI performance: Delays in displaying artifacts/ folders deletion results | DAP-42247 |
|---|---|---|
The entire Folder Tree will not be reloaded anymore when an artifact has been deleted. Only the deleted artifacts and folders are not shown in the Folder Tree anymore. |
|
| 3 | Cascading permissions: Progress bar doesn't reflect the current status - completion notification is not user-friendly | DAP-42245 |
|---|---|---|
The progress bar now reflects the current progress for the process. Errors from here are logged in the conductor.log file. |
|
Datameer X 11.1.7
New Features
1 | Admin: Job Scheduler - Introduce a control ability to schedule jobs | DAP-42008 |
|---|---|---|
We introduce a new capability for Datameer X users which can schedule jobs. This capability can be enabled/ disabled in the 'Admin' tab → 'Roles'. |
Improvements
| 1 | Export: PostgreSQL/ MySQL/ ClickHouse - Show new textbook for 'Pre-Hook SQL Statement' if the capability is set | DAP-41856 |
|---|---|---|
| You can now enter one SQL statement to be executed before performing an export in the section 'Pre-Hook' when configuring an export job. If the pre-hook fails, the whole export job will be failing. This will also fail, when the export job has a defined pre-hook statement but the job owner does not have the capability to enter it. Note that the SQL statement is not restricted in any way and it has no unintended effects. |
| 2 | Export: New capablity 'SQL statement before export execution' | DAP-41857 |
|---|---|---|
| The new capability 'Pre-Hook SQL' allows to create, edit and delete a pre-hook SQL statement before an export job execution and can be set in the 'Admin' tab → 'Roles'. This capability is only set per default for the admin user. |
Bug Fixes
| 1 | Import: Google BigQuery - Datameer X can not convert Google BigQuery DATE to Datameer X DATE format | DAP-42220 |
|---|---|---|
| When importing data from Google BigQuery to Datameer X, the correct pattern is used to convert from Google BigQuery DATE format to Datameer X DATE format. |
|
| 2 | File Browser: Artifacts details sorting issues | DAP-42191 |
|---|---|---|
Sorting artifacts in the File Browser works properly for all columns again and does not reset when scrolling. |
|
| 3 | Documentation: Broken documentation link for the export job configuration dialog | DAP-42188 |
|---|---|---|
The documentation link for 'File Path and File Name Patterns' within the export job wizard now points to the correct documentation page. |
|
| 4 | REST API: Curl command for uploading a license should not create a user session | DAP-41581 |
|---|---|---|
| Using the curl command for uploading a license does not increase the session count for user sessions any more. | Bug fixed. |
| 5 | File Backup: Error when backing up folder in the GUI | DAP-42241 |
|---|---|---|
| A file backup works as expected again after patching Datameer X. | Bug fixed. |
| 6 | Setup: 'Enable-ssl-customization.sh' should actually create 'ssl.ini' | DAP-42199 |
|---|---|---|
| When executing the 'enable-ssl' script, the HTTP module ist automatically disabled and the HTTPS/ SSL module enabled. Furthermore the 'start.d' file and 'ssl.ini' are created to contain all default values and standard properties. | Bug fixed. |
Datameer X 11.1.6
New Features
| 1 | Workbook Functions: New 'NETWORKDAYS' function | DAP-42079 |
|---|---|---|
You can now use the new Workbook function 'NETWORKDAYS'. Using this function returns the number of the whole working days between a start date and an end date. Working days exclude weekend days and any dates that are identified as holidays. |
Bug Fixes
| 1 | Documentation: Wrong documentation link in file based export job for file and date pattern | DAP-42175 |
|---|---|---|
| When creating a file based export job and clicking on the help link in the export job wizard, you are now redirected to the correct documentation link. |
|
| 2 | Connection: Twitter REST API - Can't get token, improve error message | DAP-42108 |
|---|---|---|
If a user tries to configure a Twitter Rest API and pressing the 'Authorize Datameer to retrieve data' button results in an error, now the actual error message is shown. |
|
| 3 | Workbook: 'Close Workbook' dialog appears every second time when closing an existing Workbook with no changes | DAP-42044 |
|---|---|---|
When closing an open Workbook, in which no changes were applied, the 'Close Workbook' dialog is not displayed at no time. |
|
| 4 | Workbook: After renaming a column with more characters than allowed, the previous name is not displayed | DAP-41654 |
|---|---|---|
| When renaming a column with more than 255 characters, the previous name is displayed again for that column. | Bug fixed. |
| 5 | Workbook: Status bar changes when renaming a column from a join/ formula sheet | DAP-41642 |
|---|---|---|
| After renaming a join/ formula sheet in a processed Workbook, the correct status bar at the bottom of the Workbook is displayed. | Bug fixed. |
| 6 | Import/ Export: PowerBI - Creating a connection and export jobs fail | DAP-41634 |
|---|---|---|
| A user can now create a connection to PowerBI again. Configuring and running export jobs is possible again as well. | Bug fixed. |
| 7 | Workbook: Checkbox in JSON 'X-Ray View' must be clicked twice | DAP-42138 |
|---|---|---|
| The checkbox of a node in the JSON 'X-Ray View' must be clicked once to enable it, as expected. | Bug fixed. |
Datameer X 11.1.5
New Features
| 1 | Import/ Export: Salesforce Bulk API imports | DAP-21069 |
|---|---|---|
The Salesforce Connector now uses the Bulk API 2 to import data via a REST API. For running bigger datasets, custom properties for the import job are required, e.g. 'datameer.salexforce.maxrecord-per-result-request. |
| 2 | Execution Engine: Allow jobs bypassing the Job Scheduler queue | DAP-41875 |
|---|---|---|
Jobs can now be moved in the Job Scheduler queue. For that a new checkbox is included in the scheduling sections in Import/ Export/ Workbook Details wizard: 'Bypass Job Queue'. Jobs with that configuration will be picked always first by the Job Scheduler and ignore the maximal concurrent running jobs. A new role capability controls whether a user is allowed to use this option. |
| 3 | Workbook functions: New 'REGEXTRACT_LIST' function | DAP-42147 |
|---|---|---|
| You can now use the 'REGEXTRACT_LIST' function. Using the function with data type 'string' extracts tokens that match a regular expression. It returns 'null' in case the string has no RegEx matches and returns a list instead of a string. If the string has a single RegEx match, the function returns a single element list. If the string has no RegEx matches, the function returns an empty list and if the string has multiple RegEx matches, the function returns all of them as the list elements. |
Improvements
1 | Supported Hadoop Distributions: Add support for Amazon EMR v6.3.0 | DAP-42063 |
|---|---|---|
Datameer X now supports Amazon EMR version 6.3.0. |
| 2 | Supported Hadoop Distributions: Add support for Amazon EMR v5.33.0 | DAP-42064 |
|---|---|---|
| Datameer X now supports Amazon EMR version 5.33.0. |
| 3 | Workbook/ Export : Enable sliding time window export of files by defining the partition column - partitioned export | DAP-39796 |
|---|---|---|
| You can now use the new placeholder '%partition%' for the target path and the file names for export jobs. This placeholder can only be used, when the source Workbook sheet is partitioned. When set, the placeholder will be replaced by the partition value returned by a partition filter which is configured in the configuration of the export job. At least, if a filter returns more than one partition, the export job will be creating a separate file or folder for each position. |
| 4 | Import: Oracle Eloqua - Importing Data into Datameer X | DAP-42077 |
|---|---|---|
| You can now ingest import data from Oracle Eloqua into Datameer X to receive campaign responses. For that, a JDBC driver is needed. |
| 5 | REST API: Admins can pause and resume the job scheduler and auto compaction | DAP-36390 |
|---|---|---|
| You can now pause and resume the job scheduler and auto compaction with REST API commands. |
Bug Fixes
| 1 | Workbook: Repoiting - 'NullPointerException' if the column to be repointed is blank | DAP-42141 |
|---|---|---|
| When repointing columns from a source sheet to a duplicated sheet, there is no 'NullPointerException' error anymore. |
|
| 2 | Upgrading Datameer X: Upgrade to Datameer X version 10.1.9 is blocked | DAP-42131 |
|---|---|---|
After fixing a swallowed SQL sheet and fixing some minor dependencies, the upgrade could be executed successfully. |
|
| 3 | Workbook: Autocomplete in the 'Formula Builder' offers columns from all sheets | DAP-42105 |
|---|---|---|
When inserting a formula in the Workbook's 'Formula Builder' only the sheets and columns for the first reference and only the columns from the current sheet are offered for autocompletion. Furthermore, autocomplete filters out dummy columns, e.g. insert a formula in the second column, apply, and then go to the first column. |
|
| 4 | Workbook: Renaming a column with a long name leads to a shift between the column header and the column | DAP-41921 |
|---|---|---|
| After renaming a column name, no shift is visible between the column header and the column. | Bug fixed. |
| 5 | Workbook Health Check: Link to open a Workbook still uses the Workbook ID instead of the file ID | DAP-42181 |
|---|---|---|
| When opening a broken Workbook from the Workbook Health Check page, the file ID is used to open a Workbook now. | Bug fixed. |
| 6 | Workbook: Folder can't be dragged to the root in the Folder Tree panel | DAP-42168 |
|---|---|---|
| You can now drag a folder to the root in the Folder Tree panel. | Bug fixed. |
| 7 | Export: CSV partitioned export - improve help text and make the partition pattern option only visible on the CSV export | DAP-42138 |
|---|---|---|
| The general help text for using a partition pattern export is now improved and visible in the CSV based export wizard: "The placeholder %partition% is only processed if the export sheet is partitioned!" | Bug fixed. |
| 8 | Login: After a successful login, the user must not be redirected to a Web Socket URL | DAP-42062 |
|---|---|---|
| When logging in after an automatical logout due to a user inactivity, a user is now redirected back to the previous location from before the logout. | Bug fixed. |
| 9 | Workbook: The Workbook view shows an error of a previous job run when triggering a new job | DAP-42099 |
|---|---|---|
| The error from the former broken Workbook is not displayed anymore when triggering the fixed Workbook and the job graph is being displayed now instead. | Bug fixed. |
| 10 | Workbook Settings: 'Data Driven' in the Workbook settings is not disabled when changing a JDBC connection to a session based | DAP-40390 |
|---|---|---|
| When a connection is configured with a session-based authentication and the Workbook is configured as 'Data Driven' by the source sheet, the Workbook is not triggered when the source is not triggered. | Bug fixed. |
| 11 | Export: Partition export job does not work in cluster mode | DAP-42159 |
|---|---|---|
| The partitioned export job with the pattern '%partition%' works in the cluster mode as expected. | Bug fixed. |
| 12 | Workbook: Display the autocomplete list for current sheet and column name | DAP-42180 |
|---|---|---|
| When using a formula that contains the current sheet name and the column name, the autocomplete list is now displayed. | Bug fixed. |
Datameer X 11.1.4
Improvements
1 | Workbook: Provide an option to cancel the 'Repoint Sheet' dialog. | DAP-42003 |
|---|---|---|
You can now cancel the 'Repoint Sheet' dialog after first applying a formula and then saving the sheet name. The applied formula is also being reset after cancelling the dialog. |
| 2 | REST API v2: Keep column style for a Workbook with Duplicate/ Copy/ Paste | DAP-41786 |
|---|---|---|
| A Workbook's column style is applied after duplicating, copying/ pasting a Workbook. |
Bug Fixes
| 1 | Workbook: Workbook still appears in the tab bar after closing the Workbook | DAP-42027 |
|---|---|---|
After closing a Workbook, the associated Workbook tab is being closed in the tab bar as well. |
|
| 2 | Import: JSON import - Datameer ignores the first array object | DAP-41996 |
|---|---|---|
All arrays of the JSON file are being imported. With the 'include root array' property, Datameer parses the whole array including the first object also. In general when importing JSON: If a JSON file contains a 'root array', means the first level if the data structure is a JSON array (file starts with [...]), the 'include array' checkbox has to be checked during the import wizard. If a JSON file contains an object in the first level and a nested data structure contains an array for the data ingest (file starts with {...[...]...}), the 'include root array' must not be checked. Then the JSON path to the 'target array' for the data ingest must be entered into the textbook during the import wizard. |
|
| 3 | Datameer Distributions: Azure Blob Storage Connector - Packaging issues | DAP-41979 |
|---|---|---|
After updating the core libraries, the Azure Blob Storage connector is working as expected again. |
|
| 4 | In-product documentation: Wrong documentation link for 'New Connection' | DAP-41944 |
|---|---|---|
| A user who wants to find out about more information about the 'Data Types' during the 'New Connection' workflow, is now directed to the correct public documentation page. | Bug fixed. |
| 5 | Import: 'Create new import/ data link' - slow wizard load | DAP-42072 |
|---|---|---|
| After optimizing the database query, the wizard for creating a new import job/ data link is working as quick as expected again. | Bug fixed. |
| 6 | Workbook: Formula parser throws the StackOverflowError while trying to digest a huge nested 'IF' expression | DAP-42051 |
|---|---|---|
| After changing a JVM parameter that is responsible for the set of the nested functions, the formula parser doesn't throw the exception furthermore. | Bug fixed. |
| 7 | REST API v2: When a connection is injected or restored, the File Browser is not updated | DAP-41831 |
|---|---|---|
| After injecting or restoring the connection, the File Browser is updated and the connection is immediately visible now. | Bug fixed. |
Datameer X 11.1.3
New Features
1 | Supported Hadoop Distributions: Add support for Google Dataproc version 1.5 | DAP-40353 |
|---|---|---|
Datameer X now supports Google Dataproc version 1.5. |
Improvements
1 | Supported Hadoop Distributions: Add support for Cloudera Private Cloud/ Cloudera Runtime 7.1.6 | DAP-41823 |
|---|---|---|
Datameer X now supports Cloudera Private Cloud/ Cloudera Runtime 7.1.6. |
| 2 | Admin Plug-ins: ‘plugin-tez’ - Upgrade to TEZ 0.10 | DAP-41279 |
|---|---|---|
| After a plug-in patch, the 'plugin-tez' plug-in is now available for Datameer X distributions again. |
| 3 | Properties: AWS S3 http client max pool size should be configurable | DAP-41912 |
|---|---|---|
| The default maximum connection execution amount is now set to 100. With custom properties, you can change this amount to a higher or lower number. The custom count can also be set via Hadoop property in the cluster settings. |
| 4 | Workbook: Create Toolbar button to auto-expand all column width to make all column names visible | DAP-41603 |
|---|---|---|
| Datameer has now a new toolbar button to expand all column width to make all column names fully visible. |
| 5 | Workbook: Formula sheet repointing | DAP-41549 |
|---|---|---|
| When changing a formula sheet that points to another sheet, Datameer X now detects this changes and displays a dialog: The user can apply the changes to only the current column or to all columns. This dialog is only displayed, when when more than one column is affected. |
| 6 | Workbook: validate join sheet creation and provide supportive error messages | DAP-40809 |
|---|---|---|
| If one is trying to create an invalid join definition, the join validation will give the user a hint why the join can not be created in a warning dialog. |
Bug Fixes
| 1 | Workbook: Parquet format - Ingesting creates duplicate 'das' metadata columns | DAP-41874 |
|---|---|---|
| When ingesting a Parquet file into Datameer by a File Upload, Import Job or Datalink, there will be no more duplicated columns displayed in the tab "Define Fields". |
|
| 2 | Snowflake Export: Tables are not updating when selecting another schema | DAP-41721 |
|---|---|---|
When configuring a Snowflake export or import job, the tables are now updated when changing the schema from the drop-down. |
|
| 3 | Workbook synchronisation: Sheet synchronization - Validation error is still showing even after update | DAP-41476 |
|---|---|---|
After a formerly incorrect formula has been changed into a valid formula, the validation error is no longer displayed. |
|
| 4 | File Browser: Remove the 'Import Job' tab from the tab bar after the job has been deleted | DAP-41635 |
|---|---|---|
| The 'Import Job' tab is now deleted from the tab bar and is no longer displayed, after the job has been deleted. | Bug fixed. |
| 5 | File Browser: Job status tooltip for queued jobs is missing position information | DAP-41244 |
|---|---|---|
| The tooltip now shows the position information for the queue status of a job, e.g. position 2 of 5 queued jobs. | Bug fixed. |
| 6 | Workbook: Active state of the 'encode column' button is broken | DAP-41317 |
|---|---|---|
| When the 'Encode Column' view in the Workbook Inspector is enabled, the button is in an active state. | Bug fixed. |
| 7 | FileBrowser: Right-click in an empty area opens the Browser context menu instead of the Folder Tree context menu | DAP-41652 |
|---|---|---|
| Right-clicking in an empty area within the File Browser under the Folder Tree now opens the Folder Tree context menu. | Bug fixed. |
| 8 | Workbook Inspector: Encoding inspector fly out always shows "Empty Value" | DAP-41722 |
|---|---|---|
| The fly out within the encoding section in the Workbook Inspector now shows the correct value for the different chars. | Bug fixed. |
| 9 | Upgrading Datameer X: Datameer X stops serving HTTP requests and returns 504 Gateway timeout errors | DAP-41889 |
|---|---|---|
| After a new fixed release, no more freezes happen and Datameer X works as expected after the upgrade. | Bug fixed. |
| 10 | Upgrading Datameer X: Upgrade scripts breaks at the ‘Drop Sink Data Table’ step - ‘A foreign key constraint fails’ | DAP-41955 |
|---|---|---|
| The upgrading script has been updated to let the Datameer X upgrade work as expected. | Bug fixed. |
| 11 | Workbook: Fx function in Workbook is not case sensitive | DAP-41992 |
|---|---|---|
| Selecting a Fx function in a Workbook highlights the function in the Sheet Inspector with upper or lowercase or mixed letters | Bug fixed. |
| 12 | Workbook: FilesystemRestController#moveFolder causes an endless loop | DAP-41989 |
|---|---|---|
| No endless loop of error messages is caused anymore when moving folders. When trying to move a folder into its own subfolder, an error message is displayed. | Bug fixed. |
| 13 | Connections: Snowflake - Jobs using the Snowflake connection are failing & exports are failing as well | DAP-41951 |
|---|---|---|
| After fixing the Snowflake plug-in, the connections are working as expected and exports can be executed as expected. | Bug fixed. |
| 14 | REST API: JobExecutionRestControllerV2 does not release the EntityManager | DAP-41922 |
|---|---|---|
| The REST API for job execution is working as expected again. Jobs can be triggered and stopped with REST API commands. | Bug fixed. |
| 15 | Workbook: SQL sheet - 'COUNT'/ 'SUM'/ 'AVG'/ ... (DISTINCT) aggregates are not supported | DAP-41878 |
|---|---|---|
| Aggregates with DISTINCT quantifier work again in SQL sheets. Furthermore multiple DISTINCT aggregates in a single SELECT command on the same column are supported while multiple DISTINCT aggregates with multiple different columns are not supported. | Bug fixed. |
Datameer X 11.1.2.3
Improvements
| 1 | Admin Plug-ins: ‘plugin-tez’ - Upgrade to TEZ 0.10 | DAP-41279 |
|---|---|---|
| After a plug-in patch, the 'plugin-tez' plug-in is now available for Datameer X distributions again. |
Datameer X 11.1.2.2
Bug Fixes
1 | Upgrading Datameer X: Upgrade scripts breaks at the ‘Drop Sink Data Table’ step - ‘A foreign key constraint fails’ | DAP-41955 |
|---|---|---|
| The upgrading script has been updated to let the Datameer X upgrade work as expected. |
|
Datameer X 11.1.2.1
Bug Fixes
1 | Upgrading Datameer X: Datameer X stops serving HTTP requests and returns 504 Gateway timeout errors | DAP-41889 |
|---|---|---|
| After a new fixed release, no more freezes happen and Datameer X works as expected after the upgrade. |
|
2 | Workbook: SQL sheet - 'COUNT'/ 'SUM'/ 'AVG'/ ... (DISTINCT) aggregates are not supported | DAP-41878 |
|---|---|---|
Aggregates with DISTINCT quantifier work again in SQL sheets. Furthermore multiple DISTINCT aggregates in a single SELECT command on the same column are supported while multiple DISTINCT aggregates with multiple different columns are not supported. |
|
Datameer X 11.1.2
Improvements
1 | Supported Hadoop Distributions: Add support for Cloudera Private Cloud/ Cloudera Runtime 7.1.5.14 | DAP-41578 |
|---|---|---|
Datameer X now supports Cloudera Private Cloud/ Cloudera Runtime 7.1.5.14. |
2 | Upgrading Datameer X: Upgrade process - 'database.sh' script should print the details of its execution | DAP-41882 |
|---|---|---|
The 'database.sh' script now contains the status of the database upgrade, when executed. Furthermore, the location of the backup which is created by script has changed. Now the full path to the database file is displayed. Also there are additional entries in the 'database-tool.log' file. |
3 | Housekeeping: Housekeeping: Data entity should store owner to enable Housekeeping to remove HDFS items even if associated job has been deleted already | DAP-41288 |
|---|---|---|
Housekeeping has no longer issues in removing HDFS items even if an associated job has already been deleted. Data from where the job configuration has already been deleted is cleaned up successfully without falling back to the system user. The 'data.owner' field receives the value of the current owner of the job configuration. |
Bug Fixes
1 | Workbook: Workbook toolbar buttons are not working when using them in the Internet Explorer | DAP-41864 |
|---|---|---|
| The Datameer X Workbook toolbar now works with Internet Explorer. |
|
2 | Export: Amazon Redshift (Fast Load) export is dropping records | DAP-41838 |
|---|---|---|
The data export into Amazon Redshift (Fast Load) is working correctly again. |
|
3 | Workbook: Workbook toolbar buttons are not working when using them in the latest Chrome version | DAP-41836 |
|---|---|---|
The Datameer X Workbook toolbar now works with Chrome version 89.0.4389.90 (Official Build) and newer. |
|
4 | Execution Engine: Datameer X on Amazon EMR/ Google Cloud Platform - Failed to activate the plug-in 'plugin-dwh' | DAP-41816 |
|---|---|---|
Since 'plugin-doh' is a conductor-only plug-in, it is not being copied to the cluster anymore and does not impact any job execution. |
|
5 | User Interface Login: Intermittently login page is not refreshing after a successful login | DAP-41633 |
|---|---|---|
The correct login is working in all browsers for SAML, internal authentication as well as for external authentication (LDAP). |
|
Datameer X 11.1.1.2
Bug Fixes
1 | Workbook: Workbook toolbar buttons are not working when using them in the Internet Explorer | DAP-41864 |
|---|---|---|
| The Datameer X Workbook toolbar now works with Internet Explorer. |
|
2 | Workbook: Workbook toolbar buttons are not working when using them in the latest Chrome version | DAP-41836 |
|---|---|---|
The Datameer X Workbook toolbar now works with Chrome version 89.0.4389.90 (Official Build) and newer. |
|
Datameer X 11.1.1
New Features
1 | Supported Hadoop Distributions: Add support for Amazon EMR 6.2.0 | DAP-41575 |
|---|---|---|
Datameer X now supports Amazon EMR 6.2.0. |
| 2 | Supported Hadoop Distributions: Add support for Amazon EMR 5.32.0 | DAP-41574 |
|---|---|---|
| Datameer X now supports Amazon EMR 5.32.0. |
Improvements
1 | Upgrading Datameer X: Improved upgrading process | DAP-41750 / DAP-41749 / |
|---|---|---|
Datameer X has now an improved upgrading process for new upgrades. |
2 | Workbook: Auto-expand column header during "column edit" if the column name is partly invisible | DAP-41677 |
|---|---|---|
When renaming a column, the column width is now expanded fully visible without any truncation. |
3 | Upgrading Datameer X: Schedule out of order upgrades | DAP-41626 |
|---|---|---|
The upgrade tool is now upgrading out of order upgrades to e.g. schedule new schema versions which have a lower value than the current one. |
4 | Supported Hadoop Distributions: Enable Apache Hadoop 2.8.5 support | DAP-41451 |
|---|---|---|
Datameer X now supports Apache Hadoop 2.8.5, also with Hive 2.3.8 as well as HBase 1.4.13. |
Bug Fixes
1 | Export: Snowflake - Export jobs failing with exception | DAP-41557 |
|---|---|---|
| Snowflake export jobs run successfully again after fixing the plug-in. |
|
2 | File Browser: Dependencies View artifact loses its color after selecting/ deselecting | DAP-41322 |
|---|---|---|
In the Dependencies View a selected and then deselected artifact does not change the color to grey anymore. |
|
3 | Import: Amazon EMR - Import partitioned data link from S3 does not work | DAP-40340 |
|---|---|---|
| The data link from S3 is now working again as expected. |
|
4 | Documentation: Documentation URL should point to public space | DAP-41713 |
|---|---|---|
| The public user docs are now available on 'https://datameer.atlassian.net/wiki/display/DAS110'. |
|
5 | REST API v2: Remove save dialog when closing a Workbook | DAP-41730 |
|---|---|---|
| After restoring a Workbook with REST API v2, closing that Workbook in the File Browser does not trigger the 'Save' dialog anymore. |
|
6 | File Browser Inspector: Config tab - Missing information for File Uploads | DAP-41623 |
|---|---|---|
| In the File Browser 'Config' tab, the information that scheduling is not supported for Connections and File Uploads is displayed. |
|
7 | REST API v2: Rest call leads to an illegal state exception | DAP-40157 |
|---|---|---|
| All entities are running in a row again, without any exceptions. |
|