Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

An SQL editor interface has been added to Datameer. Creating an SQL worksheet gives you the ability to write SQL queries directly in a workbook. Users working within SQL worksheets can utilize this feature to combine processes that might take several steps using the traditional interface.

Exporting data

HiveServer2 can export using the original format type

...

Comprehensive improvements for exporting into HiveServer2

New improvements exporting into existing partitioned Hive tables.

Output format

Whereas it was only possible to write in Hive tables formatted as a textfile, Datameer now has the ability to export to tables which are formatted as a sequencefile, rcfile, avro, orc, or parquet. This allows you to benefit from the advantages of these fast formats.

Hive data type support

In Datameer v6.4 we extended the list of supported Hive data types for export with decimal, date, and timestamp. Now we extend this list again with tinyint, smallint, int, float, and varchar. This allows you to optimize Hive tables to the data types you really need while ensuring full compatibility to Datameer's Hive export.

Datameer Value Typevoidbooleantinyintsmallintintbigintfloatdoubledecimalstringvarcharchartimestampdatebinaryarray <data_type>
STRING








(tick)(tick)(tick)



BOOLEAN
(tick)













FLOAT







(tick)(tick)







INTEGER

(tick)(tick)(tick)(tick)











DATE








(tick)

(tick)(tick)

BIG_DECIMAL







(tick)






BIG_INTEGER




(tick)









LIST














(tick)

Partition support

Until now, the advantages of partitioning could only be used for importing data. Datameer v7.1 brings you the ability to export into existing Hive partitions for the first time. In addition, Datameer not only supports date partitions (as for importing data) but all available types such as string partitions.

Mapping validation

The order of the columns in a workbook and in a Hive table no longer need to be identical. Also, mapping errors are now clearly marked in a red color (in the UI) for quicker troubleshooting.

User Permissions

Cascading permissions

...