Supported External Data Types and Sources
INFO
Datameer X supports the following types of structured, semi-structured, and unstructured data types and sources when importing and exporting.
Supported External Databases
INFO
Relational databases include Oracle, DB2, and MySQL.
| Database Name | Description |
|---|---|
| Amazon Athena |
|
| Amazon Redshift |
|
| Azure Cosmos DB |
|
| Azure Databricks |
|
| Azure Synapse |
|
| DB2 |
|
| Greenplum |
|
| HSQL_file |
|
| MSSQL |
|
| MySQL |
|
| Netezza |
|
| Oracle |
|
| PostgreSQL |
|
| Sybase IQ |
|
| Teradata Aster |
|
| Vertica 5.1+ |
|
Supported External Files
INFO
You can import or upload individual sheets from a spreadsheet by first converting the file to a .CSV file type.
| File Type | Description |
|---|---|
| Apache log files |
|
| Apache Avro |
|
| COBOL Copybook |
|
| CSV (comma-delimited text files) |
|
| Excel Workbooks |
|
| Fixed Width |
|
| HTML file |
|
| IIS Logs (Internet Information Services) |
|
| JSON |
|
| Key/ value pair |
|
| Log4j log file |
|
| Mbox |
|
| Netfilter/ IP Tables |
|
| ORC (Optimized Row Columnar) |
|
| Parquet |
|
| Regex Parsable Text Files |
|
| Sequence File wit Metadata |
|
| Unsecured data |
|
| XML data |
|
Supported External File System Connectors
| File System | Description |
|---|---|
| Apache Knox WebHDFS |
|
| Amazon S3 (Simple Storage Server) |
|
| Azure Blob Storage |
|
| Custom Protocol |
|
| Datameer X Server Filesystem |
|
| FTP (File Transfer Protocol) |
|
| HDFS (Hadoop Distributed File System |
|
| OpenStack Swift |
|
| SFTP (SSH File Transfer Protocol) |
|
| SSH (Secure Shell) |
INFO: Datameer X supports Bitverse SSH Server/Client for the Windows platform. The root paths to be specified while creating the connection should look something like: /c:/mydata/folder1 |
| MapR FS |
|
Datameer X is able to split large files across multiple mappers enabling parallel data ingestion. Two requirements must be fulfilled for this to be possible.
- Splitting of the file protocol must be supported. Currently splitting all of the above protocols is supported.
- Splitting of the compression type must be supported. Currently LZO and Gzip are splittable, zip and Bz2 aren't supported.
See Importing Data for more information.
Supported Other External Connectors
| External Connector | Description |
|---|---|
| Google BigQuery |
|
| HBase |
|
| Hive (JDBC) |
|
| Hive Server2 (JDBC) |
|
| IMAP & POP3 (Internet Message Access Protocol) |
|
| Knox Hive Server2 JDBC |
|
| Power BI |
|
| Tableau Server |
|
, multiple selections available,