S3

Configuring S3 as a Connection

In order to import and export from S3, you must first create a connection.

1. Click the + (plus) button and select Connection or right-click in the browser and select Create new > Connection.
2. From drop-down list, select S3  as the connection type. Click Next.
   

3. Add your S3 bucket name
   Select if you want to authenticate through an access key and secret code or using IAM Role. (Datameer X supports import/export from/to S3 encrypted buckets.)
   Add the root path prefix, if necessary.
   Indicate if the connection should be used for import, export, or both.

   As of Datameer X 7.4

   Encryption support has been implemented. Select between Amazon Web Services' AES256 and KMS.

   

   

4. Click Next.
5. If required, add a description and click Save.
   

Importing Data with a S3 Connector

After configuring a connection to S3, you can set up an import job to access the connection.

1. Click the + (plus) button and select I mport Job or right-click in the browser and select Create new > Import job.
2. Click Select Connection and choose the name of your S3 connection (here - S3_Connection) then click Next.
   

3. Enter the file or folder path and the delimiter.
   Click Next.
   

   As of Datameer X 7.4

   Datameer X has added the Remote Data Browser feature. This file browser gives you a visual interface to select the file from your S3 bucket for which to import.

   The filter box at the top of the Remote Data Browser can be used to find folders/files within the current directory.

   

   

4.  A preview of the imported data is displayed. Review the schema.
   
5. Review the schedule, data retention, and advanced properties for the job.
   
6. Add a description, click Save, and name the file.