Table of Contents
Prerequisites
| Info | ||
|---|---|---|
| ||
Datameer X needs to have the appropriate access level to establish a connection to a certain S3 bucket. For that, you need the permission to the bucket's root folder with 'ListBucket'. Giving the permission to a subfolder instead, the connection attempt will failMinimum access level required for importing data from an S3 bucket to Datameer. The Account/ IAM Role one uses in the S3 connection should be allowed to perform the following actions:
For an edge case suggestion, please check the community article Bucket policy for S3 Import in multi-tenant Datameer instance. |
Usable Custom Properties
Disabling the IAM Role Authentication Option
...
- Click the + (plus) button and select Connection or right-click in the browser and select Create new > Connection.
- From drop-down list, select S3 as the connection type. Click Next.
Add your S3 bucket name and select the authentication mode:
'Access Key and Secret Code pair' or 'IAM role' or 'IAM assumed role'. Datameer X supports import/export from/to S3 encrypted buckets.
INFO: Selecting 'IAM role' will use the IAM role associated with the EC2 instance or the EMR cluster. Selecting the 'IAM assumed role' will use the IAM role associated with the EC2 instance or the EMR cluster to assume a specific role.Add the root path prefix, if necessary.
Indicate if the connection should be used for import, export, or both.
For the encryption support, select between Amazon Web Services, AES256 and KMS.
- Click Next.
- If required, add a description and click Save.
| Anchor | ||||
|---|---|---|---|---|
|
| Note |
|---|
This connector isn't able to import from S3 buckets without access to read the metadata over the |
After configuring a connection to S3, you can set up an import job to access the connection.
...