OpenStack Swift

Configuring OpenStack Swift as a Connection

In order to import from OpenStack Swift, you must first create a connection.

1. Click the + (plus) button and select Connection or right-click in the browser and select Create new > Connection.
2. From the drop-down list select OpenStack Swift as the connection type.
   
3. Enter the authentication URL.
4. Enter the container name where the Swift objects are stored.
5. Enter the tenant name, which refers to a specific group of users.
6. Enter the user name and password. The API key can be used instead of a password if applicable. 
7. Add a path from where the data can be imported and/or exported.
8. Selected if the connection is used for import, export, or both.
   
9. Click Next and then save the connector.

Importing Data with an OpenStack Swift Connector

After configuring a OpenStack connection the wizard you can set up one or more import jobs which access that OpenStack Swift connector. 

1. Click the + (plus) button and select Import or right-click in the browser and select Create new > Import job.
2. Click New and choose the name of your Spark connection (here - OpenStack_Swift_Connection) then click Next.
3. Select the type of file to import to Datameer.
   
4. Add a to the file to import.
5. Add a parse pattern to define the schema of the data.
   
6. Optional Settings: Filter by range or time, ignore lines, character coding, number of records to detect, obfuscation. 
   
7. A preview of the data to be imported is displayed.
   
8. Set the import to be triggered manually or set to run on a schedule.
9. Name and save the import job.

The import job is viewable under the File Browser tab.