Apache Knox WebHDFS

Owned by Juliane Wetzel
Apr 30, 2020
2 min read

INFO

This connection is needed to access a HDFS which is not the same HDFS where Datameer's Private Folder is stored, e.g. a hybrid cloud or second cluster.

The connector can be disabled in the 'Admin' tab.

Configuring WebHDFS as a Connection

To connect to Apache Know WebHDFS:

  1. Select "+" and then select "Connection" or right-click on a folder in the File Browser and select "Create New" and then "Connection". A 'New Connection' tab opens.
     or 
  2. Select "Apache Knox secure WebHDFS" from the drop-down in section 'Type' and confirm with "Next". The section 'Connection Details' opens.

  3. Enter the "Apache Knox gateway hostname" and the "Port". 

  4. Enter the "Topology" path.
    INFO: Entering "/" leads to the default topology path.

  5. Select "SSL with user provided truststore" from the drop-down, upload the "Truststore" file with the Apache Knox SSL certificate and and enter the password for truststore.
    INFO: Leave the field blank when truststore is not password protected.

  6. Select "Basic (LDAP) - username/password authentication" from the drop-down, enter your credentials and confirm with "Next". The section 'Save' opens.

  7. If needed, enter a description and confirm with "Save". The dialog 'Save Connection' opens.
     
  8. Select the name and storage location of the connection and confirm with "Save". The Knox WebHDFS connection is saved. 

Disabling the Apache Know WebHDFS Plug-In

To disable the Apache Know WebHDFS plug-in:

  1. Open the "Admin" tab and select "Plug-ins". The plug-in overview page opens.
     
  2. Click the "Disable Extension" icon of the extension "Apache Knox secure WebHDFS". The extension is disabled.
    INFO: To enable the extension, click on the icon again.