...
If not using impersonation, you can set the scheduling of jobs for specific cluster queues at either a global or per job level.
Global
...
Level
- Open the "Admin" tab.
- Select "Hadoop Cluster Configuration" from the side menu.
Add the following property in the "Custom Properties" space section.
Panel title Tez Queue Property das.job.queue.name=<cluster queue name>
title MapReduce mapreduce.job.quename=<cluster queue name>
...
Job Level
- Navigate through the job wizard Job Wizard when setting up or configuring a job.
- Add the properties listed above in the "Custom Properties space" tab.
Example:
Impersonation
| Info | ||
|---|---|---|
| ||
Datameer X users that are running impersonation don't need to set any scheduling properties in Datameer. Jobs coming from Datameer X already are labeled and all configuration for the queues are made on the Hadoop cluster itself. |
Finding the Optimal Split Size/Split Count
...
If you change the split size and split count recommendations for Hadoop to:
| No Format |
|---|
min/max split size: 488 kb / 5 GB min/max split count: 0 / 2147483647 |
...
- Start setting up the Import Job
- Under 'Scheduling; ' tab, add the line below in the text area for setting up Hadoop properties
...