...
Force a job to be run with the Optimized MapReduce (Tez) execution framework by adding the following property to the Hadoop properties on the cluster configuration page:
Code Block das.execution-framework=Tez
Performance Tweaking
...
Vcores per node
Select the number of map slots cores on each node that are used to process a job.
Example: If you enter a value of 10 and also have 10 nodes, 100 slots total are task containers could be used to process the job depending on queue availability.
Code Block |
---|
das.yarn.mapavailable-tasksnode-per-nodevcores=<number of map slotsvcores per node> |
Session Pooling
...