Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

NameDefault valueDescriptionLocationSince
tez.am.shuffle-vertex-manager.desired-task-input-size50Set the input size for each TEZ sub-taskdas-common.properties5.0

das.execution-framework

smart

Force a job to be run with a specific execution framework
Smart Execution = Smart
Standard MapReduce = MapReduce
Optimized MapReduce = Tez
SmallJob Execution = SmallJob 

Spark Smart Execution = Smart

Local Mode = local (default and the only execution framework in local mode)


5.0
das.execution-framework.small-job.max-records1000000Set a threshold size for number of records to choose execution framework
5.0
das.execution-framework.small-job.max-uncompressed1000000000Set a threshold size for uncompressed file size to choose execution framework
5.0

...