Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Datameer administrators have the ability to configure Smart ExecutionTM properties.

Table of Contents

Troubleshooting

Force framework execution

Datameer's Smart Execution™ dynamically chooses the best execution engine for each of your specific jobs. But, you have the option to force a specific framework if you are experiencing a problem with performance or believe that another framework would be better suited for one of your jobs. 

...

  •  Force a job to be run with the Optimized MapReduce (Tez) execution framework by adding the following property to the Hadoop properties on the cluster configuration page: 

    Code Block
    das.execution-framework=Tez

Performance Tweaking

Vcores per node

Select the number of cores on each node that are used to process a job.

...

Code Block
das.yarn.available-node-vcores=<number of vcores per node>

Session pooling 

Session pooling reuses Tez sessions across Datameer jobs and can help elevate processing strain as well as helping to avoid container start-up cost. 

...