Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Datameer's Smart Execution™ technology dynamically chooses the best execution engine for your Datameer X job depending on the job configuration and data volume. This feature also uses a combination of multiple execution engines for separate tasks of a Datameer X job by logically allocating mixed workloads according to available resources for maximum processing efficiency. 

...

Datameer X execution frameworks with Smart Execution

  • Optimized MapReduce. The Apache Tez framework which manages resources across multiple clusters. This frameworks optimizes resource utilization at runtime, and enables dynamic physical data flow decisions. This framework is optimal for large data sets.
  • SmallJob Execution. A framework that runs job tasks on a single node of the Hadoop cluster. This framework minimizes the amount of resources needed so smaller tasks are completed faster and more efficiently.

...