Job Scheduler Threads

The Job Scheduler is the process in charge of running all the jobs within Datameer. It requires one controller thread for the coordination of tasks and a possibility of an infinite amount of worker threads that are in charge of running jobs in parallel.

To set the number of Job Scheduler threads:

Open the "Admin" tab → "Job Scheduler". The Job Scheduler page opens.
Enter the number of threads available for Job Scheduler tasks and confirm with "Save". Setting the number of threads available for the Job Scheduler tasks ist finished.

Priorizing an Import/ Export Job in the Job Scheduler

INFO

If needed, you can execute priorized jobs by bypassing the Job Scheduler's queue. For that, according role capabilities are needed as well as cluster resources.

To priorize a job when configuring it in the import/ export job wizard, simply mark the check box "Bypass Internal Job Queue". The job will be executed right after finishing the job wizard.

Example for Export Job Priorization

Role Configuration

To display the check box for bypassing the Job Scheduler queue, make sure the capability "Cluster Configuration" is activated.

Event Bus Threads

The Event Bus collects all the metadata changes for all processable Datameer X artifacts. (E.g., import jobs, data links, workbooks, etc...). The number of threads determines when to resolve tasks triggered by events published by the Event Bus. When an event begins, all registered subscribers for an event are run in sequence.

These threads are used to resolve tasks triggered by events published through the event bus

To set the number of Event Bus threads:

In Datameer X navigate to the Admin tab
Click on Event Bus from the menu on the left.
Enter the number of threads available for Event Bus tasks.
Click Save.

Saving Job Scheduler and Event Bus Thread Configurations

When upgrading Datameer X your Job Scheduler and Event Bus thread configuration can be saved in a properties file (overrides.properties) located in your systems HOME folder.

Browser not supported