Job Node Support

With medium and large business editions of CLC Genomics Server, you can parallelize job execution on multiple Job Nodes

All computers in the network are running the CLC Genomics Server: The Master Server handles the job queue and data communication.

And the Job Nodes carry out the jobs

When the user logs in to the Master Server through the Workbench and starts a job on the server, the job is distributed to an available job node. The responsibility of the master server is to manage the queue and act as a middle layer serving data to the Workbenches. The job nodes, on the other hand, are waiting for the master node to assign a job, and once the job is executed, they are available for the next job.

One benefit of this set-up is that you can distribute the work load by having several computers doing calculations. Since the job is not divided and parallelized on several computers, the specific job is not executed faster in this set-up than on a single computer. Instead the time of queuing up is reduced due to the parallel execution of several jobs at the same time.

A valuable feature of the Job Node concept is that you can specialize the nodes to only accept certain kinds of jobs. You can e.g. dedicate a node to data import in order to make sure that import jobs are not stalled by other kinds of jobs. You can also exclude a job type like e.g. read mapping of NGS data, in order to make sure that this or these nodes are not kept busy by large assembly jobs.