Categories

Versions

You are viewing the RapidMiner Server documentation for version 9.4 -Check here for latest version

Queue management

One of the most powerful features of Rapidminer Server is that it can execute RapidMiner processes eitherimmediatelyor asscheduled processes. Processes can be scheduled to be executed once at a specific point in time or periodically at specific intervals.

Rapidminer Server utilizes a queueing infrastructure where processes are submitted when they are ready for execution. The Job Agent picks up processes once they are made available in the queue and executes them.

Note: A queue can have one or several Job Agents connected to it. Each of these connected Job Agents can execute an arbitrary number of RapidMiner processes concurrently. However, the default value for parallel execution is set to three.

Queues

RapidMiner Server is shipped with a pre-configured queue namedDEFAULT, but it is possible for the user to create additional queues.

Note:所有工作人员在installati初始化on of RapidMiner server will automatically connect to theDEFAULTqueue.

To view this list of queues go toProcesses > Queueslocated on the left side of the page:

This will redirect you to theQueuespage where each configured queue is listed along with it's status information:

The table below explains the status information associated with aQueue

Field Description
Running jobs the number of processes that are currently being executed
Pending jobs the number of processes awaiting execution
Permitted groups a list of all the groups that are allowed to submit processes to the queue for execution
Job Agents the number of Job Agents connected to the queue

Adding a Queue

To configure a new queue, navigate toProcesses > Queues. Click onAdd Queuebutton located at the top right side of the queues page:

TheAdd Queuedialog will appear, where you can enter the name of the queue.

After you have entered the queue's name, click theCreatebutton to complete the process. The new queue should be immediately visible in theQueuespage.

Removing a Queue

To remove an existing queue, navigate toProcess > Queues. This will bring you to the Queues page.

Click on the delete button next to the queue name you want to delete.

Note: TheDEFAULTqueue cannot be deleted.

Managing a Queue's permissions

A queue can be configured to allow process execution to specific groups. To change these permissions navigate toProcess > Queues. This will bring you to the Queues interface.

Click theEditlink next to thePermitted groupsproperty of the queue.

This will bring up theManage permissionsdialog:

To permit a group to execute processes from the queue, select the group name from the left hand side group list and click> (Add)arrow. This action will move the selected group(s) to the group list on the right hand side.

To restrict a group from executing processes from the queue, select the group from the group list on the right hand side and click< (Remove)arrow. This action will move the selected group(s) to the group list on the left hand side.

When done clickSave.

Connecting a Job Agent to an existing Queue

To install and connect to a Job Agent an existing queue, navigate toProcesses > Queues. This will bring you to the Queues interface.

Click theInstalllink next to the Job Agents property of the queue.

You will be prompted to download a pre-configured Job Agent (in ZIP format) on to your local disk. Once the download is completed, unzip the archive.

To start the Job Agent, navigate to the unzipped Job Agent directory and run in the command line the/bin/rapidminer-jobagent.batfile in case you are using a windows operating system, or/bin/rapidminer-jobagent.shfile in case you are using other operating systems. This will boot up the Job agent which will automatically connect to the queue for which it is configured.