Batch Queue Tips

Follow

 

Batch Queue Tips

 

Create a single threaded Batch Queue

A single threaded Batch Queue can be useful in a number of situations. Users may utilize a Batch Queue to ensure only one Trigger-fired Job is running at any time, or prevent multiple occurrences of an SSIS package from running concurrently - even if that package is called by multiple other Jobs. When running Jobs on Agents, users can leverage Batch Queues to limit the number of simultaneous executions running on an Agent at any one time. 

NOTE: In a single threaded Batch Queue, Jobs will be submitted to the Queue based on their Scheduling Priority value.

  1. In the JAMS Client, open the Queues shortcut from the Management section.
  2. Click on the Add button to add a new Queue.
  3. Name the new Queue and add a description. 
  4. Ensure Edit the Queue definition after adding is checked, then click Finish.
  5. The Properties dialog for the newly created Queue will now appear.
  6. On the Status tab, ensure the Job Limit is set to 1. Define Agent Nodes (where the queue originates) if applicable. 
  7. Click Save and Close to finish creating the Queue.
 

Batch Queues and AWS

To leverage the ability to dynamically run Jobs on EC2 instances in JAMS, users must utilize Batch Queues. 

The public IP address for EC2 instances will change each time an instance is started (if an elastic IP has not been assigned to the instance). Leveraging the AWS Module in JAMS will allow EC2 instances to automatically start, capture the public IP address of each EC2 instance, and assign them to a Batch Queue.

With the newly running EC2 instances defined in the Batch Queue, Jobs with that Batch Queue defined (or Jobs in a Folder with the Batch Queue defined) will automatically start running on those EC2 instances.

 

Apply a Queue to a Job or Setup definition

Applying a Queue on a Job or Setup definition will override any Batch Queue set on the Folder level. Even if a Folder level Batch Queue is overridden at the Job or Setup level, the Folder's Scheduling Priority will still be used to calculate the overall Scheduling Priority of the Job or Setup.

  1. In the Definitions view, double-click the relevant Job or Setup to open the Properties dialog.
  2. From the properties dialog that appears, select the Properties tab, then select the relevant Batch Queue from the Submit Options section.
  3. Define a Scheduling Priority Modifier value, which can be set between -1000 and 1000. This Scheduling Priority Modifier will be used in calculating the overall Scheduling Priority. 
  4. Save and Close the properties dialog.
 

Apply a Queue at the Folder level

Applying a Queue at the Folder level will set the given Batch Queue as the default for all Jobs and Setups within that Folder. A Folder's default Batch Queue can be overridden on manual submissions, or by defining a Batch Queue on the Job or Setup itself. Folder level Scheduling Priority modifiers will be used in overall Scheduling Priority calculations, regardless of whether or not the Folder Batch Queue is overridden. 

  1. Right click on the given Folder and select Properties from the drop-down list.
  2. From the Folder Properties dialog that appears, select the Properties tab, then select the relevant Batch Queue from the Submit Options section.
  3. If using this batch queue with multiple Folders, users can set a Scheduling Priority Base that will help to prioritize each Job within the given Folder. 
  4. Save and Close the Folder Properties dialog.
 

Configure Batch Queue and Scheduling Priority on manual Job or Setup submissions

Through the use of manual submissions, users can add Jobs or Setups to any Batch Queue, and can even push the given Job or Setup to the front of a Batch Queue by properly configuring the Scheduling Priority.

  1. With the relevant Job or Setup selected, click the Submit button to manually submit the Job or Setup.
  2. In the Submit dialog that appears, select the Schedule tab.
  3. Choose the relevant Queue from the Batch Queue drop-down list, then set the Scheduling Priority for the manual submission. 
  4. Adjust other options as necessary, then click Submit Run Request.
Have more questions? Submit a request

Comments