You are here: Foswiki>CycleSeeder Web>Uc3JobSubmission (04 Jun 2012, LincolnBryant)Edit Attach

Job submission to UC3

Overview
- UC3 resource selection options
- Condor requirements by resource
A simple test job
- Job script
- Submit file example
Another simple test job
- hello.submit
- A simple Mathematica-enabled job

Overview

UC3 resource selection options

Different combinations of resources can be selected within UC3 since not all resources have identical capabilities. Pools available at any given time are listed at http://uc3-mgt.uchicago.edu:8080/. Here are some possibilities:

Require jobs run on a specific pool

Condor requirements by resource

This is expressed with the Condor requirements file (see example below)

Name	Head	Requirements
CycleSeeder	uc3-mgt.uchicago.edu	Requirements = UidDomain == "osg-gk.mwt2.org"
MWT2	condor.mwt2.org	Requirements = UidDomain == "osg-gk.mwt2.org"
SPT	uc3-cloud.uchicago.edu	Requirements = Machine == "sptcloud.mwt2.org"
ITB-PBS via Campus Factory	itb1.uchicago.edu	Requirements = IS_GLIDEIN =?= TRUE or Requirements = GLIDEIN_Site == UcItbForUc3
ITS Virtualization Lab	appcloud01.uchicago.edu	Requirements = Machine == "appcloud01.uchicago.edu" or Requirements = UidDomain == "uchicago.edu"

A simple test job

Job script

Short test job:

#!/bin/bash
# short.sh: a short discovery job
/bin/hostname
/bin/date
/usr/bin/id
/usr/bin/whoami
/bin/env | /bin/sort

Submit file example

Here is a sample Condor submit file.

########################
# Submit description file for short test program
########################
Executable     = short.sh
Universe       = vanilla
Error   = job.err.$(Cluster)-$(Process)
Output  = job.out.$(Cluster)-$(Process)
Log     = job.log.$(Cluster)
Requirements = UidDomain == "osg-gk.uchicago.edu"
Queue

Another simple test job

hello.submit

# Hello World-type Submit File for Condor

# Path to the program
Executable = /bin/echo

# Condor universe. Describes various condor runtime environments.
#  'vanilla' should be sufficient for most batch jobs. 
#  there are others such as 'mpi', 'java', and 'vm' as well
Universe   = vanilla

# Specify the error file, output file, and log file 
Error       = hello.err
Output      = hello.out
Log        = hello.log

# Arguments for the executable ('echo' in this case)
Arguments  = "Hello World"

#Number of jobs to queue
Queue 1

A simple Mathematica-enabled job

Some resources in UC3 have Mathematica installed, while others do not. For a job to require Mathematica, the following should be added:

requirements = (HAS_MATHEMATICA =?= True)

-- LincolnBryant - 4 June 2012

-- MarcoMambelli - 23 May 2012

Topic revision: r3 - 04 Jun 2012, LincolnBryant

CycleSeeder

Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback