Job submission to UC3

Overview

UC3 resource selection options

Different combinations of resources can be selected within UC3 since not all resources have identical capabilities. Pools available at any given time are listed at http://uc3-mgt.uchicago.edu:8080/.  Here are some possibilities:
  • Require jobs run on a specific pool

Condor requirements by resource

This is expressed with the Condor requirements file (see example below)

Name Head Requirements
CycleSeeder uc3-mgt.uchicago.edu
Requirements = UidDomain == "osg-gk.mwt2.org"
MWT2 condor.mwt2.org
Requirements = UidDomain == "osg-gk.mwt2.org"
SPT uc3-cloud.uchicago.edu
Requirements = Machine == "sptcloud.mwt2.org"
ITB-PBS via Campus Factory itb1.uchicago.edu
Requirements = IS_GLIDEIN =?= TRUE
or
Requirements = GLIDEIN_Site == UcItbForUc3
ITS Virtualization Lab appcloud01.uchicago.edu
Requirements = Machine == "appcloud01.uchicago.edu"
or
Requirements = UidDomain == "uchicago.edu"

A simple test job

Job script

Short test job:
#!/bin/bash
# short.sh: a short discovery job
/bin/hostname
/bin/date
/usr/bin/id
/usr/bin/whoami
/bin/env | /bin/sort

Submit file example

Here is a sample Condor submit file.
########################
# Submit description file for short test program
########################
Executable     = short.sh
Universe       = vanilla
Error   = job.err.$(Cluster)-$(Process)
Output  = job.out.$(Cluster)-$(Process)
Log     = job.log.$(Cluster)
Requirements = UidDomain == "osg-gk.uchicago.edu"
Queue

Another simple test job

hello.submit

# Hello World-type Submit File for Condor

# Path to the program
Executable = /bin/echo

# Condor universe. Describes various condor runtime environments.
#  'vanilla' should be sufficient for most batch jobs. 
#  there are others such as 'mpi', 'java', and 'vm' as well
Universe   = vanilla

# Specify the error file, output file, and log file 
Error       = hello.err
Output      = hello.out
Log        = hello.log

# Arguments for the executable ('echo' in this case)
Arguments  = "Hello World"

#Number of jobs to queue
Queue 1

A simple Mathematica-enabled job

Some resources in UC3 have Mathematica installed, while others do not. For a job to require Mathematica, the following should be added:
requirements = (HAS_MATHEMATICA =?= True)

-- LincolnBryant - 4 June 2012

-- MarcoMambelli - 23 May 2012
Topic revision: r3 - 04 Jun 2012, LincolnBryant
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback