PathenaTry2

Background

These are some personal notes taken while trying out the SUSY validation package, run via pathena. (Not meant for public consumption!)

• See PathenaStartup for some initial notes that were appropriate for using a release rather than a distribution kit.

Environment for MWT2 or UC Tier3

• cd /some/work/area/. In my example, cd ~/work/13.0.30/.
• source /osg/app/atlas_app/atlas_rel/13.0.30/cmtsite/setup.sh -tag=13.0.30.15,32,AtlasPoint1
• export CMTPATH=`pwd`:$CMTPATH
• export CVSROOT=:ext:rgardner@atlas-sw.cern.ch:/atlascvs
• export CVS_RSH=ssh
• export PATHENA_GRID_SETUP_SH=/share/osg-client/setup.sh
• source /share/osg-client/setup.sh

Checkout and build

• cmt co PhysicsAnalysis/DistributedAnalysis/PandaTools
• cmt co PhysicsAnalysis/SUSYPhys/SUSYValidation
• Then cd to each cmt dir, source setup.sh and make.
• By the way, here is the requirements file at the time: CmtRequirements1

Setup run directory

• In this example, cd ~/work/13.0.30, mkdir run, cd run
• get_files SUSYValidation_jobOptions.py

Temporary fix for PYTHONPATH in osg-client

• echo $PYTHONPATH > file
• edit file and remove /share/osg-client/globus/lib64
• export PYTHONPATH=`cat file`

Run

• pathena --inDS valid2_valid1.005403.SU3_jimmy_susy.recon.AOD.v13003003 --outDS user.RobertWGardnerJr.test0 --site ANALY_MWT2 SUSYValidation_jobOptions.py
• Here is a PathenaSession1.

Job monitoring

• Check the status of the job from Panda monitor: http://pandamon.usatlas.bnl.gov:25880/server/pandamon/query?dash=analysis

Troubleshooting ANALY_MWT2

• http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?job=7383248 was the analysis-build job and http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?job=7383250 was the analysis job.
• Problems with the analysis build job. Went into holding pretty quick.
• LogFileExtracts1 and FindAndViewLogfiles1
• curl http://uct2-grid1.uchicago.edu:8000/dq2/lrc/PoolFileCatalog?lfns=user.RobertWGardnerJr.uct3-edge4_50.lib._000002.log.tgz
• Shows and XML of file - see LRCforExample1.
• Try to fetch logfile tarball
• globus-url-copy gsiftp://uct2-grid7.uchicago.edu/pnfs/uchicago.edu/data/ddm1/user.RobertWGardnerJr.uct3-edge4_89.lib._000001/user.RobertWGardnerJr.uct3-edge4_50.lib._000002.log.tgz file:////home/rwg/work/13.0.30/run/tmp/file.tgz

Testing ANALY_UTA

• See PathenaSessionUTA
• http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?job=7384326
• http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?job=7384327

To do from Nurcan

9. Once the job is completed, get the output ntuple (root file) by: $ dq2_get -rv user.YourName.test

10. Run a root macro from SUSYValidation package to make plots $ get_files susy_RTT.C $ root -b -q susy_RTT.C\(\"nameOfRootFile\"\)

11. This will create png files for plots. You see them on your web browser if you like: $ get_files plot_SU3.html Put the png files and plot_SU3.html on your web server and look at plot_SU3.html on your browser.

12. You can send the job to other sites by specifying the site name as: ANALY_UTA, ANALY_AGLT2, ANALY_NET2, ANALY_SLAC, ANALY_OU_OCHEP_SWT2

References

• https://twiki.cern.ch/twiki/bin/view/Atlas/DAonPanda
• https://www.hep.ucl.ac.uk/twiki/bin/view/Main/AtlasPathena

-- RobGardner - 08 Feb 2008