PathenaTry3

Background

Starting from where we left off with PathenaTry2.

Initial

• source /osg/app/atlas_app/atlas_rel/13.0.30/cmtsite/setup.sh -tag=13.0.30.15,32,AtlasPoint1
• (I forgot to cd to an work directory, so my home directory is being used for InstallArea, etc.)
• export CMTPATH=`pwd`:$CMTPATH
• export CVSROOT=:ext:rgardner@atlas-sw.cern.ch:/atlascvs
• export CVS_RSH=ssh
• export PATHENA_GRID_SETUP_SH=/share/osg-client/setup.sh

Setup packages

• cd ~/work/13.0.30/PhysicsAnalysis/DistributedAnalysis/PandaTools/cmt
• source setup.sh; make
• cd ~/work/13.0.30/PhysicsAnalysis/SUSYPhys/SUSYValidation/cmt/
• source setup.sh; make
• I then setup a "run" directory in the same subdirectory as InstallArea, which in this case is my home directory.
• mkdir ~/run3
• cd ~run3
• get_files SUSYValidation_jobOptions.py

setup grid

• source /share/osg-client/setup.sh
• grid-proxy-init

Temporary fix for PYTHONPATH in osg-client

• echo $PYTHONPATH > file
• edit file and remove /share/osg-client/globus/lib64/python:
• export PYTHONPATH=`cat file`

Run

• pathena --inDS valid2_valid1.005403.SU3_jimmy_susy.recon.AOD.v13003003 --outDS user.RobertWGardnerJr.test0 --site ANALY_MWT2 SUSYValidation_jobOptions.py
• Here is a PathenaSessionTry3.

Job monitoring

• Check the status of the job from Panda monitor: http://pandamon.usatlas.bnl.gov:25880/server/pandamon/query?dash=analysis

Troubleshooting ANALY_MWT2

• http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?job=7383248 was the analysis-build job and http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?job=7383250 was the analysis job.
• Problems with the analysis build job. Went into holding pretty quick.
• LogFileExtracts1 and FindAndViewLogfiles1
• curl http://uct2-grid1.uchicago.edu:8000/dq2/lrc/PoolFileCatalog?lfns=user.RobertWGardnerJr.uct3-edge4_50.lib._000002.log.tgz
• Shows and XML of file - see LRCforExample1.
• Try to fetch logfile tarball
• globus-url-copy gsiftp://uct2-grid7.uchicago.edu/pnfs/uchicago.edu/data/ddm1/user.RobertWGardnerJr.uct3-edge4_89.lib._000001/user.RobertWGardnerJr.uct3-edge4_50.lib._000002.log.tgz file:////home/rwg/work/13.0.30/run/tmp/file.tgz

Testing ANALY_UTA

• See PathenaSessionUTA
• http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?job=7384326
• http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?job=7384327

To do from Nurcan

9. Once the job is completed, get the output ntuple (root file) by: $ dq2_get -rv user.YourName.test

10. Run a root macro from SUSYValidation package to make plots $ get_files susy_RTT.C $ root -b -q susy_RTT.C\(\"nameOfRootFile\"\)

11. This will create png files for plots. You see them on your web browser if you like: $ get_files plot_SU3.html Put the png files and plot_SU3.html on your web server and look at plot_SU3.html on your browser.

12. You can send the job to other sites by specifying the site name as: ANALY_UTA, ANALY_AGLT2, ANALY_NET2, ANALY_SLAC, ANALY_OU_OCHEP_SWT2

References

• https://twiki.cern.ch/twiki/bin/view/Atlas/DAonPanda
• https://www.hep.ucl.ac.uk/twiki/bin/view/Main/AtlasPathena

-- RobGardner - 11 Feb 2008