TestSkim080313ANL

Intro

Test with FDR data at the ASC at ANL. Preparing for tutorial at the Jamboree

Directory /local/workdir/mm-s2/ and subdirectories

Links

A tutorial about TNT: http://ppewww.physics.gla.ac.uk/~caitrian/tutorial/edinburgh/index.html Another tutorial: https://twiki.cern.ch/twiki/bin/view/Atlas/EventTagTutorial

To submit errors: https://savannah.cern.ch/bugs/?func=additem&group=panda

To see all Pathena jobs submitted by Marco Mambelli: http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?ui=user&name=Marco%20Mambelli

Setup

Setup instructions about ASC: http://www.hep.anl.gov/atlas/ASC/YourAccount.html

-bash-3.00$ source /grid/app/asc_app/asc_rel/1.0/setup-script/set_version.sh
Enter Athena version: 12.0.7, 12.0.8, 13.0.10, 13.0.20, 13.0.25, 13.0.30 or 13.0.40: 13.0.40
Current Athena version:  13.0.40
-bash-3.00$ source /grid/app/asc_app/asc_rel/1.0/setup-script/grid_setup.sh
-bash-3.00$ source /opt/Don-Quijote/dq2_user_client/setup.sh
-bash-3.00$ grid-proxy-init 
Your identity: /DC=org/DC=doegrids/OU=People/CN=Marco Mambelli 325802
Enter GRID pass phrase for this identity:
Creating proxy ................................................. Done
Your proxy is valid until: Fri Mar 14 23:02:00 2008

Manual DQ2

Event reference pointing to ... Stream_AOD fixed by Jack: points to AODs, many returned, one official, some user-ds, some unknown

 File "/usr/lib/python2.3/site-packages/dq2/repository/client/RepositoryClient.py", line 486, in resolveVUID
  File "/share/osg-client/globus/lib/python/", line 8, in send
    
  File "/usr/lib/python2.3/site-packages/dq2/common/client/aspects/exception.py", line 41, in wrap_send
  File "/usr/lib/python2.3/site-packages/dq2/common/aspects/__init__.py", line 123, in _proceed_method
  File "/share/osg-client/globus/lib/python/", line 8, in send
    
  File "/usr/lib/python2.3/site-packages/dq2/common/client/aspects/transaction.py", line 34, in wrap_send
  File "/usr/lib/python2.3/site-packages/dq2/common/aspects/__init__.py", line 123, in _proceed_method
  File "/usr/lib/python2.3/site-packages/dq2/common/client/DQClient.py", line 378, in send
  File "/usr/lib/python2.3/site-packages/dq2/common/client/curl/DQCurl.py", line 252, in get
  File "/usr/lib/python2.3/site-packages/dq2/common/client/curl/DQCurl.py", line 186, in _process
dq2.repository.DQRepositoryException.DQUnknownDatasetException: [USER][OTHER] Unknown dataset exception! (vuid='93611533-a4f7-4a76-b956-6043b4d04fac')
>>> dataset = dq.repositoryClient.resolveVUID('5700fa5f-afcc-4d4c-924d-99a9ae3ca791')
>>> print dataset
{'dsn': 'fdr08_run1.0003070.StreamEgamma.merge.AOD.o1_r12_t1', 'version': 1}
>>> dq.contentClient.queryDatasetsWithFileByGUID('828FED21-B7DF-DC11-BFB4-0030487CD934')[
[]

Hello World

-bash-3.00$ cd testarea/13.0.40
-bash-3.00$ cmt show versions PhysicsAnalysis/AnalysisCommon/UserAnalysis
PhysicsAnalysis/AnalysisCommon/UserAnalysis UserAnalysis-00-10-12 /grid/app/atlas_app/atlas_rel/13.0.40/AtlasAnalysis/13.0.40

-bash-3.00$ cmt co -r UserAnalysis-00-10-12 PhysicsAnalysis/AnalysisCommon/UserAnalysis
-bash-3.00$ pushd PhysicsAnalysis/AnalysisCommon/UserAnalysis/cmt
-bash-3.00$ . setup.sh 
-bash-3.00$ popd
-bash-3.00$ mkdir run; cd run
-bash-3.00$ athena.py HelloWorldOptions.py

The hello world test runs correctly

Tag production

Instructions on https://twiki.cern.ch/twiki/bin/view/Atlas/TagForEventSelection#Building_Tags_Under_12_0_31 The problem is that instructions refer to release 12

-bash-3.00$ athena -c "PoolAODInput=['fdr08_run1.0003073.MinBias.merge.AOD.o1_r12_t1._0001.1']; PoolTAGOutput='fdr08_run1.0003073.MinBias.merge.TAG.o1_r12_t1._0001.mm.pool'" RecExCommon/aodtotag.py

...

CondProxyProvider                                 WARNING Service already offline
cleaning up
EventSelector                                     WARNING Service already offline
ChronoStatSvc                                        INFO  Number of skipped events for MemStat-1
StatusCodeSvc                                        INFO initialize
ApplicationMgr                                       INFO Application Manager Finalized successfully
ApplicationMgr                                       INFO Application Manager Terminated successfully
Py:Athena            INFO leaving with code 64: "exception raised during an algorithm execute"

-bash-3.00$ athena -c "PoolAODInput=['data/fdr08_run1.0003070.MinBias.merge.AOD.o1_r12_t1._0001.1']; PoolTAGOutput='fdr08_run1.0003070.MinBias.merge.TAG.o1_r12_t1._0001.mm.pool'" RecExCommon/aodtotag.py > out2.txt &

During the execution I saw some ERROR (missing Stream_AOD) but a TAG file was produced

Event count

This crashed with memory error:

-bash-3.00$ athena -c "In=['fdr08_run1.0003070.MinBias.merge.AOD.o1_r12_t1._0001.1'];CollType='ExplicitROOT'" AthenaPoolUtilities/EventCount.py > out_count.txt &

This worked correctly:

-bash-3.00$ athena -c "In=['fdr08_run1.0003070.MinBias.merge.AOD.o1_r12_t1._0001.1']" AthenaPoolUtilities/EventCount.py > out_count2.txt &

Notes for center

The grid sw is % /grid/vdt/Pacman/pacman-3.20/bin/pacman -get http://vdt.cs.wisc.edu/vdt_180_cache:VDT-Client finished at Wed Aug 1 15:47:40 2007 OSG client would be better OSG:client

To get a package version, instead of looking TagCollector: -bash-3.00$ cmt show versions PhysicsAnalysis/AnalysisCommon/UserAnalysis PhysicsAnalysis/AnalysisCommon/UserAnalysis UserAnalysis-00-10-12 /grid/app/atlas_app/atlas_rel/13.0.40/AtlasAnalysis/13.0.40

Set this env variable: export PATHENA_GRID_SETUP_SH=/grid/vdt/osg/setup.sh

-- MarcoMambelli - 13 Mar 2008