Testing the Tier3SW environment provided by Grid Canada

Introduction

Installation test

The software is described in https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ManageTier3SW The installation instruction are in a text file in CVS: http://viewcvs.atlas-canada.ca/viewvc.cgi/ATLAS%20Canada/userSupport/manageTier3SW/_README.FIRST?view=markup A presentation: http://indico.cern.ch/contributionDisplay.py?contribId=18&sessionId=0&confId=77057

I installed it on uct3-grid5 in /ecache/marco/asoka/ATLASLocalRootBase/. The installation requires a dedicated user (atlasadmin). I tried to circumvent that using my own account:

• had to install some software out of ~/bin, the chosen /ecache/marco/asoka/bin was not sufficient (a [https://twiki.mwt2.org/bin/../pub/Main/TestCanadaTier3SW/tmp100215-CanadaTier3SW-failedinstall.txt][first install failed]] without it)
• the main installation happened in the specified /ecache/marco/asoka/ATLASLocalRootBase/ and is little more than 2GB
• as a side effect a ~/workarea directory was created (no warning or request) with 294M
• a crontab for the user was created:

   crontab -l
  5 23,5,11,17 * * * export ATLAS_LOCAL_ROOT_BASE=/ecache/marco/asoka/ATLASLocalRootBase/ATLASLocalRootBase; $ATLAS_LOCAL_ROOT_BASE/utilities/fetchCRL.sh 2>&1
  42 14 * * * export ATLAS_LOCAL_ROOT_BASE=/ecache/marco/asoka/ATLASLocalRootBase/ATLASLocalRootBase; $ATLAS_LOCAL_ROOT_BASE/utilities/fetchCA.sh 2>&1
  

• Here the attached log file

The installation directory

The biggest part of the installation is the i686 directory with binaries and libraries.

> du -sh ATLASLocalRootBase/ATLASLocalRootBase/i686/*0	ATLASLocalRootBase/ATLASLocalRootBase/i686/Athena
6.2M	ATLASLocalRootBase/ATLASLocalRootBase/i686/DQ2Client
239M	ATLASLocalRootBase/ATLASLocalRootBase/i686/Ganga
631M	ATLASLocalRootBase/ATLASLocalRootBase/i686/Gcc
517M	ATLASLocalRootBase/ATLASLocalRootBase/i686/gLite
0	ATLASLocalRootBase/ATLASLocalRootBase/i686/java-i686
3.7M	ATLASLocalRootBase/ATLASLocalRootBase/i686/Pacman
1.3M	ATLASLocalRootBase/ATLASLocalRootBase/i686/PandaClient
61M	ATLASLocalRootBase/ATLASLocalRootBase/i686/python
523M	ATLASLocalRootBase/ATLASLocalRootBase/i686/root
0	ATLASLocalRootBase/ATLASLocalRootBase/i686/wlcg-client

wlcg-client, java and Athena are not installed yet (probably their installation may be triggered).

Most of the space is used by C compilers (Gcc), root, gLite (including globus), Ganga, python.

The workarea directory

> du -sh workarea/*
8.0K	workarea/ATLASLocalRootBase
8.0K	workarea/configATLASLocalRootBase
8.0K	workarea/DQ2Client
24K	workarea/Ganga
8.0K	workarea/Gcc
146M	workarea/gLite
852K	workarea/Pacman
2.3M	workarea/PandaClient
92M	workarea/python
54M	workarea/root

It mainly includes unexpanded tar files (gliteUI is the biggest). Few packages are installed, e.g. python, PandaClient.

Comparing current wlcg-client installation directory

Wlcg-client uses about 1.1GB. It is only grid software (no root and Athena included).

> du -sh /ecache/share/wlcg-client091218/*
34M	/ecache/share/wlcg-client091218/ant
0	/ecache/share/wlcg-client091218/atlasosgcompat
28M	/ecache/share/wlcg-client091218/berkeley-db
2.0M	/ecache/share/wlcg-client091218/bwctl
2.5M	/ecache/share/wlcg-client091218/cert-scripts
340M	/ecache/share/wlcg-client091218/condor
4.3M	/ecache/share/wlcg-client091218/curl
636K	/ecache/share/wlcg-client091218/expat
56K	/ecache/share/wlcg-client091218/fetch-crl
22M	/ecache/share/wlcg-client091218/glite
228M	/ecache/share/wlcg-client091218/globus
3.2M	/ecache/share/wlcg-client091218/gpt
139M	/ecache/share/wlcg-client091218/jdk1.5
21M	/ecache/share/wlcg-client091218/lcg
528K	/ecache/share/wlcg-client091218/licenses
80K	/ecache/share/wlcg-client091218/logrotate
0	/ecache/share/wlcg-client091218/logs
100K	/ecache/share/wlcg-client091218/ndt
12K	/ecache/share/wlcg-client091218/npad
4.0M	/ecache/share/wlcg-client091218/o..pacman..o
5.2M	/ecache/share/wlcg-client091218/openldap
4.0K	/ecache/share/wlcg-client091218/osg
2.3M	/ecache/share/wlcg-client091218/owamp
4.0K	/ecache/share/wlcg-client091218/pacman-platform-mapping
61M	/ecache/share/wlcg-client091218/pegasus
42M	/ecache/share/wlcg-client091218/perl
20K	/ecache/share/wlcg-client091218/post-install
40K	/ecache/share/wlcg-client091218/pyglobus-url-copy
20K	/ecache/share/wlcg-client091218/setup.csh
16K	/ecache/share/wlcg-client091218/setup.sh
8.7M	/ecache/share/wlcg-client091218/srm-client-fermi
9.1M	/ecache/share/wlcg-client091218/srm-client-lbnl
4.0K	/ecache/share/wlcg-client091218/trusted.caches
3.8M	/ecache/share/wlcg-client091218/vdt
16K	/ecache/share/wlcg-client091218/vdt-app-data
224K	/ecache/share/wlcg-client091218/vdt-install.log
4.0K	/ecache/share/wlcg-client091218/voms
1.7M	/ecache/share/wlcg-client091218/wget
72M	/ecache/share/wlcg-client091218/xrootd

There is no future triggered install. The biggest part are: condor, globus, java-1.5, xrootd, pegasus. It has also more small packages than CanadaTier3SW

Use

The CanadaTier3SW is more a set of environment than a single sw package. Initial setup:

export ATLAS_LOCAL_ROOT_BASE=/ecache/marco/asoka/ATLASLocalRootBase/ATLASLocalRootBase
source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh

After the initial setup you have separate setup commands depending what you want to do. Some of them are compatible with others, some not.

Type localSetupDQ2Client to use DQ2 Client
...Type localSetupGanga to use Ganga
...Type localSetupGcc to use alternate gcc
...Type localSetupGLite to use GLite
...Type localSetupPacman to use Pacman
...Type localSetupPandaClient to use Panda Client
...Type localSetupROOT to setup (standalone) ROOT
...Type saveSnapshot [--help] to save your settings
...Type showVersions to show versions of installed software
...Type runKV [--help] to test the kit or your desktop

Wlcg-client is a single pacman package:

source /ecache/share/wlcg-client091218

Commands comparison

Globus

CanadaTier3SW:

globus-domainname            globus-job-clean             globus-makefile-header.gpt1
globus-gass-server           globus-job-get-output        globusrun
globus-gass-server-shutdown  globus-job-run               globus-sh-exec
globus-generalized-time      globus-job-status            globus-url-copy
globus-hostname              globus-job-submit            globus-version
globus-job-cancel            globus-makefile-header       

wlcg-client:

globus2jks                             globus-job-run-ws.pl
globus-build-doxygen-dependencies      globus-job-status
globus-check-environment               globus-job-submit
globus-credential-delegate             globus-job-submit-ws
globus-credential-refresh              globus-job-submit-ws.pl
globus-deploy-gar                      globus-makefile-header
globus-domainname                      globus-rls-cli
globus-edit-wsdd                       globusrun
globus-gass-server                     globusrun-ws
globus-gass-server-shutdown            globus-sh-exec
globus-generalized-time                globus-start-container
globus-hostname                        globus-start-container-detached
globus-hostname2contacts               globus-stop-container
globus-job-cancel                      globus-stop-container-detached
globus-job-clean                       globus-undeploy-gar
globus-job-clean-ws                    globus-update-doxygen-index
globus-job-clean-ws.pl                 globus-url-copy
globus-job-get-output                  globus-vararg-enums-doxygen-filter.pl
globus-job-get-output-ws               globus-version
globus-job-get-output-ws.pl            globus-wsc-container
globus-job-run                         globus-wsdl-parser
globus-job-run-ws                      globus-wsrf-cgen

wlcg-client provides also WS-Globus support

SRM

CanadaTier3SW:

srm-abort-files           srm-get-request-status    srm-release-files
srm-abort-request         srm-get-request-summary   srm-release-space
srm-advisory-delete       srm-get-request-tokens    srm-reserve-space
srm-bring-online          srm-get-space-metadata    srmrm
srm-check-permissions     srm-get-space-tokens      srmrmdir
srmcp                     srmls                     srm-set-permissions
srm-extend-file-lifetime  srmmkdir                  srmstage
srm-get-metadata          srmmv                     srm-storage-element-info
srm-get-permissions       srmping                   srm_v1

wlcg-client:

srm                       srm-ls-status             srm-reserve-space
srm-abort-files           srmmkdir                  srmrm
srm-abort-request         srm-mkdir                 srm-rm
srm-advisory-delete       srmmv                     srmrmdir
srm-bring-online          srm-mv                    srm-rmdir
srm-check-permissions     srm-permission-check      srm-set-permissions
srm-copy                  srm-permission-get        srm-space
srm-copy-status           srm-permission-set        srm-sp-change
srmcp                     srmping                   srm-sp-info
srm-dir                   srm-ping                  srm-sp-purge
srm-extendfilelifetime    srm-putdone               srm-sp-release
srm-extend-file-lifetime  srm-release               srm-sp-reserve
srm-get-metadata          srm-release-files         srm-sp-reserve-status
srm-get-permissions       srm-release-space         srm-sp-tokens
srm-get-request-status    srm-req-abort             srm-sp-update
srm-get-request-summary   srm-req-abortfiles        srmstage
srm-get-request-tokens    srm-req-resume            srm-storage-element-info
srm-get-space-metadata    srm-req-summary           srm-transferprotocols
srm-get-space-tokens      srm-req-suspend           srm-util
srmls                     srm-req-tokens            srm_v1
srm-ls                    srm-request               

wlcg-client has also the LBNL client

LCG

CanadaTier3SW:

lcg-aa               lcg-gt               lcg-lr               lcg-sd
lcg-bringonline      lcg-info             lcg-ls               lcg-stmd
lcg-cp               lcg-infosites        lcg-ManageVOTag      lcg-tags
lcg-cr               lcg-job-monitor      lcg-ra               lcg-uf
lcg-del              lcg-job-status       lcg-rep              
lcg-get-checksum     lcg-la               lcg-replica-manager  
lcg-getturls         lcg-lg               lcg-rf               

wlcg-client:

lcg-aa               lcg-getturls         lcg-lr               lcg-sd
lcg-bringonline      lcg-gt               lcg-ls               lcg-stmd
lcg-cp               lcg-info             lcg-ra               lcg-uf
lcg-cr               lcg-infosites        lcg-rep              
lcg-del              lcg-la               lcg-replica-manager  
lcg-get-checksum     lcg-lg               lcg-rf               

! CanadaTier3SW has extra commands (lcg-getturls, lcg-ManageVOTag, lcg-tags)

gLite

CanadaTier3SW:

glite-brokerinfo                      glite-srm-get-metadata
glite-ce-allowed-submission           glite-srm-get-protocols
glite-ce-delegate-proxy               glite-srm-get-status
glite-ce-disable-submission           glite-srm-mk-permanent
glite-ce-enable-submission            glite-srm-pin
glite-ce-get-cemon-url                glite-srm-ping
glite-ce-job-cancel                   glite-srm-put
glite-ce-job-lease                    glite-srm-set-status
glite-ce-job-list                     glite-srm-unpin
glite-ce-job-purge                    glite-ssss-join-key
glite-ce-job-resume                   glite-ssss-join-passwd
glite-ce-job-status                   glite-ssss-split-key
glite-ce-job-submit                   glite-ssss-split-passwd
glite-ce-job-suspend                  glite-transfer-addvomanager
glite-ce-monitor-consumer             glite-transfer-cancel
glite-ce-monitor-getevent             glite-transfer-channel-add
glite-ce-monitor-getinfo              glite-transfer-channel-addmanager
glite-ce-monitor-gettopics            glite-transfer-channel-audit
glite-ce-monitor-pause                glite-transfer-channel-drop
glite-ce-monitor-resume               glite-transfer-channel-list
glite-ce-monitor-subinfo              glite-transfer-channel-listmanagers
glite-ce-monitor-subscribe            glite-transfer-channel-removemanager
glite-ce-monitor-subupdate            glite-transfer-channel-set
glite-ce-monitor-unsubscribe          glite-transfer-channel-setvolimit
glite-ce-proxy-renew                  glite-transfer-channel-setvoshare
glite_data_srm_api_cpp_test           glite-transfer-channel-signal
glite_data_srm_api_cpp_test_create    glite-transfer-discovery
glite_data_srm_api_cpp_test_delete    glite-transfer-getroles
glite_data_srm_api_c_test             glite-transfer-list
glite-delegation-destroy              glite-transfer-listvomanagers
glite-delegation-info                 glite-transfer-removevomanager
glite-delegation-init                 glite-transfer-service-info
glite-dgas-hlr-query                  glite-transfer-setpriority
glite-dgas-hlr-resinfo                glite-transfer-status
glite-dgas-hlr-userinfo               glite-transfer-submit
glite-dgas-ping                       glite-transfer-submit-placement
glite-eds-chmod                       glite-version
glite-eds-decrypt                     glite-voms-proxy-destroy
glite-eds-encrypt                     glite-voms-proxy-fake
glite-eds-get                         glite-voms-proxy-info
glite-eds-getacl                      glite-voms-proxy-init
glite-eds-key-register                glite-voms-proxy-list
glite-eds-key-unregister              glite-wms-get-configuration
glite-eds-put                         glite-wms-grid-console-shadow
glite-eds-rm                          glite-wms-job-attach
glite-eds-setacl                      glite-wms-job-cancel
glite-job-attach                      glite-wms-job-delegate-proxy
glite-job-logging-info                glite-wms-job-info
glite-job-status                      glite-wms-job-list-match
glite-lb-logevent                     glite-wms-job-logging-info
glite-proxy-cert                      glite-wms-job-output
glite-sd-query                        glite-wms-job-perusal
glite-srm-delete                      glite-wms-job-status
glite-srm-get                         glite-wms-job-submit

wlcg-client:

CanadaTier3SW has 108 glite commands, all missing in wlcg-client. Some I think are a simple rename for other commands (e.g. glite-voms-proxy-init) but I'm not sure, should check. Some may have no alternative, e.g. glite-wms-...

edg

CanadaTier3SW:

edg-gridftp-exists        edg-job-cancel            edg-voms-proxy-destroy
edg-gridftp-ls            edg-job-get-chkpt         edg-voms-proxy-fake
edg-gridftp-mkdir         edg-job-get-logging-info  edg-voms-proxy-info
edg-gridftp-rename        edg-job-get-output        edg-voms-proxy-init
edg-gridftp-rm            edg-job-list-match        edg-voms-proxy-list
edg-gridftp-rmdir         edg-job-status            
edg-job-attach            edg-job-submit            

wlcg-client:

edg-voms-proxy-destroy  edg-voms-proxy-info     edg-voms-proxy-list     
edg-voms-proxy-fake     edg-voms-proxy-init     

CanadaTier3SW provides some extra command, to evaluate

voms

CanadaTier3SW:

voms-admin          voms-proxy-destroy  voms-proxy-info     voms-proxy-list
voms-admin.py       voms-proxy-fake     voms-proxy-init     

wlcg-client:

voms-proxy-destroy  voms-proxy-info     voms-proxy-list     
voms-proxy-fake     voms-proxy-init     

CanadaTier3SW provides some extra command, to evaluate

xrootd

CanadaTier3SW:

xrd          xrdb         xrdcp        xrdgsiproxy  xrdpwdadmin  

wlcg-client:

xrd            xrdb           xrdgsiproxy    xrdsecgsitest  xrdstagetool   
xrdadler32     xrdcp          xrdpwdadmin    xrdsssadmin    

CanadaTier3SW has only the commands provided by ROOT (no separate xrootd client). wlcg-client setup does not include ROOT even if it is compatible with ROOT.

-- MarcoMambelli - 15 Feb 2010