You are here: Foswiki>ITB Web>ITBBestmanXrootd (02 Mar 2009, SuchandraThapa)Edit Attach

ITBBestmanXrootd

Setup

  • Using bestman/xrootd as found in itb cache and following instructions given by storage team.
  • itb1: bestman, xrootdfs, fuse, gridftp
  • itb2: xrootd redirector & manager
  • itb3: xrootd data server

Installation on itb1 (bestman gateway / gridftp)

FUSE

  • yum install fuse-libs
  • yum install fuse
Appeared to work properly

Install pacman

  • cd /opt 
  • wget http://physics.bu.edu/pacman/sample_cache/tarballs/pacman-latest.tar.gz
  • tar xvzf pacman-latest.tar.gz
  • ln -s pacman-3.26 pacman
  • cd pacman-3.26
  • source setup.sh

Install bestman components

Xrootd

  • cd /opt
  • mkdir bestman
  • cd bestman
  • pacman -get ITB:XrootdFS
  • source setup.sh
  • /vdt/setup/configure_xrootdfs --user daemon --cache /storage/cache/ -xrdr-host itb2.uchicago.edu -xrdr-storage-path /storage/xrootd/

Bestman

  • pacman -get ITB:Bestman
  • source setup.sh
  • vi vdt/etc/vdt-update-certs.conf to enable crl updates from goc
  • source vdt-questions.sh
  • vdt-setup-ca-certificates
  • /vdt/setup/configure_bestman --server y --user daemon --cert /etc/grid-security/hostcert.pem --key /etc/grid-security/hostkey.pem --http-port 8080 --https-port 8443 --gums-host uct3-xen-edge1.uchicago.edu --with-transfer-servers gsiftp://itb1.uchicago.edu
  • visudo and add following 
Cmnd_Alias SRM_CMD = /bin/rm, /bin/mkdir, /bin/rmdir, /bin/mv, /bin/ls 
Runas_Alias SRM_USR = ALL, !root 
daemon ALL=(SRM_USR) NOPASSWD: SRM_CMD

Gridftp

  • pacman -get ITB:Bestman-Gridftp
  • ./vdt/setup/configure_gridftp --use-xrootd --xrootd-host itb2.uchicago.edu --xrootd-mount-point /storage/cache --xrootd-storage-path /storage/xrootd/
  • cp $VDT_LOCATION/post-install/prima-authz.conf /etc/grid-security/
  • cp $VDT_LOCATION/post-install/gsi-authz.conf /etc/grid-security
  • edit gsi-authz.conf and prima-authz.conf to make sure gums host is correct

Enable services

  • vdt-register-service --enable --name gratia-gridftp-transfer
  • vdt-register-service --enable --name gums-host-cron

Installation on itb3 (xrootd data node)

Install pacman

  • cd /opt 
  • wget http://physics.bu.edu/pacman/sample_cache/tarballs/pacman-latest.tar.gz
  • tar xvzf pacman-latest.tar.gz
  • ln -s pacman-3.26 pacman
  • cd pacman-3.26
  • source setup.sh

Xrootd

  • mkdir /opt/xrootd
  • cd /opt/xrootd
  • pacman -get ITB:Xrootd
  • source setup.sh
  • ./vdt/setup/configure_xrootd --server y --user rsv --xrdr-host itb2.uchicago.edu --xrdr-storage-path /storage/xrootd Use rsv account since it has a shell, daemon doesn't

Installation on itb2 (xrootd redirector)

Install pacman

  • cd /opt 
  • wget http://physics.bu.edu/pacman/sample_cache/tarballs/pacman-latest.tar.gz
  • tar xvzf pacman-latest.tar.gz
  • ln -s pacman-3.26 pacman
  • cd pacman-3.26
  • source setup.sh

Xrootd

  • mkdir /opt/xrootd
  • cd /opt/xrootd
  • pacman -get ITB:Xrootd
  • source setup.sh
  • ./vdt/setup/configure_xrootd --server y --user rsv --this-is-xrdr --xrdr-storage-path /storage/xrootd/ Use rsv account since it has a shell, daemon doesn't

Start system

itb2

  • cd /opt/xrootd
  • source setup.sh
  • vdt-control --on

itb3

  • cd /opt/xrootd
  • source setup.sh
  • vdt-control --on

itb1

  • cd /opt/xrootd
  • source setup.sh
  • vdt-control --on

Try 2

Invocations

Setups

  • Setup software in same locations (/opt/bestman on itb1, /opt/xrootd on itb2/itb3)
  • Data directories in /xrootd/{shadow,mount,cache} on all three servers

ITB1

  • configure_bestman 
./vdt/setup/configure_bestman --server y --user daemon --cert /etc/grid-security/bestmancert.pem \
--key /etc/grid-security/bestmankey.pem --http-port 8080 --https-port 8443 \
--gums-host uct3-xen-edge1.uchicago.edu --with-transfer-servers gsiftp://itb1.uchicago.edu  \
 --gums-dn "/DC=org/DC=doegrids/OU=Services/CN=itb1.uchicago.edu" \
-with-tokens-list "ATLASDATADISK[desc:ATLASDATADISK][5];ATLASPRODDISK[desc:ATLASPRODDISK][3];ATLASGROUPDISK[desc:ATLASGROUPDISK][3]" \
 --use-xrootd
  • configure_xrootdfs 
./vdt/setup/configure_xrootdfs --user daemon --cache /xrootd/mount/ \
-xrdr-host itb2.uchicago.edu -xrdr-storage-path /xrootd/shadow/
  • configure_gridftp 
./vdt/setup/configure_gridftp --use-xrootd --xrootd-host itb2.uchicago.edu \
--xrootd-mount-point  /xrootd/mount --xrootd-storage-path /xrootd/shadow

ITB2

  • configure_xrootd 
./vdt/setup/configure_xrootd --server y --user rsv --this-is-xrdr --xrdr-storage-path /xrootd/shadow/ \
 --xrdr-storage-cache /xrootd/cache/ -with-tokens-list "ATLASDATADISK[desc:ATLASDATADISK][5];ATLASPRODDISK[desc:ATLASPRODDISK][3];ATLASGROUPDISK[desc:ATLASGROUPDISK][3]" \
--public-cache-size 80

ITB3

  • configure_xrootd 
./vdt/setup/configure_xrootd --server y --user rsv --xrdr-host itb2.uchicago.edu \
--xrdr-storage-path /xrootd/shadow/  --xrdr-storage-cache /xrootd/cache/ --public-cache-size 80 \
 --with-tokens-list "ATLASDATADISK[desc:ATLASDATADISK][5];ATLASPRODDISK[desc:ATLASPRODDISK][3];ATLASGROUPDISK[desc:ATLASGROUPDISK][3]"

Testing

* srm-ping 
[sthapa@uct3-edge7 ~]$ srm-ping srm://itb1.uchicago.edu:8443/srm/v2/server
srm-ping   2.2.1.2.i2  Mon Feb  9 10:25:04 PST 2009
SRM-Clients and BeStMan Copyright(c) 2007-2009,
Lawrence Berkeley National Laboratory. All rights reserved.
Support at SRM@LBL.GOV and documents at http://datagrid.lbl.gov/bestman
 
SRM-CLIENT: Connecting to serviceurl httpg://itb1.uchicago.edu:8443/srm/v2/server

SRM-PING: Mon Mar 02 15:44:03 CST 2009  Calling SrmPing Request...
versionInfo=v2.2

Extra information (Key=Value)
backend_type=BeStMan
backend_version=2.2.1.2.i2
backend_build_date=2009-02-09T16:24:42.000Z 
GatewayMode=Enabled
gsiftpTxfServers=gsiftp://itb1.uchicago.edu
clientDN=/DC=org/DC=doegrids/OU=People/CN=Suchandra Thapa 757586
gumsIDMapped=sthapa
staticToken(0)=ATLASDATADISK desc=ATLASDATADISK size=5368709120
staticToken(1)=ATLASPRODDISK desc=ATLASPRODDISK size=3221225472
staticToken(2)=ATLASGROUPDISK desc=ATLASGROUPDISK size=3221225472
  • srm-copy 
[sthapa@uct3-edge7 ~]$ srm-copy file:////tmp/test1 srm://itb1.uchicago.edu:8443/srm/v2/server\?SFN=/xrootd/mount/test1
srm-copy   2.2.1.2.i2  Mon Feb  9 10:25:04 PST 2009
SRM-Clients and BeStMan Copyright(c) 2007-2009,
Lawrence Berkeley National Laboratory. All rights reserved.
Support at SRM@LBL.GOV and documents at http://datagrid.lbl.gov/bestman
 
SRM-CLIENT: Mon Mar 02 15:32:40 CST 2009 Connecting to httpg://itb1.uchicago.edu:8443/srm/v2/server

SRM-CLIENT: Mon Mar 02 15:32:40 CST 2009 Calling SrmPrepareToPutRequest now ...
request.token=put:0
status=SRM_SUCCESS
explanation=null
SRM-CLIENT: received TURL=gsiftp://itb1.uchicago.edu//xrootd/mount/test1

SRM-CLIENT: Mon Mar 02 15:32:44 CST 2009 start file transfer
SRM-CLIENT:Source=file:////tmp/test1
SRM-CLIENT:Target=gsiftp://itb1.uchicago.edu//xrootd/mount/test1

SRM-CLIENT: Mon Mar 02 15:32:47 CST 2009 end file transfer for file:////tmp/test1

SRM-CLIENT: Mon Mar 02 15:32:47 CST 2009 Calling putDone for srm://itb1.uchicago.edu:8443/srm/v2/server?SFN=/xrootd/mount/test1
Result.status=SRM_SUCCESS
Result.Explanation=null

SRM-CLIENT: Request completed with success

SRM-CLIENT: Printing text report now ...

SRM-CLIENT*REQUESTTYPE=put
SRM-CLIENT*TOTALFILES=1
SRM-CLIENT*TOTAL_SUCCESS=1
SRM-CLIENT*TOTAL_FAILED=0
SRM-CLIENT*REQUEST_TOKEN=put:0
SRM-CLIENT*REQUEST_STATUS=SRM_SUCCESS
SRM-CLIENT*SOURCEURL[0]=file:////tmp/test1
SRM-CLIENT*TARGETURL[0]=srm://itb1.uchicago.edu:8443/srm/v2/server?SFN=/xrootd/mount/test1
SRM-CLIENT*TRANSFERURL[0]=gsiftp://itb1.uchicago.edu//xrootd/mount/test1
SRM-CLIENT*ACTUALSIZE[0]=0
SRM-CLIENT*FILE_STATUS[0]=SRM_SUCCESS
SRM-CLIENT*EXPLANATION[0]=SRM-CLIENT: PutDone is called successfully
[sthapa@uct3-edge7 ~]$ srm-copy srm://itb1.uchicago.edu:8443/srm/v2/server\?SFN=/xrootd/mount/test1 file:////tmp/test2
srm-copy   2.2.1.2.i2  Mon Feb  9 10:25:04 PST 2009
SRM-Clients and BeStMan Copyright(c) 2007-2009,
Lawrence Berkeley National Laboratory. All rights reserved.
Support at SRM@LBL.GOV and documents at http://datagrid.lbl.gov/bestman
 
SRM-CLIENT: Mon Mar 02 15:32:56 CST 2009 Connecting to httpg://itb1.uchicago.edu:8443/srm/v2/server

SRM-CLIENT: Mon Mar 02 15:32:57 CST 2009 Calling SrmPrepareToGet Request now ...
request.token=get:1

status=SRM_SUCCESS
explanation=null
SRM-CLIENT: received TURL=gsiftp://itb1.uchicago.edu//xrootd/mount/test1

SRM-CLIENT: Mon Mar 02 15:33:00 CST 2009 start file transfer
SRM-CLIENT:Source=gsiftp://itb1.uchicago.edu//xrootd/mount/test1
SRM-CLIENT:Target=file:////tmp/test2

SRM-CLIENT: Mon Mar 02 15:33:03 CST 2009 end file transfer for srm://itb1.uchicago.edu:8443/srm/v2/server?SFN=/xrootd/mount/test1

SRM-CLIENT: Mon Mar 02 15:33:03 CST 2009 Calling releaseFile

SRM-CLIENT:  ...Calling srmReleaseFiles...
   status=SRM_SUCCESS
   explanation=null
   status=SRM_SUCCESS
   explanation=null

SRM-CLIENT: Request completed with success

SRM-CLIENT: Printing text report now ...

SRM-CLIENT*REQUESTTYPE=get
SRM-CLIENT*TOTALFILES=1
SRM-CLIENT*TOTAL_SUCCESS=1
SRM-CLIENT*TOTAL_FAILED=0
SRM-CLIENT*REQUEST_TOKEN=get:1
SRM-CLIENT*REQUEST_STATUS=SRM_SUCCESS
SRM-CLIENT*SOURCEURL[0]=srm://itb1.uchicago.edu:8443/srm/v2/server?SFN=/xrootd/mount/test1
SRM-CLIENT*TARGETURL[0]=file:////tmp/test2
SRM-CLIENT*TRANSFERURL[0]=gsiftp://itb1.uchicago.edu//xrootd/mount/test1
SRM-CLIENT*ACTUALSIZE[0]=5
SRM-CLIENT*FILE_STATUS[0]=SRM_FILE_PINNED

-- SuchandraThapa - 24 Feb 2009
Edit  | Attach | Print version | History: r3 < r2 < r1 | Backlinks | View wiki text | Edit wiki text | More topic actions
Topic revision: r3 - 02 Mar 2009, SuchandraThapa
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback