TestingROOTIO

Introduction

These are some notes for running IlijaVukotic's ROOTIO package for measuring local and WAN performance. You can vary the percentage of the file read, and the size to the TTreeCache buffer. These instructions are based on using ATLASLocalRootBase from a CVMFS mounted file system.

Environment setup

For interactive use, in your .bashrc file, put something like this:

# ATLASLocalRootBase setups
export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase
alias setupATLAS='source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh'
export ALRB_localConfigDir=$HOME/localConfig

From a job script, execute something like this:

# ATLASLocalRootBase setups
export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase
export ALRB_localConfigDir=$HOME/localConfig
source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh
source ${ATLAS_LOCAL_ROOT_BASE}/packageSetups/atlasLocalROOTSetup.sh 

Checkout the package

Create a working directory and cd to it. Then

svn co svn+ssh://your-lxplus-account@svn.cern.ch/reps/atlasgrp/Computing/EDM/ROOTIOTests

Get an input data file

setupATLAS
localSetupGLite
voms-proxy-init -voms atlas
xrdcp root://xrd.mwt2.org//atlas/dq2/user/ilijav/HCtest/user.ilijav.HCtest.1/group.test.hc.NTUP_SMWZ.root /tmp/

Alternatively use these redirectors:

• glrd.usatlas.org
• xrd-central.uchicago.edu (AGLT2, MWT2, OU, IllinoisHEP)
• Or look here: http://uct3-xrdp.uchicago.edu:8080/rsv/

Examples

NTUP file - local file access

• 10% of file, 30 MB TTreeCache buffer
• root -l -q -b "read.C++ (\"group.test.hc.NTUP_SMWZ.root\",\"physics\",10,30)"

NTUP file - via MWT2 dCap door

• Native dCap door uses local site dCache path based on LFC
• 10% of file, 30 MB TTreeCache buffer
• dCap door is located at host dcap.mwt2.org, we'll use default dCap port (whatever it is)
• root -l -q -b "read.C++ (\"dcap://dcap.mwt2.org/pnfs/uchicago.edu/atlasdatadisk/user/ilijav/HCtest/user.ilijav.HCtest.1/group.test.hc.NTUP_SMWZ.root\",\"physics\",10,30)"

NTUP file - via MWT2 dCache-xrootd door

• Native dCache-Xrootd door uses local site dCache path based on LFC
• 10% of file, 30 MB TTreeCache buffer
• dcache-xrootd door is located at host dcap.mwt2.org, port 1096
• root -l -q -b "read.C++ (\"root://dcap.mwt2.org:1096/pnfs/uchicago.edu/atlasdatadisk/user/ilijav/HCtest/user.ilijav.HCtest.1/group.test.hc.NTUP_SMWZ.root\",\"physics\",10,30)"

NTUP file - xrootd via FAX overlay at MWT2

• FAX uses ATLAS global name space
• 10% of file, 30 MB TTreeCache buffer
• root -l -q -b "read.C++ (\"root://xrd.mwt2.org//atlas/dq2/user/ilijav/HCtest/user.ilijav.HCtest.1/group.test.hc.NTUP_SMWZ.root\",\"physics\",10,30)"

NTUP file - xrootd via FAX US central redirector

• FAX uses ATLAS global name space
• 10% of file, 30 MB TTreeCache buffer
• root -l -q -b "read.C++ (\"root://xrd-central.uchicago.edu//atlas/dq2/user/ilijav/HCtest/user.ilijav.HCtest.1/group.test.hc.NTUP_SMWZ.root\",\"physics\",10,30)"
• Notice redirection message:

  120427 14:38:14 001 Xrd: GoToAnotherServer: Going to: uct2-grid5.uchicago.edu:1094
  120427 14:38:14 001 Xrd: GoToAnotherServer: Going to: uct2-s1.uchicago.edu:1094

AOD file via dCache-Xrootd door at MWT2

• Notice CollectionTree replaces physics in argument
• root -l -q -b "read.C++ (\"root://dcap.mwt2.org:1096/pnfs/uchicago.edu/atlasdatadisk/mc11_7TeV/AOD/e815_s1272_s1274_r2730_r2700/mc11_7TeV.106044.PythiaWmunu_no_filter.merge.AOD.e815_s1272_s1274_r2730_r2700_tid519075_00/AOD.519075._000394.pool.root.1\",\"CollectionTree\",10,30)"

-- RobGardner - 27 Apr 2012