Test DQ2 Client

Introduction

This page is the entry point for different tests that are evaluating the performance of the tools used in ATLAS to transfer data. Mainly [[][DQ2 Client]], the client of the ATLAS Distributed Data Management system and the programs use to actually copy the files. In fact DQ2 client interacts with data catalogs and can use different programs to actually transfer the files. Programs used include:

• [[][lcg-cp]]
• [[][srmcp]]
• [[][ngcp]]

Tests

Here are some tests that I performed:

• comparison of different available grid client tools from a user point of view (TestDQ2Client080725). It compares the tools on their ability to retrieve a file (given a valid URL, maybe incomplete), on specific command line options requirements, on requirements for other servers beside the Storage Element.
• OSG storage element test (TestDQ2Client080728). It includes an analysis of TiersOfATLASCache (ATLAS SE catalog) and dataset retrieval tests from different SEs using different options in dq2-get
• simple performance test (TestDQ2Client080805). It is a simple performance test comparing the time required to retrieve a dataset using different commands

Some references:

SE used in OSG: bestman+GPFS and bestman+PVFS2 bestman+xrootd or bestman+lustre

File system, data movement performance measures available in literature:

Test comparing different file systems from Andrew Baranovski <abaranov@fnal.gov>(dCache group Andrei Maslennikov) at HEPIX FSWG: http://indico.cern.ch/getFile.py/access?contribId=28&sessionId=10&resId=1&materialId=slides&confId=27391

-- MarcoMambelli - 11 Aug 2008