Meeting October 10

Meeting

Tuesday 10/10 at 2.30pm Chicago time

Phone conference ESNet Call: 510-665-5437

When: October 10, 2006, 02:30 PM America/Chicago

Meeting ID: 22333

Agenda

  • Review Action items from 10/10
  • Jack proposal
  • CVS access

Notes

Attending: David, Ed, Jerry, Jack, Dan, Marco, Robert

Discussion

In this section I tried to report the discussion. Feel free to correct or add to this.The most important is the action section.

Ed would like to have all the information about the cluster and servers configuration. All the hostnames, ports, etc... Specially considering that the current system is not production level. Marco: some of the details are not important for the users. In the current model users make ticket requests (RT) to the Tier2 administrators, so this information is not useful.

Jack: local files at Chicago are ESD. It is a long process to get AOD and TAG from there. So he asked to transfer some other datasets. These have been transferred and are in the UC_VOB

Dan: showed how to check the information (including the location) of recently transferred files

Jack tested the option files to produce TAGs with release 11.0.42

Robert's vertical test: take a dataset, plot the distribution. Produce the TAGs, do a cut selecting some events, do a plot and verify that the skim actually corresponds to what was the initial intention. To start with this could be done all on one file.

Jerry: Given a lfn of a file that I know that is on UC_VOB how do I get it on tier2-06?

There are different ways to access files that are residents in dCache. For access to the lo

How do I check the content of the LRC? Panda DDM browser: http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?overview=dslist ARDA monitoring: http://atlas-ddm-monitoring.web.cern.ch/atlas-ddm-monitoring/ or http://lxarda08.cern.ch/dashboard/request.py/sites Direct: curl http://tier2-01.uchicago.edu:8000/dq2/lrc/PoolFileCatalog\?lfns=...

Try to access directly the DB using Athena. In the long run the direct access would be very useful (e.g. bck-navigation from AOD) If the DB follows pool in terface and the Athena sw includes (pool and coral) client tools.

Provide on the twiky the informtion to access the DQ2 DB and try direct pool access to the files.

CVS access: tier2-06 (as worker nodes or many laptops) is not kerberized. It is preferrable to use ssh access. If you require kerberized access you can use tier2-u1.

Jack was able to have ssh access to CVS and will document it.

Jack's schema summarizes the elements that we needs for the data service. For the selection from TAGs we could use th tools developed by the Glasgow group.

Query mysql with pool command line works at the moment and allows to get a collection in a file. You can select in SQL and get a root file with the information you want, if you know the right query. Query estimtion tools: before you start a query you may need some information to build your cut tree. Pre built istograms and informations. Querying on all the ATLAS events may not be feasible.

Actions

  • Document how to access the files (Marco)
  • Document how to access DQ2 backend (Marco)
  • Produce the tags for the rel12 files testIdeal_... (Jack and Jerry)
  • Provide a tool to register local files into a SE (DQ2) (Marco)
  • Go to steps 1-2-3 of Jack's diagram

Followup

Access files in UC_VOB SE

UC_VOB uses dCache as backend. All its files are stored in /pnfs/uchicago.edu/data/usatlas/.... Note that this is a dCache (dcap) fs. dccp allows to copy files back and forth from it, ls to view the content, but not all posix access is possible. IMPORANT: this space is the backend of the DQ2 server, so users should not write or delete file directly from there.

UC_VOB DQ2 mysql backend

The host is tier2-05.uchicago.edu, the std port 3306, user dq2user, contact Marco to get the password if you don't know it.

-- MarcoMambelli - 10 Oct 2006
Topic revision: r2 - 10 Oct 2006, MarcoMambelli
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback