Meeting October 10
Meeting
Tuesday 10/10 at 2.30pm Chicago time
Phone conference ESNet Call: 510-665-5437
When: October 10, 2006, 02:30 PM America/Chicago
Meeting ID: 22333
Agenda
- Review Action items from 10/10
- Jack proposal
- CVS access
Notes
Attending: David, Ed, Jerry, Jack, Dan, Marco, Robert
Discussion
In this section I tried to report the discussion. Feel free to correct or add to this.The most important is the action section.
Ed would like to have all the information about the cluster and servers configuration. All the hostnames, ports, etc... Specially considering that the current system is not production level.
Marco: some of the details are not important for the users.
In the current model users make ticket requests (RT) to the Tier2 administrators, so this information is not useful.
Jack: local files at Chicago are ESD. It is a long process to get AOD and TAG from there. So he asked to transfer some other datasets. These have been transferred and are in the UC_VOB
Dan: showed how to check the information (including the location) of recently transferred files
Jack tested the option files to produce TAGs with release 11.0.42
Robert's vertical test: take a dataset, plot the distribution. Produce the TAGs, do a cut selecting some events, do a plot and verify that the skim actually corresponds to what was the initial intention. To start with this could be done all on one file.
Jerry: Given a lfn of a file that I know that is on UC_VOB how do I get it on tier2-06?
There are different ways to access files that are residents in dCache.
For access to the lo
How do I check the content of the LRC?
Panda DDM browser:
http://gridui02.usatlas.bnl.gov:25880/server/pandamon/query?overview=dslist
ARDA monitoring:
http://atlas-ddm-monitoring.web.cern.ch/atlas-ddm-monitoring/ or
http://lxarda08.cern.ch/dashboard/request.py/sites
Direct: curl http://tier2-01.uchicago.edu:8000/dq2/lrc/PoolFileCatalog\?lfns=...
Try to access directly the DB using Athena.
In the long run the direct access would be very useful (e.g. bck-navigation from AOD)
If the DB follows pool in terface and the Athena sw includes (pool and coral) client tools.
Provide on the twiky the informtion to access the DQ2 DB and try direct pool access to the files.
CVS access: tier2-06 (as worker nodes or many laptops) is not kerberized. It is preferrable to use ssh access. If you require kerberized access you can use tier2-u1.
Jack was able to have ssh access to CVS and will document it.
Jack's schema summarizes the elements that we needs for the data service.
For the selection from TAGs we could use th tools developed by the Glasgow group.
Query mysql with pool command line works at the moment and allows to get a collection in a file.
You can select in SQL and get a root file with the information you want, if you know the right query.
Query estimtion tools: before you start a query you may need some information to build your cut tree. Pre built istograms and informations. Querying on all the ATLAS events may not be feasible.
Actions
- Document how to access the files (Marco)
- Document how to access DQ2 backend (Marco)
- Produce the tags for the rel12 files testIdeal_... (Jack and Jerry)
- Provide a tool to register local files into a SE (DQ2) (Marco)
- Go to steps 1-2-3 of Jack's diagram
Followup
Access files in UC_VOB SE
UC_VOB uses dCache as backend. All its files are stored in
/pnfs/uchicago.edu/data/usatlas/...
.
Note that this is a dCache (dcap) fs.
dccp
allows to copy files back and forth from it,
ls
to view the content, but not all posix access is possible. IMPORANT: this space is the backend of the DQ2 server, so users should not write or delete file directly from there.
UC_VOB DQ2 mysql backend
The host is
tier2-05.uchicago.edu
, the std port 3306, user
dq2user
, contact Marco to get the password if you don't know it.
--
MarcoMambelli - 10 Oct 2006