FY07-Q3 Effort Report of Marco Mambelli

This report summarizes efforts of Marco Mambelli for the period of actvity from April-June, 2007.

Distributed Data Services and DSS

Work continues in the Tier2 Data Services activity, see further: http://twiki.mwt2.org/bin/view/DataServices/WebHome. This activity involves a joint group from the Midwest Tier2 Center and Argonne National Lab (Jack Cranshaw, David Malon, Jerry Gieraltowski, Rob Gardner).

The goal of the activity is to design, prototype and package services that:

• Host or provide access to ATLAS specific database services, such as TAG and possibly conditions (IOV and calibration) databases.
• Provide a dataset skimming service (DSS) for Tier2-resident datasets through either command line or web interfaces.
• Provide users the ability to access the Tier2's DQ2 server.

Work towards these goals included: group coordination (chairing meetings, taking minutes); planning, scope definition and initial organization; prototype data services machine initial deployment; testing.

DSS Milestones: (baseline, forecast/effective, status)

• Inclusion of the feedback received at the Munich software workshop. (30 Apr 07, 30 Apr 07, completed)
• Generation of local MySQL TAG DB (Format of ATLAS Release 12 and earlier) (15 Apr 07, 15 Apr 07, completed)
• Evaluation of different Web Frameworks and selection of Django as production platform for DSS (15 May 07, 30 May 07, completed)
• Deployment of version 0.3 of DSS as a prototype Web interface integrating all the component of DSS and providing a database backend to store poveneance information. (1 Jun 07, 30 Jun 07, completed)
• The prototype of the Web interface is available at: http://tier2-06.uchicago.edu:8800/dss/
• Further development and support of the Data Movement Utilities component (DMU) of DSS to move data reliably between local storage elements and worker nodes, including file registration in DQ2 site services. The DMU component is also in use by Panda.
• Planned DSS v0.4. providing interface with remote Oracle TAG DB (1 Aug 07, 15 Aug 07, delayed)
• Planned Functional Delivery of DSS 1.0 (30 Sep 07, 30 Sep 07, on schedule)

Panda Troubleshooting

Continued efforts in support of Panda production by troubleshooting pilot execution, submission, and scheduling problems. This work includes general troubleshooting for all US ATLAS sites in addition to MWT2.

The PilotChecker system was developed as tool for checking/verifying the execution environment for Panda pilots, see further: http://twiki.mwt2.org/bin/view/DataServices/PandaSubmitHost. This activity emerged as support of my troubleshooting activity for Panda production. Since many system administrators were asking to send pilots to their clusters and to troubleshoot pilot execution I decided to provide an easy Web interface to submit Panda pilots and verify their execution. To develop PilotChecker I leveraged the knowledge acquired by developing the DSS Web framework.

Panda Troublshooting Milestones:

• PilotChecker v 0.1, a usable prototype able to submit pilots to all OSG sites, was presented at the Tier2 and Tier3 meeting at IU Bloomington (June 20-22). (NP, 20 Jun 07, completed)

-- MarcoMambelli - 06 Aug 2007