MeetingNotes070516

Attending

• Jack, Jerry, Marco

Agenda

• Present the Web interface (Marco)
• Present the updated scripts (Jerry)
• ...

Discussion

Development meeting.

Framework

An entry URL for the Web frame is: http://tier2-06.uchicago.edu:8800/dss/skim

Currently the Web framework allows to see information about the skims, to submit skims on the local machine, to see DB informations.

Some feedback : would be nice to choose the database, then add a condition(one of the possible valid ones), then add operators, then other conditions as desired. All in order not run the job and then find out that the value is not an attribute of the collection (not in the header of the DB - for now, later the structure will change).

This could be achievable using:

• validation of query (attribute name and operators) in the form
• short prerun execution
• guiding editor

New mysql collections will be relational, have a separate table for the attribute names. So the framework cannot count on column names being attr. names.

Scripts

Package (tar) available in Jerry's directory. Mainly in shell (some of my code still python) main execution script is dsspilot. dssmaster is just a dummy to trick Condor and allow easy updates. Condor several times uses old version of the executable (it is caching/saving it somewhere and there is no way to send the new one). Using a dummy that never changes solves the problem. The real executable is sent and transferred to the run directory.

How the pilot scripts work:

• transfer the input files through condor (joboptions, )
• create PFC.xml (on the submit host, using curl and the web interface of the LRC), split it, send the pieces with the job
• 1 Athena call, just AOD through Athena, no TAGs from that DS procuced
• 1 extra Athena job to count events (to check the results)
• job option is as generic as possible, a skeleton calling ReconX. It works for all 12.0.X releases (OK 12.0.5, 12.0.6)
• should I add aodtotag from release? try as much as possible to include from the release and set only our additional parameters to reduce release dependency
• transfer output file through condor (this probably should be fixed, it could be a big load)

- MarcoMambelli - 16 May 2007