Administrator Group * Member list: * Set GROUP = RobGardner FrederickLuehring MaryHeinz MaryHeintz LincolnBryant DaveLesny JudithStephen DavidJordan Feng...
AtticRWG 2007 * Need to fix http://mwt2.uchicago.edu/atlas analysis/atlas workbook (was this plone?) 10/19/06 * Doing ITB 0.5.1 install on Admins.OsgITBD...
http://security.ncsa.uiuc.edu/research/grid howtos/usefulopenssl.php openssl pkcs12 export in cert.pem inkey key.pem out cred.p12 Main.RobGardner 26 Nov 2...
CheckoutJobStats Introduction New cron job from Charles that runs once per hour and collects job info from the Panda monitor, then stores this in a local SQL dat...
root@tier2 osg ~ # tail 300 /var/log/condor/SchedLog 2/11 18:23:17 (pid:3194) match (#1201908699#70#...) out of jobs (cluster id 337577); relinquishing 2/11 18:...
Introduction * http://indico.fnal.gov/conferenceDisplay.py?confId=1901 * Face to face meeting * To represent US ATLAS * Introductions 12 people Paul...
DASPOSMeeting Meeting bootcamp Meeting location The meeting will be at the High Energy Physics building (see map http://maps.uchicago.edu/northwest/). Enter th...
DataManageRwg Only crap that works. Hostname left in some places for context. Setups rwg@uct2 grid7:~$ source /share/wlcg client/setup.sh rwg@uct2 grid7:...
* Login to uct2 grid1, setup grid environment, proxy. * Find a dataset which has files for deletion. dq2 client tools not exported to grid1. I go back to uct3...
DeployXrootdITB Introduction * Will follow instructions here: https://twiki.grid.iu.edu/bin/view/Tier3/XrootdInstall * Installing from current ITB 1.1.20 c...
DeployingOSG1d0 Internal MWT2 note: this PUBLIC VERSION of the Admins.DeployingOSG1dot0onUCT2P documented installation. Background These are installation notes f...
DigiCerts DOEGrids CA retirement is March 31, 2013 The DOEGrids CA will cease issuing certificates on March 31, 2013. After this date, it will not be possible to...
Contacts In case of cooling system failures, the following are notified * Jess Valle: 773 834 7559 * Rob Gardner: 312 804 0859 * Mary Heintz: 773 795 113...
Tarball preparation command was: if test ! d "/home/sm/logs/user.RobertWGardnerJr.uct3 edge4_50.lib._000002.log.tgz" ; then mkdir "/home/sm/logs/user.RobertWGar...
rwg@uct3 edge4:~$ globusrun a r tier2 02.uchicago.edu GRAM Authentication test failure: connecting to the job manager failed. Possible reasons: job terminated,...
root@tier2 osg ~ # ls l /home/usatlas1/gram_scratch_Arp7W3hQoC total 356 rw r r 1 usatlas1 usatlas 32631 Feb 11 09:22 DQ2ProdClient2.py rw r r 1 usatlas1 u...
My Links * .BeginnersStartHere view a short introductory presentation on TWiki for beginners * .WelcomeGuest starting points on TWiki * .UsersGuide ...
My Links * .BeginnersStartHere view a short introductory presentation on TWiki for beginners * .WelcomeGuest starting points on TWiki * .UsersGuide ...
My Links * .BeginnersStartHere view a short introductory presentation on TWiki for beginners * .WelcomeGuest starting points on TWiki * .UsersGuide ...
My Links * .BeginnersStartHere view a short introductory presentation on TWiki for beginners * .WelcomeGuest starting points on TWiki * .UsersGuide ...
* As for some files to use: AANT1 files from /pnfs/uct3/users/boveia/wjets/samples/group10.phys sm.mc09_7TeV.106020.PythiaWenu_1Lepton.merge.AOD.e468_s624_s633_r1...
KernelBuild Background * Thanks to Charles Waldman, MWT2 was able to determine the correct tunings for our own custom kernel and later a packaged one merged w...
Tier3 Cluster Flocking into ATLAS Connect Overview There are only two steps needed to allow your cluster to flock jobs into ATLAS Connect. Jobs are routed by th...
Gnuplot * Source here and discussion 1, discussion 2 for Mac OS X. * gnuplot 4.2.3.pdf: Gnuplot manual (pdf) Software added Attempt to keep track of addi...
NotesCarrRandomization Abstract Carr's randomization and new FFT techniques for fast and accurate pricing of barrier options Dmitri Boyarchenko University of ...
PandaClientExercise Install and setup Panda client * Following https://twiki.cern.ch/twiki/bin/view/Atlas/PandaAthena and links therein, and https://twiki....
PathenaStartup Background These are some personal notes taken while trying out the SUSY validation package, run via pathena. (Not meant for public consumption!)...
PathenaTry2 Background These are some personal notes taken while trying out the SUSY validation package, run via pathena. (Not meant for public consumption!) ...
PathenaTry3 Background Starting from where we left off with PathenaTry2. Initial * source /osg/app/atlas_app/atlas_rel/13.0.30/cmtsite/setup.sh tag=13.0.30....
* Vancouver tutorial to test pathena jobs on FDR2 AOD data with 14.0.1.3 using TopPhysTools and TopPhysDPDMaker packages: * https://twiki.cern.ch/twiki/bin/...
RemoteClusterConnect Links * How to submit a job using a Remote Cluster Connect Factory * How to setup flocking to a Remote Cluster Connect Factory Server ...
FY07 Q2 Effort Report of Marco Mambelli This effort report covers the period of activity of Marco Mambelli from January March, 2007. Tier2 Data Services, see furt...
FY07 Q3 Effort Report of Marco Mambelli This report summarizes efforts of Marco Mambelli for the period of actvity from April June, 2007. Distributed Data Servi...
FY07 Q4 Effort Report of Marco Mambelli This effort report covers the period of activity of Marco Mambelli from July September, 2007. Distributed Data Services a...
FY08 Q1 Effort Report of Marco Mambelli WIP This effort report covers the period of activity of Marco Mambelli from October December, 2007. Distributed Data Serv...
FY08 Q2 Effort Report of Marco Mambelli This effort report covers the period of activity of Marco Mambelli from January March, 2008. Distributed Data Services an...
FY08 Q3 Effort Report of Marco Mambelli This effort report covers the period of activity of Marco Mambelli from April June, 2008. Distributed Data Services and D...
FY08 Q4 Effort Report of Marco Mambelli This effort report covers the period of activity of Marco Mambelli from July September, 2008. Distributed Data Services a...
FY09 Q1 Effort Report of Marco Mambelli This effort report covers the period of activity of Marco Mambelli from October December, 2008. Distributed Data Services...
FY09 Q2 Effort Report of Marco Mambelli This effort report covers the period of activity of Marco Mambelli from January March, 2009. Distributed Data Services an...
Will need to move over to release 13.0.40. * http://gridui07.usatlas.bnl.gov:25880/server/pandamon/query/?mode=taskquery qTaskTRFVersion=13.0.40.4 qTaskName=54...
RobGardnerJan2008 Overview This report covers the efforts into OSG Integration and Sites Coordination, at the level of 0.5 FTE, and US ATLAS Integration Program ...
My Links * .BeginnersStartHere view a short introductory presentation on TWiki for beginners * .WelcomeGuest starting points on TWiki * .UsersGuide ...
RootBasics Introduction As part of an exploration of the ATLAS software tutorials, this week we look at what's available for ROOT. ROOT references: * http://...
SiteReportMay19 lsm get failures * lsm put issues continue to dominate failure rates * Charles has been doing diagnostics based on logfile data * #mover...
SiteReportMay26 lsm get Kernel update ANALY_MWT2_X Storage * Added 180 TB (raw), 156 TB (useable) * Still ran out of DATADISK on Saturday night; adjus...
Submitting jobs into ATLAS Connect from a Tier3 Enable Flocking from a Local SCHEDD into a RCC Factory Before a user can flock jobs into an RCC Factory, the loca...
My Links * .BeginnersStartHere view a short introductory presentation on TWiki for beginners * .WelcomeGuest starting points on TWiki * .UsersGuide ...
TestingROOTIO Introduction These are some notes for running Main.IlijaVukotic's ROOTIO package for measuring local and WAN performance. You can vary the percent...
TroubleProtoCondor Introduction Condor incident on UC_ATLAS_MWT2 on 2/11/08. See also mail thread to MWT2 list. Initial observations and actions * Afternoon...
UChicagoBrookhavenNetworkTesting Summary * 18 March 2009 * Before switch to jumbo frames, performance to nettest10g.usatlas.bnl.gov 3.2 Gbps (8 streams) ...
VirtualMachines CERN VM * Setup in ATLAS, https://twiki.cern.ch/twiki/bin/viewauth/Atlas/CernVM * Example setting up: http://hep.phys.sfu.ca/wiki/doku.php?...
rwg ~ sudo /usr/local/bin/vpn_uninstall WARNING: Improper use of the sudo command could lead to data loss or the deletion of important system files. Please doub...
List of Foswiki users Below is a list of users with accounts. If you want to edit topics or see protected areas of the site then you can get added to the list by ...
1. install the release a) cd 12.0.7 b) pacman get http://www.usatlas.bnl.gov/BNL_ATLAS_Pacman:12.0.7slc3 gcc trust all caches allow tar overwrite 2. inst...
XrootdTier3 Introduction The ATLAS Tier 3 program has established a number of working groups. The ATLAS Tier 3 Xrootd working group was formed to evaluate Xroo...
CondorCycleSeeder The name chosen for the pool (CONDOR_HOST) is uct3 mgt.mwt2.org. This implies that by default the collector/negotiator will advertise that hostn...
GangliaCycleSeeder Puppet * Created gmond config file in puppet (/etc/puppet/modules/gmond/files/gmond.uc3.conf) * Created gmetad config file in puppet (/...
PuppetCycleSeeder Purpose and background * Capture all major configuration decisions for hosts in the cycle seeder cluster * And any operational notes Ma...
Transferring Datasets to UC dCache Purpose Transfer datasets for local analysis and for dataset skimming service (DDS) system development, part of the UC/ANL Tie...
Tier2 Data Skimming Service (DSS) Questions about the Data Skimming Service 1 Given a selection of events (obtained how? represented how?), skim the select...
DssPrototype Developers Jerry, Jack, Marco Description A simple end to end skimming service prototype. * Create a TAG database, given an AOD. * Process to...
Hi Marco, There is some information on using the POOL Collection utilities at http://lcgapp.cern.ch/project/persist/currentReleaseDoc/UserGuide/Collection_Referen...
Attending David, Sasha, Jack, Paul, Marco, Rob, Richard Hansen (welcome), Ed Twiki issues * Currently using http://pgl.uchicago.edu/twiki/bin/view/ATLAS/DataS...
Attending * Marco, Jack, Rob, Tom, David * Next meeting invite Dan. Pathena * Jack is exploring running pathena at brookahven; general checkout. * In...
NotesMay2 Web framework * Marco has been working on the django framework allows one to do web apps in python. Has a prototype running, but not many functio...
Notes from 5/31/06 Initial Questions * Question about space requirement for databases 1 TB of space. This will be for calibration and Tags. * If you hos...
Hi Marco, I wrote up, as far as I could remember, the steps I took to install the latest version of the site services at Glasgow. This is at http://ppewww.ph.gla....
SkimBrowser Developers Jerry Inputs web form with user selection, data from the SkimDatabase. The data exisiting in the SkimDatabase is created by the SkimPubl...
SkimComposer Developers Marco Inputs Fields from a web form. An existing webservice which might be utilized is SQLTuple JSP. Predefined skims Outputs SQL quer...
SkimDatabase Developers Marco Description Contains the state and histories of active and archived skims. Dependencies A functional MySQL database server. Mai...
SkimExtractor Developers Marco, Jerry Inputs * all global environment variables defined in the DSS configuraiton file (see skimSelector) * collection usab...
SkimNotification Developers Marco, Jerry Description Notify user or analysis group of skim status (complete, failed, milestone hit in progress). Dependencies ...
SkimPublisher Developers Marco Inputs Messages and updates will come from various components in the system. In particular: * From SkimSelector Messages ...
SkimRegistrar Developers Marco Inputs Skimmed dataset (name and files local PFNs) Outputs Registered DS: LRC registration and DS in DDM Data for the bookkee...
SkimSelector Developers Jerry, Marco Inputs 1. full path to a configuration file identifying all job variables needed in the workflow of both skimSelector an...
Tier2 Data Services Monthly statistics (calculate) Overview A number of Tier2 centric data services need to be operational in order to efficiently use the cl...
AdobeConnectAdminNotes Introduction * We will attempt to use Adobe Connect to support remote participation in the workshop * The URL for the meeting is: ht...
AggregatorBDII Introduction Setup a test instance of an aggregator service (for data collected from CEMon services running at sites) and BDII index server. Inst...
BogotaProxyServer Introduction * This page describes notes for preparing a local Squid service for use in the laboratory at Universidad de Javeriana site. ...
DjangoWebNotes Initial installation * Host: uct3 edge5.uchicago.edu 2009 04 14 I asked Marco to look into the problem of hosting multiple projects with dj...
DocBooksInfrastructure Introduction How to generate grid school tutorials using DocBooks. Recipe for fetching and modifying source * You must have rights to ...
DrupalInstall Installation * using itb3 and same mysql db as mw * Download into /opt * Copied settings file, create files directory (see instructions...
GraphToolNotes Installation * Installed on uct3 edge5.uchicago.edu * Followed http://t2.unl.edu/documentation/graphtool/yum based install Reference * h...
GridColombiaCache Introduction This will be a temporary Pacman cache to hold packages designed specifically for the prototype Grid Colombia grid. This cache wil...
GridColombiaWorkshopInfrastructure Introduction A page to gather notes on infrastructure to support the OSG Grid Colombia workshop being organized here. * Als...
InstallConfigDjango Overview This page describes the installation and configuration of the Django web framework. Installation (initial) * Installed following...
Getting started * What's available? root@itb3 ~ # yum info php Loading "kernel module" plugin Setting up repositories Reading repository metadata in from loca...
Build from source * Will have to install from source, or find an rpm. * From PHP website, root@itb3 opt # wget http://www.php.net/get/php 5.2.9.tar.gz/...
MatchMakingService Introduction Setup a match making service like the one used by the OSG Engage group. Installation * Instructions: http://osgmm.sourceforge...
MediaWikiInstallation Getting started * Machine: itb3 * http://www.mediawiki.org/wiki/Manual:Installation_guide * Requirements: PHP5 or later, a databas...
MediaWikiInstallationPrerequisites Summary * Preparations to use itb3.uchicago.edu for Media Wiki for OSG documentation testing. * MySQL 5.1.34 * Apache...
root@itb3 maintenance # php update.php aconf ../AdminSettings.php MediaWiki 1.16.0beta3 Updater Going to run database updates for wikidb mw_osg Depending on the ...
root@itb3 maintenance # php update.php aconf ../AdminSettings.php MediaWiki 1.16.0beta3 Updater Going to run database updates for wikidb mw_osg Depending on the ...
MinutesOSGUC110329 Glide in WMS (Marco) * This is the VO front end: contains four parts: user pool collector (a Condor collector); glide in VO front end pyt...
Drupal Site Stuck Offline? Here's How to Unlock It Quick instructions for removing offline status in the database Adapted from: Author: M Butcher Date: 2008 06 25...
ReSSinstallation Introduction To deploy a test instance of a ReSS collector (version v1.3) for use in Condor match making. Installation * Starting from here,...
SettingUpWorkshopProxies Generating training certificates First request a certificate: * Requesting certificates using the "Cert Scripts" package in OSG clien...
SurveyorDevelopment Overview * Code: part of the jobmonitor project in SVN. References * See Main.RobertVeitch 's effort reports Main.RobGardner 15 Ap...
VMwareInfrastructure Introduction A page to gather notes on virtualization infrastructure relevant for OSG related activities (ITB, workshops, Tier 3 support, et...
VOMSInstallation Introduction Instructions for setting up a VOMS server for a hypothetical VO. References * http://vdt.cs.wisc.edu/VOMS documentation.html ...
OSG Integration at UChicago Introduction This twiki web is focused on Integration activities at U Chicago. See also OSG @ UC for other OSG activities at UC. Da...
ITB Web Preferences The following settings are web preferences of the ITB web. These preferences overwrite the site level preferences in . and , and can b...
Splunk 2.2.3 April 2007 Splunk is the search engine for IT data. Splunk can index any data for which it has read access. If you don't give it sufficient privile...
Splunk 3.0 Beta May 2007 Splunk is the search engine for IT data. Splunk can index any data for which it has read access. If you don't give it sufficient privil...
Syslog ng Install Overview The following describes a system of two syslog ng servers: one providing a source of logging data, the second providing a central logg...
SBIR Meeting, Jan 18, 2007 Attending * Paul, Rob, Suchandra Discussion * Discussion of validation process * See Apache ODE, download and build via Mave...
Notes from Nov 17 Telecon * 2x2 core machines (8Gb RAM) to virtualize * Need a more organized testbed for services. Where to start? Need a framework for ...
SBIR Statement of Work Initial project development * Definition of key test/validation processes, stack ranked. RG 2/14/07: see front page for defined use...
SRM is a protocol that specifies an interface to storage resources. Here we will use an implementation provided by the http://www.dcache.org/ project. Suchandra...