MatchMakingService

Introduction

Setup a match making service like the one used by the OSG Engage group.

Installation

[osgmm@gs-matchmaker]~% tar xvzf /home/sthapa/osgmm-0.8_pre20091006.tar.gz 
osgmm-0.8_pre20091006/
osgmm-0.8_pre20091006/sbin/
osgmm-0.8_pre20091006/sbin/osgmm
osgmm-0.8_pre20091006/etc/
osgmm-0.8_pre20091006/etc/attribute-override-all-ads
osgmm-0.8_pre20091006/etc/additional-ads/
osgmm-0.8_pre20091006/etc/attribute-overrides/
osgmm-0.8_pre20091006/etc/osgmm.conf
osgmm-0.8_pre20091006/bin/
osgmm-0.8_pre20091006/bin/condor_grid_submit
osgmm-0.8_pre20091006/bin/condor_status_ress
osgmm-0.8_pre20091006/bin/condor_grid_overview
osgmm-0.8_pre20091006/libexec/
osgmm-0.8_pre20091006/libexec/maintenance-script.fork
osgmm-0.8_pre20091006/libexec/verification-script.jm
osgmm-0.8_pre20091006/libexec/remote-wrapper.py
osgmm-0.8_pre20091006/libexec/verification-script.local
osgmm-0.8_pre20091006/libexec/verification-script.fork
osgmm-0.8_pre20091006/libexec/maintenance-script.jm
osgmm-0.8_pre20091006/lib/
osgmm-0.8_pre20091006/lib/commons-cli-1.2.jar
osgmm-0.8_pre20091006/lib/cog-jglobus-1.4.jar
osgmm-0.8_pre20091006/lib/osgmm-0.8.jar
osgmm-0.8_pre20091006/lib/log4j-1.2.13.jar
osgmm-0.8_pre20091006/lib/cryptix-asn1-3.2.0.jar
osgmm-0.8_pre20091006/lib/cryptix32-3.2.0.jar
osgmm-0.8_pre20091006/lib/jce-jdk13-1.3.1.jar
osgmm-0.8_pre20091006/lib/jrobin-1.5.9.jar
osgmm-0.8_pre20091006/lib/puretls-0.9-beta-4.jar
osgmm-0.8_pre20091006/lib/commons-io-1.2.jar
osgmm-0.8_pre20091006/docs/
osgmm-0.8_pre20091006/docs/index.html
osgmm-0.8_pre20091006/docs/ar01s02.html
osgmm-0.8_pre20091006/docs/sflogo.png
osgmm-0.8_pre20091006/docs/osgmm-style.xsl
osgmm-0.8_pre20091006/docs/ar01s03.html
osgmm-0.8_pre20091006/docs/style.css
[osgmm@gs-matchmaker]~% ln -s osgmm-0.8_pre20091006 osgmm
  • Installed client in ~/client-1.2
[osgmm@gs-matchmaker ~]$ cd client-1.2/
[osgmm@gs-matchmaker client-1.2]$ source /opt/pacman-3.29/setup.sh 
[osgmm@gs-matchmaker client-1.2]$ pacman -get http://software.grid.iu.edu/osg-1.2/:client
Do you want to add [http://software.grid.iu.edu/osg-1.2/] to [trusted.caches]? (y/n/yall): yall
Beginning VDT prerequisite checking script vdt-common/vdt-prereq-check...       

All prerequisite checks are satisfied.
                                                          


========== IMPORTANT ==========
Most of the software installed by the VDT *will not work* until you install
certificates.  To complete your CA certificate installation, see the notes
in the post-install/README file.



                                                                              
The VDT version 2.0.0 has been installed.

                                         
The OSG Client package OSG version 1.2.3 has been installed.
  • Added the following to ~/client-1.2/condor/condor/local.gs-matchmaker/condor_config.local
# Add the OSG Match Maker to the daemons managed by Condor.
DAEMON_LIST = $(DAEMON_LIST), OSGMM
OSGMM = /home/osgmm/osgmm/sbin/osgmm-wrapper

# To run the OSGMM as a different user account, uncomment this line and modify
# it to replace osgmm with the user in question.  The account must have a
# usable home directory.
OSGMM_USERID = osgmm

# If you are running a more complex security configuration with the OSGMM
# running as a different user, the following settings should allow the OSG Match
# Maker the access it requires.
ALLOW_WRITE = $(ALLOW_WRITE),$(OSGMM_USERID)@*/$(FULL_HOSTNAME)
SEC_DAEMON_AUTHENTICATION_METHODS = FS, $(SEC_DAEMON_AUTHENTICATION_METHODS)


NEGOTIATOR_INTERVAL=25
SCHEDD_INTERVAL = 60
GRIDMANAGER_MAX_SUBMITTED_JOBS_PER_RESOURCE=400
GRIDMANAGER_MAX_PENDING_SUBMITS_PER_RESOURCE=3
  • Created the following file in ~/osgmm/sbin/osgmm-wrapper
#!/bin/bash
# A simple wrapper for /opt/vdt/osg-match-maker/sbin/osgmm, to ensure that
# the VDT environment variables are present.
. "/home/osgmm/client-1.2/setup.sh"
exec "/home/osgmm/osgmm/sbin/osgmm" "$@"
  • Ran chmod 755 ~/osgmm/sbin/osgmm-wrapper
  • Edited ~/osgmm/etc/osgmm.conf and changed the vo_name setting to osgedu
  • Added . ~/client-1,2/setup.sh to ~/.bashrc and logged out and back in
  • Started condor using condor_master
  • Things seem to work:
[osgmm@gs-matchmaker bin]$ ./condor_grid_overview 

ID         DAG              Owner        Resource              Status      Command       TimeInState
========== ================ ============ ===================== =========== ============= ===========

Site                      Total  Subm Stage  Pend  Run  Other  Rank Succes
========================= ===== ===== ===== ===== ===== ===== ===== ======
AGLT2                         0     0     0     0     0     0   700   100%
BNL-ATLAS                     0     0     0     0     0     0   700   100%
BNL-ATLAS                     0     0     0     0     0     0   700   100%
CIT_CMS_T2                    0     0     0     0     0     0   700   100%
CIT_CMS_T2                    0     0     0     0     0     0   700   100%
Clemson-ciTeam                0     0     0     0     0     0   700   100%
Duke                          0     0     0     0     0     0   700   100%
Firefly                       0     0     0     0     0     0   700   100%
Firefly                       0     0     0     0     0     0   700   100%
LIGO_UWM_NEMO                 0     0     0     0     0     0   700   100%
NYSGRID-CCR-U2                0     0     0     0     0     0   700   100%
NYSGRID_CORNELL_NYS1          0     0     0     0     0     0   700   100%
Nebraska                      0     0     0     0     0     0   700   100%
RENCI-Engagement              0     0     0     0     0     0   700   100%
SBGrid-Harvard-East           0     0     0     0     0     0   700   100%
SPRACE                        0     0     0     0     0     0   700   100%

0 jobs; 0 matching, 0 pending remotely, 0 running, 0 held, 0 other

Refrences


-- RobGardner - 06 Oct 2009
Topic revision: r3 - 19 Feb 2010, SuchandraThapa
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback