AggregatorBDII

Introduction

Setup a test instance of an aggregator service (for data collected from CEMon services running at sites) and BDII index server.

Installation

• The CEmon-BDII server install script (modified to remove OSG GOC-specific items and to use files in the tarball instead of a direct svn check out), and related files are here: http://dev.grid.iu.edu/~agopu/cemon_bdii_setup.tgz.

• files from tarball untarred at /opt/bdii/
• yum install httpd openldap-servers openldap-clients perl-libwww-perl perl-XML-Writer perl-XML-Simple perl-XML-Parser expect
• Create directory for software

[root@gs-bdii local]# mkdir /usr/local/cemon_bdii_aggregator

• Prep directory

[root@gs-bdii local]# chmod g+s -R cemon_bdii_aggregator/

• Copy rpms from tarball over

[root@gs-bdii local]# cd cemon_bdii_aggregator/
[root@gs-bdii cemon_bdii_aggregator]# cp -r /opt/bdii/cemon_bdii_aggregator/files/svn_files/* .

• Create directories:

[root@gs-bdii cemon_bdii_aggregator]# mkdir -p var/log
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/cemon_raw_incoming
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/cemon_transitory
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/cemon_processed_wlcg_interop_unfiltered
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/cemon_processed_wlcg_interop 
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/misc
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_osg/ldif 
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_osg/plugin
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_osg/var/bdii/db/stats
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_osg/var/lock/subsys
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_osg/var/run/
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_osg/var/archive
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_wlcg_interop/ldif
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_wlcg_interop/provider
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_wlcg_interop/plugin
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_wlcg_interop/var/bdii/db/stats
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_wlcg_interop/var/lock/subsys
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_wlcg_interop/var/run/
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_wlcg_interop/var/archive
[root@gs-bdii cemon_bdii_aggregator]# mkdir -p data/bdii_osg/provider
[root@gs-bdii cemon_bdii_aggregator]# mkdir data/cemon_processed_osg

• Install bdii rpms

[root@gs-bdii downloads]# rpm -Uvh glue-schema-1.3.0-4.noarch.rpm  bdii-4.0.2-2.noarch.rpm 
Preparing...                ########################################### [100%]
   1:bdii                   ########################################### [ 50%]
   2:glue-schema            ########################################### [100%]

• Create symlinks for bdii

[root@gs-bdii cemon_bdii_aggregator]# ln -sf /usr/local/cemon_bdii_aggregator/etc/DB_CONFIG /opt/bdii/etc/DB_CONFIG
[root@gs-bdii cemon_bdii_aggregator]# ln -sf /usr/local/etc/default.ldif /opt/bdii/etc/default.ldif

• Fix permissions on init.d script

[root@gs-bdii cemon_bdii_aggregator]# chmod u+x /etc/init.d/bdii

* Install other cemon rpms

[root@gs-bdii downloads]# rpm -ivh gpt-3.2autotools2004_NMI_9.0_x86_rhap_5-1.i386.rpm
Preparing...                ########################################### [100%]
   1:gpt                    ########################################### [100%]
Using system tar and gzip programs to unpack packages
GNU tar located at /bin/tar
GNU zip located at /bin/gzip
GNU unzip located at /bin/gunzip
GNU make located at /usr/bin/make
Perl located at /usr/bin/perl
rpm located at /bin/rpm
rpmbuild located at /usr/bin/rpmbuild
RPM Package License set to GNU
RPM Package Vendor set to NCSA
RPM Package FTP Site set to ftp.ncsa.uiuc.edu
RPM Package URL set to http://www.gridpackaging.org
RPM Packager set to NCSA
RPM Prefix set to /usr/grid
GNU target platform set to i686-pc-linux-gnu
[root@gs-bdii downloads]# rpm -ivh vdt_globus_essentials-VDT1.10.1x86_rhap_5-1.i386.rpm
Preparing...                ########################################### [100%]
   1:vdt_globus_essentials  ########################################### [100%]
[root@gs-bdii downloads]# rpm -ivh c-ares-1.3.0-2.fc3.i386.rpm
warning: c-ares-1.3.0-2.fc3.i386.rpm: Header V3 DSA signature: NOKEY, key ID 1ac70ce6
Preparing...                ########################################### [100%]
   1:c-ares                 ########################################### [100%]

• Install older version of boost (needed for compatibility reasons)

[root@gs-bdii downloads]# rpm -ev boost-devel-1.33.1-10.el5.i386
[root@gs-bdii downloads]# rpm -ev boost-1.33.1-10.el5 
[root@gs-bdii downloads]# rpm -ivh boost-1.32.0-5.fc3.i386.rpm
warning: boost-1.32.0-5.fc3.i386.rpm: Header V3 DSA signature: NOKEY, key ID 4f2a6fd2
Preparing...                ########################################### [100%]
   1:boost                  ########################################### [100%]

• Install glite rpms

[root@gs-bdii downloads]# rpm -ivh glite-security-gsoap-plugin-1.5.4-2.slc4.i386.rpm
Preparing...                ########################################### [100%]
   1:glite-security-gsoap-pl########################################### [100%]
[root@gs-bdii downloads]# rpm -ivh glite-ce-monitor-client-api-c-1.9.3-0.slc4.i386.rpm
Preparing...                ########################################### [100%]
   1:glite-ce-monitor-client########################################### [100%]

• Create symlinks in installed directories

[root@gs-bdii downloads]# ln -sf /usr/local/cemon_bdii_aggregator/data /usr/local/cemon_bdii_aggregator/var/www/html/data

• Create symlinks for init.d scripts

[root@gs-bdii downloads]# ln -sf /usr/local/cemon_bdii_aggregator/sbin/cemon.init /etc/init.d/cemon-consumer
[root@gs-bdii downloads]# ln -sf /usr/local/cemon_bdii_aggregator/sbin/bdii-osg.init /etc/init.d/bdii-osg
[root@gs-bdii downloads]# ln -sf /usr/local/cemon_bdii_aggregator/sbin/bdii-wlcg-interop.init /etc/init.d/bdii-wlcg-interop

* Symlink httpd.conf and logrotation configuration files

[root@gs-bdii downloads]# ln -sf /usr/local/cemon_bdii_aggregator/etc/httpd.conf /etc/httpd/conf/httpd.conf
[root@gs-bdii downloads]# ln -sf /usr/local/cemon_bdii_aggregator/etc/cemon-bdii-aggregator.logrotate /etc/logrotate.d/cemon-bdii-aggregator

* Remove bdii configuration

[root@gs-bdii downloads]# rm -f /opt/bdii/etc/bdii.conf /opt/bdii/etc/bdii-update.conf /opt/bdii/etc/bdii-slapd.conf

* Symlink log directories

[root@gs-bdii downloads]# ln -sf /usr/local/cemon_bdii_aggregator/data/bdii_osg /usr/local/cemon_bdii_aggregator/var/log/
[root@gs-bdii downloads]# ln -sf /usr/local/cemon_bdii_aggregator/data/bdii_wlcg_interop /usr/local/cemon_bdii_aggregator/var/log/

* Change group permissions on app directory

[root@gs-bdii downloads]# chmod -R g+rwX /usr/local/cemon_bdii_aggregator/

* Fix up selinux capabilities

[root@gs-bdii downloads]# semanage fcontext -a -t bin_t /usr/local/cemon_bdii_aggregator'/var/www/cgi-bin/status.cgi'
[root@gs-bdii downloads]# chcon -t httpd_sys_content_t '/bin/ls'

* Set services to run at boot

[root@gs-bdii downloads]# chkconfig --level 345 httpd on
[root@gs-bdii downloads]# chkconfig --level 345 bdii-osg on
[root@gs-bdii downloads]# chkconfig --level 345 bdii-wlcg-interop on
[root@gs-bdii downloads]# chkconfig --level 345 cemon-consumer on

* Setup crontab entries

[root@gs-bdii downloads]# install -bp -o root -g root -m 0644 /usr/local/cemon_bdii_aggregator/etc/cemon_bdii_server.crontab /etc/cron.d/cemon_bdii_server

* Run initialization scripts

[root@gs-bdii downloads]# /usr/bin/perl /usr/local/cemon_bdii_aggregator/bin/cache-myosg-xml --myosg-resource-summary --verbose 1>>/usr/local/cemon_bdii_aggregator/var/log/cache-myosg-xml.out 2>>/usr/local/cemon_bdii_aggregator/var/log/cache-myosg-xml.err
[root@gs-bdii downloads]# /usr/bin/perl /usr/local/cemon_bdii_aggregator/bin/cache-myosg-xml --myosg-cpuinfo-summary --verbose 1>>/usr/local/cemon_bdii_aggregator/var/log/cache-myosg-xml.out 2>>/usr/local/cemon_bdii_aggregator/var/log/cache-myosg-xml.err

* Start up services

[root@gs-bdii downloads]# /etc/init.d/httpd restartStopping httpd:                                            [FAILED]
Starting httpd:                                            [  OK  ]
[root@gs-bdii downloads]# /etc/init.d/cemon-consumer restart
Stopping OSG CEMon Consumer .. no PID file /usr/local/cemon_bdii_aggregator/var/cemon-consumer.pid
Starting OSG CEMon ConsumerLock file /usr/local/cemon_bdii_aggregator/var/cemon-consumer.pid exists but PID 26021 died
CEMon Consumer startup appears to have errored out ... 
                                                           [FAILED]
[root@gs-bdii downloads]# /etc/init.d/bdii-osg stop; /etc/init.d/bdii-wlcg-interop stop
Stopping BDII                                              [FAILED]
Stopping BDII                                              [FAILED]
[root@gs-bdii downloads]# /etc/init.d/bdii-osg start; /etc/init.d/bdii-wlcg-interop start
Starting BDII                                              [  OK  ]
Starting BDII                                              [  OK  ]

* Cemon Consumer issues due to misconfiguration, need to edit /usr/local/cemon_bdii_aggregator/etc/cemon-consumer.conf to have following values

## This is a home grown conf file for the CEMon consumer's init script

CEMON_CONSUMER_DIR=/opt/glite/

CEMON_CONSUMER_VAR_DIR=/usr/local/cemon_bdii_aggregator/var
CEMON_CONSUMER_OUTPUT_DIR=/usr/local/cemon_bdii_aggregator/data/cemon_raw_incoming

CEMON_CONSUMER_LISTEN_PORT=14001

GLOBUS_LIB_DIR=/opt/globus/lib

#CEMON_CONSUMER_USER=root

• Cemon-Consumer service started correctly after changes

References

• http://is.grid.iu.edu/documentation.html
• http://is.grid.iu.edu/

-- RobGardner - 06 Oct 2009