Machines being modified

The ITB systems are being modified to update their OS to the latest version and to being the ITB machines under configuration management. The following systems are being worked on:

• uct3-edge5
• uct3-edge6
• uct3-edge7
• itb1.uchicago.edu
• itb2.uchicago.edu
• itb3.uchicago.edu
• itb4.uchicago.edu
• itb-gums.uchicago.edu
• itb-dcache1.uchicago.edu
• itb-dcache2.uchicago.edu

Plan

The ITB machines in the Tier3 cluster will just have their operating systems updated. The other itb machines will be brought under configuration management using cobbler and puppet in order to manage the basic system services (ntp, dns, filesystem mounts, users, etc.).

Cobbler Setup

The ITB machines that need to be reloaded will need to be added to cobbler. The basic information needed is the MAC address of the internal NIC, and the system name. Cobbler will use this to control the PXE boot and reload of this system, and assign the name to the system once it comes back up. Once the system is up, puppet will take over.

Puppet Setup

Each ITB machine will need an entry in nodes.itb.pp, a new file in /etc/puppet/manifests on uct2-mgt. Each machine will be assigned a template, which is defined in templates.pp in the same directory. We'll start with a single simple template that defines the users, basic services (ntp, ssh) and any other shared configuration. We'll define the individual itb rules/configuration for ITB within a new module called itb.

Actions Taken

uct3-edge5

uct3-edge6

uct3-edge7

itb1.uchicago.edu

itb2.uchicago.edu

itb3.uchicago.edu

itb4.uchicago.edu

• VMWare changed mac addresses
  • nic 0
    • Flexible
    • Mac set to 00:50:56:00:01:02
  • nic 1
    • VMXNET3
    • Mac set to 00:50:56:00:02:02
• Rebooted to
• Installed cobbler on system (using tier3 image)
  • Needed to use new disk image since kickstart wouldn't work with old image
  • Changed nic on 101 vlan network to e1000 so that image could use nic
  • Needed to set scsi type to lsi sas
  • Needed to boot using boot using standard kernel to mount and use vmware tools
    • grub.conf needed to be changed to point to correct kernel files (references a later kernel file)
• Installed vmware tools so that nic pointing to external network can be recognized
• Changed eth1 setup to use correct settings (ip address, static, broadcast, gateway)
• Puppet installed and setup
  • puppet already in image, just did a puppet restart
  • needed to delete /home so that puppet could recreate it as a symlink

itb-gums.uchicago.edu

• Procedure identical to itb-dcache2 install procedure with following exceptions:
  • nic 1
    • Flexible
    • Mac set to 00:50:56:00:01:03
  • nic 2
    • VMXNET3
    • Mac set to 00:50:56:00:02:03
  • Changed vm to use new 25GB disk image
  • Changed network configuration for eth1 (/etc/sysconfig/network-scripts/ifcfg-eth1)
    • BOOTPROTO=static
    • HWADDR=00:50:56:00:02:03
    • IPADDR=128.135.158.213
    • NETMASK=255.255.255.128
    • GATEWAY=128.135.158.129
    • DEVICE=eth1
• Restored grid certs
• Reinstalled pacman and gums
• Used backup config from gums to restore current configuration

itb-dcache1.uchicago.edu

• Procedure identical to itb-dcache2 install procedure with following exceptions:
  • nic 1
    • Flexible
    • Mac set to 00:50:56:00:01:04
  • nic 2
    • VMXNET3
    • Mac set to 00:50:56:00:02:04
  • Changed vm to use new 25GB disk image
  • Changed network configuration for eth1 (/etc/sysconfig/network-scripts/ifcfg-eth1)
    • BOOTPROTO=static
    • HWADDR=00:50:56:00:02:03
    • IPADDR=128.135.158.182
    • NETMASK=255.255.255.128
    • GATEWAY=128.135.158.129
    • DEVICE=eth1
• Restored grid certs
• Reinstalled dcache

itb-dcache2.uchicago.edu

• VMWare changed mac addresses
  • nic 1
    • Flexible
    • Mac set to 00:50:56:00:01:05
  • nic 2
    • VMXNET3
    • Mac set to 00:50:56:00:02:05
  • changed scsi type to lsi sas
  • Changed vm to use new 50GB disk image
  • Changed vmware settings to set the os type to RHEL 5 x86_64
  • Booted into bios and moved netboot from nic1 to first in boot sequence
• Set netboot option in cobbler and rebooted
• Logged in as root and changed grub conf to point to 128-1 kernel
• Rebooted and selected 128-1 kernel for booting
• Installed vmware tools
  • Select select guest->install from vm right click menu
  • run 'mount -t iso9660 /dev/cdrom cdrom' in /mnt
  • copy VMware tools tarball to /tmp
  • untar and run ./vmware-install.pl
    • install into /opt/vmware/{bin,docs,sbin}
• Changed network configuration for eth1 (/etc/sysconfig/network-scripts/ifcfg-eth1)
  • BOOTPROTO=static
  • HWADDR=00:50:56:00:02:05
  • IPADDR=128.135.158.183
  • NETMASK=255.255.255.128
  • GATEWAY=128.135.158.129
  • DEVICE=eth1
• ran service network restart
• ran yum update
• ran puppetd to update configuration
  • needed to change exports on uct2-grid2 and uct2-grid7 to allow osg and osgvo directories to be mounted
  • removed /home to allow puppet to create symlink for /home
• rebooted to new kernel (from update)

itb-test1.uchicago.edu

• VMWare changed mac addresses
  • nic 0
    • Flexible
    • Mac set to 00:50:56:00:01:01
  • nic 1
    • VMXNET3
    • Mac set to 00:50:56:00:02:01
• Installed cobbler on system (using tier3 image)
  • Needed to use new disk image since kickstart wouldn't work with old image
  • Changed nic on 101 vlan network to e1000 so that image could use nic
  • Needed to set scsi type to lsi sas
  • Needed to boot using boot using standard kernel to mount and use vmware tools
    • grub.conf needed to be changed to point to correct kernel files (references a later kernel file)
• Installed vmware tools so that nic pointing to external network can be recognized
• Changed eth1 setup to use correct settings (ip address, static, broadcast, gateway)
• Puppet installed and setup
• Updated puppet configuration to correct issues
  • puppet already in image, just did a puppet restart
  • needed to delete /home so that puppet could recreate it as a symlink

-- SuchandraThapa - 25 May 2010