ROCKS 5 Routing

ROCKS 5 has a flexible scheme for setting routing rules. Similar to the attribute scheme, routes can be set on a global, OS, appliance and host level. Wish to use this method.

Disable NAT

The default network setup for a ROCKS cluster puts the clients on a private network with the frontend running NAT and acting as a gateway.

We have private and public networking to each node

rocks remove route 0.0.0.0
rocks remove route 255.255.255.255
rocks remove route 192.41.236.11

Put the default gateway in:

rocks add route 0.0.0.0 192.41.236.1 netmask=0.0.0.0

Note haven't yet disabled NAT in iptables.

Wider multicast netmask

rocks remove route 224.0.0.0
rocks add route 224.0.0.0 eth0 netmask=240.0.0.0

Additional gateways

We use routing between the private network in the MSU and UM clusters. Need to specify the gateway that can send packets from MSU to UM.

Note This isn't yet tested as we are rearranging the local IPs.

rocks add route 10.10.0.0 10.10.128.1 netmask=255.255.240.0

Update tables on umrocks

rocks remove route 0.0.0.0
rocks remove route 255.255.255.255
rocks add route 0.0.0.0 192.41.230.1 netmask=0.0.0.0
rocks remove route 224.0.0.0
rocks add route 224.0.0.0 eth0 netmask=240.0.0.0
rocks add route 10.10.128.0 10.10.1.2 netmask=255.255.240.0
rocks add route 10.1.0.0 10.10.1.2 netmask=255.255.254.0
rocks add route 10.10.2.0 10.10.1.2 netmask=255.255.254.0
rocks remove route 192.41.230.42

# Previously this was 10.10.1.42, the private NIC address of umrocks
rocks set attr Kickstart_PrivateGateway 10.10.1.2

Update frontend

The file /etc/sysconfig/static-routes is not updated by a rocks sync config command. Update it this way:

# rocks report host route msurxi > /etc/sysconfig/static-routes

After network restart, routes look like:

[root@msurxi ~]# route
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
192.41.236.0    *               255.255.254.0   U     0      0        0 eth1
10.10.0.0       10.10.128.1     255.255.254.0   UG    0      0        0 eth0
10.10.128.0     *               255.255.240.0   U     0      0        0 eth0
169.254.0.0     *               255.255.0.0     U     0      0        0 eth1
224.0.0.0       *               240.0.0.0       U     0      0        0 eth0
default         192.41.236.1    0.0.0.0         UG    0      0        0 eth1

-- TomRockwell - 15 Nov 2009