I have 4 NICs in a server running Ubuntu 11.04. It's sole purpose is dynamips. I'm seeing flaky behavior with routing (missing hops in traceroute, intermittent ping) and finally found the culprit:
tyler@dynamipsBox:~$ route -n
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
192.168.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
192.168.1.0 0.0.0.0 255.255.255.0 U 1 0 0 eth3
192.168.1.0 0.0.0.0 255.255.255.0 U 1 0 0 eth1
192.168.1.0 0.0.0.0 255.255.255.0 U 1 0 0 eth2
169.254.0.0 0.0.0.0 255.255.0.0 U 1000 0 0 eth2
0.0.0.0 192.168.1.1 0.0.0.0 UG 0 0 0 eth1
0.0.0.0 192.168.1.1 0.0.0.0 UG 100 0 0 eth0
Now I can manually delete a route using the command
sudo route del default dev eth0
But this is kind of a pain in the butt to do every time the server is rebooted.
Does anybody know how to fix this?