Hey all, I've been trying to figure out how to make this work cleanly but I don't like any of the solutions I've come up with.
We have 2 sites that we'd like to multihome out of. Now, each site was allocated their own block of IPs by their respective ISPs. What I would like to happen is those blocks of IPs always go out (and come back in) by the ISP who owns them, unless there is a failure, in which case I would like the traffic sent over the MPLS and out the other ISP.
I've gotten this to work in a lab by issuing out default routes from the ISPs to the 2811 through BGP. Then I distribute the default route out via OSPF. I have the two 2811s connected to the MPLS connected using a tunnel. The 2 sites are in different autonomous systems in OSPF so at Site 2 I redistributed OSPF from Site 1. Since the default gateway of Site 1 is being redistributed into Site 2 I bump up the metric so that site doesn't try to use it as it's primary.
But since the 2811 at Site 2 directly participates in Site 1's OSPF it sometimes uses it's gateway (since both have the same metric).
So it works, and works ok, but it's not the cleanest way to do it.
Does anyone have any thoughts?