From the O/S standpoint, everything is setup correctly; I can trace route through the primary connection without a problem. I can ping the gateway (running through a Dell Layer 3 switch) and the gateway's gateway.
However, about once a day, I get a single alert in the ISA console that says "Description: There is no local IP address on the External network available for connecting to ISP XO. " and it fails over.
There aren't any other configuration errors that I see on the system. It DOES have a local IP (in fact, it has 3, for each of the 3 servers it will be publishing).
I don't have a DNS server configured though, do I need one?
When I disable the backup Internet line, it will switch, I get a good tracert to www.google.com on the new ISP, but within 1 minute I get the error message again and it fails over.
When we first got the new ISP, they gave us 2 different sets of IP's
Set 1: 1.2.3.2 Gateway 1.2.3.1
Set 2:
5.6.7.2-6 Gateway 5.7.7.1
But no router. Before I reprogrammed my Dell 6248 to be a Layer 3 switch, I put the following IP's directly on the ISA server:
1.2.3.2 5.6.7.2 5.6.7.3 5.6.7.4
Gateway 1.2.3.1 and plugged it into the ISP's router.
This worked, and the ISP redundancy worked.
When I reprogrammed our L3 switch to route, and it took 1.2.3.2 and 5.6.7.1, then I set the default gateway in TMG to 5.6.7.1. That worked.
The mistake was on the ISP Redundancy tab, the default gateway was still set at 1.2.3.1, which didn't exist on the new ISA NIC ... it now only has: 5.6.7.2 5.6.7.3 5.6.7.4