Quote:
Originally Posted by donsimon  Let me explain what happened on the 19th. We have 4 routes into our data center and one of the routers from one of primary bandwidth providers freaked out. When this happened for some strange reason the other 3 routers tried to switch to the route that was having problems. It made no sense to me that something like that would happen but we had 1 hour 38 minutes of complete downtime and 33 minutes of downtime on just one of our clusters for a total of 2 hours 11 minutes of some downtime. |
Were the routers Cisco? Sometimes they can play follow the leader and make the leader the rouge equipment. I had about the same thing happen a couple years back, I had to write it off as a bad NOS instruction at the basic level. This may sound like a dummy rigging at the very cheapest level, but we (the ISP) were down because of this, the replacement couldn't get to me for a day so I bought a cheap (
$30) Linksys router at Officemax, did some creative wiring and everything worked perfect. To this day I still keep two cheap routers in my supply cabinet and pray it never happens again.
Happy Holidays and high CTRs to all.