OVHcloud Network Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
FS#9003 — rf-1/2/3/4/5/6-a1
Incident Report for Network & Infrastructure
Resolved
The 6 route reflectors have rebooted.

Last reload reason: Critical software exception, check bootflash:crashinfo_RP_00_00_20130722-231203-UTC


Update(s):

Date: 2013-07-23 00:18:19 UTC
Last week we updated the ADVA (optical network of NRA Lille).
When the first equipment returned,it sent a dead OSPF packet that crashed 7 routers on the network, one after the other .
We transfered the bug to Cisco and they found that the new ADVA version is killing routers.
We had to isolate the ADVA network today from the backbone to go into BGP.
But the risk of a new serial crash has been very high.
We waited for the night to perform the intervention and it did not work: 9 routers down, direct reboot.
Now we isolated ADVA , therefore it will not happen again.


The impacts routers:
ASR1K
6K5
they have the same OSPF code so the same bug

Non impacted routers
ASR9K
N7K
They have a new OSPF code so there is no bug.

Date: 2013-07-22 23:37:05 UTC
We are isolating the adva equipment set of the network.
Posted Jul 22, 2013 - 23:36 UTC