OVHcloud Network Status
Current status
Legend
- Operational
- Degraded performance
- Partial Outage
- Major Outage
- Under maintenance
FS#9057 — Routing Frankfurt 30 and 31/07
Scheduled Maintenance
Report for Network & Infrastructure
Completed
We will launch works tonight and the following night in Frankfurt (30 and 31/07) in order to relocate our routers in a bigger room and disposing further power.
This will allow us to optically to protect our circuits 10G Roubaix <> Frankfurt and Strasbourg <> Frankfurt.
Works planning:
- night of 30 to 31: relocating fra-5-6k
- night of 31 to 01/08: relocating fra-1-6k, voip, cdn, switching the optical line to Brussels/Roubaix.
01/08: setting the protection Roubaix <> Frankfurt by Brussels and Paris.
Update(s):
Date: 2013-08-01 07:45:47 UTC
Infinera has to analyse the data collected on the node control modules in order to determine the cause of the crash and find a solution to the problem.
It will be an indepth analysis carried out directly in California and the feedback certainly won't be rapid.
We will turn to the Roubaix > Paris > Frankfurt route for some time while we wait to be able to get the Roubaix > Bruxelles > Frankfurt side back up and put protections in place.
Date: 2013-08-01 06:21:10 UTC
We recovered 100% of the performance Roubaix <> Frankfurt.
Traffic flows currently through Paris.
We will keep working with Infinera in order to find a solution that will allow us to restore the line Roubaix> Brussels> Frankfurt.
For now,we will no longer try to perform any action which can have an impact on traffic .
We will certainly perform a new intervention the next night.
Date: 2013-08-01 04:20:27 UTC
We are still troubleshooting with Infinera. We are working with 30% of normal capacity between Roubaix and Frankfurt.
Date: 2013-08-01 04:19:37 UTC
Troubleshooting with Infinera is in progress. So, traffic will be at risk.
Date: 2013-08-01 04:17:49 UTC
The node has crashed again during insertion of the DLM in chassis # 2 and the traffic was again impacted. The node is up again and we have 100% of performance up, but only on the line Roubaix > TH2> SBG> Frankfurt.
It is not possible for the moment to reinsert the DLMs cards to raise the performance of the primary line Roubaix> Brussels> Frankfurt.
We are working on the problem with the OEM (original equipment manufacturer), Infinera.
Date: 2013-08-01 00:30:16 UTC
All circuits are up again. The entire node has been reset following the insertion of DLMs in the chassis. We will now reinsert the DLMs one by one.
Date: 2013-08-01 00:28:31 UTC
We have an incident on the new node Infinera. The chassis 2 and 3 are offline and circuits are cut.
Date: 2013-07-31 23:15:15 UTC
The router was installed in the new room. Traffic Roubaix <> Frankfurt currently flows through Paris.
Date: 2013-07-31 23:14:24 UTC
The router is isolated. We turned it off so we can move it.
Date: 2013-07-31 23:13:18 UTC
We started isolating the router fra-1-6kfrom the network.
Date: 2013-07-31 02:08:22 UTC
Done.
We will restore traffic on the router.
Date: 2013-07-30 23:36:36 UTC
The router is up. We are reconnecting the links.
Date: 2013-07-30 23:36:03 UTC
The router is isolated. We are stopping it for relocation.
Date: 2013-07-30 23:35:31 UTC
We are starting to isolate the router fra-5-6k of the network.
This will allow us to optically to protect our circuits 10G Roubaix <> Frankfurt and Strasbourg <> Frankfurt.
Works planning:
- night of 30 to 31: relocating fra-5-6k
- night of 31 to 01/08: relocating fra-1-6k, voip, cdn, switching the optical line to Brussels/Roubaix.
01/08: setting the protection Roubaix <> Frankfurt by Brussels and Paris.
Update(s):
Date: 2013-08-01 07:45:47 UTC
Infinera has to analyse the data collected on the node control modules in order to determine the cause of the crash and find a solution to the problem.
It will be an indepth analysis carried out directly in California and the feedback certainly won't be rapid.
We will turn to the Roubaix > Paris > Frankfurt route for some time while we wait to be able to get the Roubaix > Bruxelles > Frankfurt side back up and put protections in place.
Date: 2013-08-01 06:21:10 UTC
We recovered 100% of the performance Roubaix <> Frankfurt.
Traffic flows currently through Paris.
We will keep working with Infinera in order to find a solution that will allow us to restore the line Roubaix> Brussels> Frankfurt.
For now,we will no longer try to perform any action which can have an impact on traffic .
We will certainly perform a new intervention the next night.
Date: 2013-08-01 04:20:27 UTC
We are still troubleshooting with Infinera. We are working with 30% of normal capacity between Roubaix and Frankfurt.
Date: 2013-08-01 04:19:37 UTC
Troubleshooting with Infinera is in progress. So, traffic will be at risk.
Date: 2013-08-01 04:17:49 UTC
The node has crashed again during insertion of the DLM in chassis # 2 and the traffic was again impacted. The node is up again and we have 100% of performance up, but only on the line Roubaix > TH2> SBG> Frankfurt.
It is not possible for the moment to reinsert the DLMs cards to raise the performance of the primary line Roubaix> Brussels> Frankfurt.
We are working on the problem with the OEM (original equipment manufacturer), Infinera.
Date: 2013-08-01 00:30:16 UTC
All circuits are up again. The entire node has been reset following the insertion of DLMs in the chassis. We will now reinsert the DLMs one by one.
Date: 2013-08-01 00:28:31 UTC
We have an incident on the new node Infinera. The chassis 2 and 3 are offline and circuits are cut.
Date: 2013-07-31 23:15:15 UTC
The router was installed in the new room. Traffic Roubaix <> Frankfurt currently flows through Paris.
Date: 2013-07-31 23:14:24 UTC
The router is isolated. We turned it off so we can move it.
Date: 2013-07-31 23:13:18 UTC
We started isolating the router fra-1-6kfrom the network.
Date: 2013-07-31 02:08:22 UTC
Done.
We will restore traffic on the router.
Date: 2013-07-30 23:36:36 UTC
The router is up. We are reconnecting the links.
Date: 2013-07-30 23:36:03 UTC
The router is isolated. We are stopping it for relocation.
Date: 2013-07-30 23:35:31 UTC
We are starting to isolate the router fra-5-6k of the network.