rssLink RSS for all categories
 
icon_red
icon_green
icon_red
icon_red
icon_blue
icon_green
icon_green
icon_red
icon_red
icon_red
icon_orange
icon_green
icon_green
icon_green
icon_green
icon_blue
icon_green
icon_orange
icon_red
icon_green
icon_red
icon_red
icon_green
icon_red
icon_red
icon_red
icon_red
icon_orange
icon_green
 

FS#10665 — FS#14532 — 46.105.108.0/24 & 46.105.109.0/24

Attached to Project— Network
Maintenance
RBX-4
CLOSED
100%
One of two Nexus managing these networks lost some of the FEX (Bug).

We will upgrade the couple of Nexus to ISSU tonight to avoid the failure, if the problem occurrs on the second Nexus.

For now, some of the traffic flows through the secondary N5.

The intervention is scheduled this Friday, August 28th from 11:00 pm GMT + 2
Date:  Friday, 04 September 2015, 13:33PM
Reason for closing:  Done
Comment by OVH - Monday, 31 August 2015, 16:16PM

The intervention starts, we have lost a FEX.


Comment by OVH - Monday, 31 August 2015, 16:18PM

The primary switch has been reloaded and crashed during the ISSU. It rebooted causing a small interruption on the service. The FEX fell during the upgrade. We are updating the secondary switch for the FEX to be updated and back on the primary switch.


Comment by OVH - Monday, 31 August 2015, 16:20PM

The ISSU on the secondary switch went well. We are reloading the primar y switch that is in an abnormal condition (ports are inactive)


Comment by OVH - Monday, 31 August 2015, 16:22PM

When restarting the FEX on the primar y switch, those that had lost their config (probably from before), are causing inconsistencies in the vpc.
We have checked all the configurations and all servers are pinging.

The couple is now stable.


Comment by OVH - Friday, 04 September 2015, 13:26PM

FEX 103 disappeared from one of the 2 nexus.

# sh fex
FEX FEX FEX FEX Fex
Number Description State Model Serial
------------------------------------------------------------------------
100 fex100|51C09 Online N2K-C2248TP-1GE SSI14280VP3
101 FEX0101 Online N2K-C2248TP-1GE SSI14260CR3
102 fex102|51C07 Online N2K-C2248TP-1GE SSI14270LJ4
104 fex104|51C05 Online N2K-C2248TP-1GE SSI14270LRD
106 FEX0106 Online N2K-C2232PP-10GE SSI14160433
110 FEX0110 Online N2K-C2232PP-10GE SSI14260EFJ
111 FEX0111 Online N2K-C2248TP-1GE SSI14270E6V
112 FEX0112 Online N2K-C2248TP-E-1GE SSI171301VL
--- -------- Offline N2K-C2248TP-1GE SSI142709EX

This only impacts redundancy and delivery of new servers in this rack.
We will reboot the n5 on 03/09/2015, the traffic will be redirected by the 2nd n5.


Comment by OVH - Friday, 04 September 2015, 13:27PM

We will reboot the 1st n5.


Comment by OVH - Friday, 04 September 2015, 13:27PM

# sh fex
FEX FEX FEX FEX Fex
Number Description State Model Serial
------------------------------------------------------------------------
100 fex100|51C09 Online N2K-C2248TP-1GE SSI14280VP3
101 FEX0101 Online N2K-C2248TP-1GE SSI14260CR3
102 fex102|51C07 Online N2K-C2248TP-1GE SSI14270LJ4
104 fex104|51C05 Online N2K-C2248TP-1GE SSI14270LRD
106 FEX0106 Online N2K-C2232PP-10GE SSI14160433
110 FEX0110 Online N2K-C2232PP-10GE SSI14260EFJ
111 FEX0111 Online N2K-C2248TP-1GE SSI14270E6V
112 FEX0112 Online N2K-C2248TP-E-1GE SSI171301VL
--- -------- Connected N2K-C2248TP-1GE SSI142709EX <<<<<<

FEX 103 is still not present, despite the port shut....

I will fully deconfigure the 103 and repush the configuration.


Comment by OVH - Friday, 04 September 2015, 13:28PM

Deconf/reconf is not working.

We will electrically reboot FEX103.


Comment by OVH - Friday, 04 September 2015, 13:33PM

when in doubt, reboot....

# sh fex
FEX FEX FEX FEX Fex
Number Description State Model Serial
------------------------------------------------------------------------
100 fex100|51C09 Online N2K-C2248TP-1GE SSI14280VP3
101 FEX0101 Online N2K-C2248TP-1GE SSI14260CR3
102 fex102|51C07 Online N2K-C2248TP-1GE SSI14270LJ4
103 fex103|51C06 Online N2K-C2248TP-1GE SSI142709EX <<<<<<<
104 fex104|51C05 Online N2K-C2248TP-1GE SSI14270LRD
106 FEX0106 Online N2K-C2232PP-10GE SSI14160433
110 FEX0110 Online N2K-C2232PP-10GE SSI14260EFJ
111 FEX0111 Online N2K-C2248TP-1GE SSI14270E6V
112 FEX0112 Online N2K-C2248TP-E-1GE SSI171301VL

The FEX is back up. The configuration is synchronised. All good.