At 1:43pm, our monitoring identified a link failure on our metro ethernet ring between Bolton and Manchester. As designed, our ring reconverged via backup links and no outage was experienced – however the ring now has reduced resilience. We have raised a fault with Virgin Media to investigate the cause… Continue reading
At approx. 8:15pm this evening, our alerting saw a flap of our protected fibre link between Manchester and London (provided as an MPLS pseudowire) which affected connectivity between LDeX2 and LDeX1 datacentres. This link is used solely for our connectivity to LINX LON1 and LINX LON2 peering networks, and caused… Continue reading
At approx 18:43 this evening, we started to receive monitoring alerts to high levels of packet loss to some internet destinations. After diagnostics, we discovered that these destinations were all via one of our IP Transit suppliers (GTT) – we have shutdown our IP Transit feed to cause re-routing via… Continue reading
We have received notification today that VirginMedia have scheduled planned maintenance for 7th September from 00:01 to 06:01 with an expected actual outage time of 90 minutes. This is required for them to upgrade processor modules in their network node in Manchester “due to obsolescence”. This will affect our metro… Continue reading
At approx 10:35pm this evening, one of our core Cisco routers unexpectedly rebooted. This was due to an IOS-XE crash. The router automatically restarted, and BGP sessions will re-establish. Some network instability would have occurred during this restart due to the unclean nature of the reboot. We will investigate… Continue reading
As mentioned in an earlier post, we have been upgrading our network capacity (both internally and externally). We have now expanded our two main external connectivity (“Transit”) provider links to 10Gbit/s each. We have also recently agreed to join an additional Internet Exchange in Manchester (more info will follow once… Continue reading
One of our IP Transit providers has informed us of some emergency maintenance taking place on Monday 2nd July 2018 at 12noon (UK local time). We will shutdown this connection prior to the maintenance window, all traffic will automatically re-route via our alternative paths and no issues are expected. The… Continue reading
We currently have a 10Gbit/s Openreach fibre circuit between BOL23 and MA1 offline. Openreach are investigating. Our ring automatically rerouted traffic to prevent an outage to customers. No outages are anticipated, but the ring is operating at reduced resilience in the interim.
We have gracefully shutdown our LINX LON1 and LON2 LAN peering while our LINX Connexions provider performs some maintenance. All traffic has re-routed via other paths (LINX IXManchester, or IP Transits) without any disruption to traffic. We will bring these peers back online once our Connexions provider completes their maintenance… Continue reading
At approx 1:10pm today, we experienced a network issue. After investigating, we saw what appeared to be a Layer 2 loop within our network. We have mitigation against these loops, so this was unusual. After detailed investigation, we discovered that a Cisco 3850 series switch located in Manchester MA2 had… Continue reading