Vodafone, who provide our telephony services, are performing maintenance on Thursday 1st June 2017 between 7pm and midnight UK local time. This is to relocate our voice circuits between paths due to Vodafone expiring a historic United Utilities building where our fibre circuit currently travels. During this time, our landline… Continue reading
At 6:55am this morning, we saw Hypervisor DT-324 crash with a pink-screen-of-death. This has been rebooted after a hardware check and any virtual machines located on this HV are now being booted. As this is the 2nd PSOD on this hypervisor in the last year, we will now take… Continue reading
We have received a maintenance notification from Cogent Communications regarding one of IP Transit connections to the global internet. This maintenance is due on 12th February 2017 between midnight and 7am, with an expected outage time of 45-60 minutes. No outage to Netnorth customers is expected as we have multiple… Continue reading
Today we have enabled a new IP Transit connectivity provider. We now have additional connectivity from GTT supplied into one of our Manchester locations. This was enabled for testing during the weekend, and is now fully operational. We will balance our traffic over this over the next few days.
Following on from the router crash experienced yesterday, we have performed an emergency upgrade of the Cisco IOS-XE software on all of our internet-facing routers. This update should resolve the issue that was triggered yesterday. No outage to customers should have been experienced today, but there may have been brief… Continue reading
At 3:52pm today, one of our Cisco ASR routers experienced a crash within its routing engine. This caused the router to instantly stop routing and any destinations via the router experienced an outage. Unfortunately, this did not just sever connectivity cleanly… it started causing “flapping” (where routes are introduced and… Continue reading
We have received a maintenance notification from Virgin Media regarding one of our metro fibre circuits between Bolton and Manchester. This maintenance is due on 23rd February 2017 between midnight and 7am, with an expected outage time of 20 minutes. No outage to Netnorth customers is expected as we have… Continue reading
At 11:55pm tonight, our connection to Level3 appeared to disconnect. The symptoms are identical to the previous occasions where the Level3 router rebooted so we assume this to be the case again tonight. The connection is slowly coming back online, which further supports this suspicion. As Level3 appear to be… Continue reading
We’re seeing packet loss on the LINX Extreme network this morning. We’ve also got alerts coming in for our London location too, this is routed entirely separately to our Bolton/Manchester locations, so it looks like it is affecting the entire LINX LAN. We’ve shunted most traffic over to the LINX… Continue reading
There is currently a storm over the Bolton area (with very nice fork lightning!) which has caused a brief power outage this evening around 7pm UK local time. Our UPS units continued to operate during the outage with no loss of power to the datacentres, and our generators started to… Continue reading