Here’s a few thoughts on the recent bash vulnerabilities: A lot of media reports have said only people calling CGI scripts with bash are at risk, but it extends much further than that due to the way the OS works. When spawning a new process (e.g. to start a CGI,… Continue reading
At 8:37pm, switch 23 went offline due to a power failure. Engineers attended site and diagnosed the cause of the power failure and re-established power at 10:28pm and will continue to monitor the power for the next 24 hours. Any customers connected to switch 23 will have seen a network… Continue reading
Cogent Maintenance is about to begin. As a precaution, we have disabled all connectivity via Cogent during their maintenance window. Details: Start time: 24.05.14 04:00 CEST End time: 24.05.14 07:00 CEST Location: Manchester-Slough (U.K) Work order number: NC583 Expected Outage/Downtime: 1 hour The purpose of this work is reload… Continue reading
Earlier this evening we experienced some issues with an interlink between Telecity Reynolds House and Telecity Williams House in Manchester. Starting 6:06pm, we started receiving spanning-tree topology errors via the link (provided by Geo) causing the link to flap. This continued randomly until approximately 8:15pm and has been stable since…. Continue reading
We have been notified of a scheduled maintenance window for Cogent Communications (one of our IP Transit suppliers). This is due to occur on Saturday 24th May 2014 between 4am-7am UK local time whilst a router software upgrade is applied. We should notice very little, if any disruption during this… Continue reading
Further to our recent ticket, our IP Transit connection to Level3 Communications is offline again. At 1:05am this morning, our physical link to Level3 Communications is reported as down. As this is the second event recently, we have escalated this with the provider. Due to the unclean shutdown, a… Continue reading
We experienced an outage of one of our interlinks between Bolton and Manchester provided by Virgin Media overnight. This fibre-optic link failed to pass traffic between 12:04am and 2:36am. Due to our resilient ring network topology, no outage occurred to customers in Bolton as traffic diverted via an alternate fibre… Continue reading
At 10:53am UK local time, we saw our physical link to Level3 (AS3356) drop for 5 minutes. This caused our routers to immediately terminate the BGP routing session with Level3 and start to reconverge via our alternative paths leading to 2-3 minutes of instability whilst routes updated. The link to… Continue reading
Earlier today, we had a failure of one of our firewalls pairs. This occurred at 2:43pm UK local time. Our firewalls operate in pairs in a failover capacity. Unfortunately, today this failover took much longer than expected. The failover took place within a few seconds as designed, however this triggered… Continue reading
We have received monitoring alerts showing a core problem at one of our IP Transit providers (Level3). While trying to confirm this alert, we can’t reach Level3’s London POP at all so feel that the issue at their end is a lot wider than a local issue. As a result,… Continue reading