At approx 4:24pm this evening we saw a failure of a SAN shelf in one of our BOL8 SANs used for provisioning virtual machines. This shelf failure caused a loss of array #7 on the SAN which affected a handful of virtual machines. Upon investigation, an air conditioning unit failed… Continue reading
At approx. 3pm today, our telephone system stopped sending and receiving telephone calls due to a fault with Vodafone. This also seems to be affecting Vodafone mobile telephones. This appears to be a national outage. Until the outage recovers we will pay closer attention to our Email ticket systems in… Continue reading
At 6:58am local time, we had a fire alarm activation in our BOL8 datacentre. Our monitored alarm system automatically notified local fire services and they attended around 5 minutes later. After thoroughly inspecting the affected area it was deemed a false alarm sensor activation. The fire service advice was to… Continue reading
We are currently seeing one of our core fibre ring links down between Equinix MA1 and iomart DC13 in Manchester. This is not service affecting as traffic automatically rerouted via a resilient path. We contacted the circuit provider who confirmed that this is due to planned maintenance and due to… Continue reading
Due to a software CPU exhaustion bug, we are required to force an emergency reload of the switch DS-130 in LD2 Manchester datacentre. This will affect any customers directly connected to this switch. This reload is to install a software patch to fix the CPU exhaustion bug.
At approximately 6:07pm, we were alerted to a Cisco Switch failure of DS-173 on part of our older core network. A simultaneous dual fan failure caused the device to power down after 30 seconds. We arrived on site and migrated all affected ports on DS-173 to our newer core network,… Continue reading
At 10:26pm UK local time, we started to receive automated reports of increased latency and packet loss to some destinations. After some diagnostics, we discovered that traffic taking an inbound path via Cogent (AS174) to us was seeing increased latency of +900ms and 25-35% packet loss. Outbound data was unaffected…. Continue reading
At approximately 9:17am UK local time, we started receiving network status reports from our BOL23 datacentre indicating an issue with connectivity. We quickly identified this as a dual fan failure in switch DS-178 which caused it to shutdown after 60 seconds to prevent an overheat condition. This affected connectivity on… Continue reading
At approx 8:25pm on 30th May 2024 we identified some network disruption to our core network. After investigation, we discovered that we had lost power to a rack in Manchester that houses some connectivity and also one of our core routers. Generally this would cause a couple of minutes of… Continue reading
At approx 5:20am this morning, we experienced a dual Cisco device failure on our older switched network which caused an outage for any customers still present on that network. Customers and devices connected to our newer network were unaffected. Ports on the older network are being migrated to the newer… Continue reading