At 7:04am this morning, we had a dark fibre failure between two of our Manchester datacentres. The cause of this is currently being investigated by the fibre provider.
Unfortunately, our backup fibre path failed to take over leading to one of our Manchester datacentres becoming isolated. This was caused by a configuration error and has now been rectified.
More updates to follow once the fibre failure has been investigated.
This has been reported as part of an extended maintenance window by the dark fibre provider.
They are investigating why we did not receive notification of the maintenance.
We will continue to operate on the backup path with no further outages anticipated.
There may be a few seconds of instability when the circuit returns however.
This circuit is back online as of 10:15am, it has entered into backup state.