We have received reports of some unusual packet loss to certain destinations since 2:10am this morning. We have conducted testing within our network to confirm that the issue lies outside of our network infrastructure. As a result, we have raised the issue with our global connectivity providers to investigate further.
Our monitoring systems alerted us to IPv4 connectivity issues at 6:32pm this evening. This was traced to our connection with Level3, Inc. It appears to have stopped passing IPv4 traffic due to a routing loop internally within Level3’s network. We have shutdown our connectivity with them and raised a trouble… Continue reading
Netnorth have recently established additional DNS fabric in Hemel Hempstead, providing further resilience to our hosted services. We now operate various networked DNS servers deployed across 5 distinct geo-locations: LON1 – London MAN1 – Manchester BOL1 – Bolton BOL2 – Bolton HEM1 – Hemel Hempstead All of Netnorth’s DNS servers… Continue reading
Continuing from http://status.netnorth.net/2015/05/06/us-based-connectivity-issue/ We just started to receive monitoring reports showing the same level of packet loss as received earlier this morning. We have removed the Level3 connectivity from our network immediately forcing re-routing of traffic. We will contact Level3 for more information.
We have received reports this morning of network alerts from 3rd party providers indicating trouble reaching the Netnorth network. After further investigation, we narrowed the issue to part of the Level3 network (traceroutes included below) located in the US – we raised this with Level3 who confirmed they currently have… Continue reading
At 1:34pm we received alerts regarding some destinations being unreachable. Further investigation showed that our fibre link to Level3 was down unexpectedly. This caused a BGP routing event. Our configuration started the BGP reconvergance process as soon as the router saw the fibre link drop and outbound traffic was re-routed… Continue reading
We experienced a short fibre outage on one of our fibre circuits between Bolton and Manchester overnight. This started at 12:05am and concluded at 12:52am. No maintenance was scheduled for this period so we are awaiting a RFO (reason for outage) from VirginMedia for the circuit. Due to our… Continue reading
We have received a maintenance notification from IXmanchester(LINX) stating that they will be performing switch maintenance on their network. 18/Mar/2015 midnight – 5am (UK local time) This maintenance will affect our IXmanchester peering connectivity during the window. We do not anticipate any disruption from the above maintenance as the exchange… Continue reading
Following some recent reports of very low packet loss on some routes via Cogent, we performed extensive testing of our core infrastructure and located a potential issue with one leg of our metropolitan core ring. (Our core ring traverses four buildings, utilising a different supplier for each leg of the… Continue reading
This evening there have been a few periods of instability with one of our IP Transit providers (Level3). These occurred around 5pm, 7pm and 10:30pm. Level3 have confirmed this is due to a faulty line card which is currently being replaced. These brief periods of instability occur while our routers… Continue reading