Cogent acknowledged this incident an hour or so after we mitigated it and have now provided the following RFO:
Your service connected at London Volta may have experienced connectivity issues for some minutes.
During the execution of a non impacting maintenance in our network, we made a mistake and applied some configuration changes on the wrong device, causing the isolation of a node router. As soon as we realized about the mistake, we reverted the config changes on the affected device.
This has been a human error. However we will review the maintenance process to see if there is any room of improvement to avoid a similar issue in the future.
Apologies for any inconvenience caused.
Thankfully, we have multiple transit providers and multiple connections to each distributed around the network, so shutting one down in this kind of situation, or even for a prolonged period, is a non-event. Further, only 10% of our traffic flows over transit - 90% is directly on-net or flows over bilateral peering.
We continue to encourage customers to connect as directly as possible - either by being on-net directly, cross-connected to us in a common data centre, or having your colocation provider peer with us if they don’t already. Please speak to us if you’d like this.
We will be testing Cogent’s fix and re-enabling this session later this evening.