Between 2020-06-04 12:08 UTC and 2020-06-04 12:32 UTC Everweb Datacenter SE1 experienced an outage.
What triggered this issue was an incorrect configuration change that was pushed to the datacenter switches. As soon as this was identified, the applied changes were reverted and service was fully operational at 12:32 UTC.
2020-06-04 12:08 UTC– Alerts triggered and investigation initiated
2020-06-04 12:27 UTC – STATUSPAGE updated
2020-06-04 12:30 UTC – Cause identified and a configuration change is reverted
2020-06-04 12:32 UTC – Alerts cleared and Service Operational.
2020-06-04 12:40 UTC – Incident closed
The root cause of this incident was due to a human error when performing a configuration change to Datacenter switches as part of a decommission procedure.
During the event, clients located in the SE1 datacenter would have experienced network timeouts (5xx-errors) when trying to connect to their service.
Short-term mitigation
Long-term mitigation
We place the utmost importance and pride on achieving and sustaining the highest level of availability for our customers and we regret any disruption in service you have experienced. We continue to work tirelessly to ensure any and all service disruptions are prevented and or mitigated and we will use this incident to further these efforts to help ensure you receive a reliable and positive experience.