Between 19:18 UTC and 19:23 UTC the Clerk.io API experienced a minor outage causing slow response times.

At 19:18 UTC a series of commands were issued to our datastore slowing down our response times and thus caused a domino effect slowing all other queries. The domino effect were to big to be resolved automatically by our autonomous reliability systems.

At 19:19 UTC our team was alerted and at 19:21 UTC we had identified the problem and started our tools to cooldown the system.

At 19:23 UTC API response times were back to normal.

‌

Though we are still investigating the initial cause we will now start our evaluation process of our preventive measures that could have avoided this incident.

A good thing to take from this outage is that our alerting, monitoring and recovery tools worked exactly as planned which meant that the issues was resolved as fast as humanly possible.

We know the reliability of our service is crucial for your business and we always works seriously on expanding Clerk.io’s stability and reliability.

--

Hans-Kristian Bjerregaard

CEO, Clerk.io