Elevated API errors and latencies

What to do

• Check whether you use Radar Track API, Dashboard, Webhooks, Search APIs and 4 more. Check your stack

  Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.

• Confirm your retries, queues and scheduled jobs caught up after the 6h 1m it lasted.

  Anything that failed between 2021-10-06 00:33 UTC and 2021-10-06 06:34 UTC may need a replay.

• Subscribe to Radar's feed to hear about the next one first. RSS feed

  https://down.guide/feed?provider=radar works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Updates from Radar 6

1. investigatingOct 6, 2021, 12:33 AM UTC

   We are investigating elevated API errors and latencies.

   provider

2. investigatingOct 6, 2021, 12:36 AM UTC

   We are continuing to investigate this issue.

   provider

3. investigatingOct 6, 2021, 12:45 AM UTC

   We are continuing to investigate this issue.

   provider

4. investigatingOct 6, 2021, 1:09 AM UTC

   We are continuing to investigate this issue.

   provider

5. identifiedOct 6, 2021, 1:20 AM UTC

   We have identified the issue and are implementing a fix.

   provider

6. resolvedOct 6, 2021, 6:34 AM UTC

   This incident has been resolved. Due to a code rollback, an index build was triggered, leading to CPU and IO pressure on our database. This index has completed building and all services have returned to normal latencies.

   provider

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.