Delayed Automation Execution

What to do

• Check whether you use Courier API. Check your stack

  Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.

• Confirm your retries, queues and scheduled jobs caught up after the 1h 19m it lasted.

  Anything that failed between 2023-02-23 00:59 UTC and 2023-02-23 02:18 UTC may need a replay.

• Subscribe to Courier's feed to hear about the next one first. RSS feed

  https://down.guide/feed?provider=courier works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Updates from Courier 4

1. investigatingFeb 23, 2023, 12:59 AM UTC

   We're are currently investigating reports of a delay in resuming execution of Courier Automations while they are in a "waiting" state.

   provider

2. identifiedFeb 23, 2023, 1:19 AM UTC

   The issue has been identified and a fix is being applied to production systems. Once the fix has been applied, backlogged Automations will begin to clear out. We will post an update in the next 40 minutes.

   provider

3. monitoringFeb 23, 2023, 2:10 AM UTC

   This issue had a broader impact that originally indicated: Instead of only automations in a "WAITING" state, all automations processing was adversely impacted. The applied fix appears to have stabilized automations execution. Backlogged automations are now being processed. The team will continue to monitor.

   provider

4. resolvedFeb 23, 2023, 2:18 AM UTC

   The incident has been resolved. All backlogged Automations have been processed.

   provider

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.