Skip to main content
Buildkite

Latency issues

Partial outage Lasted 7h 33m · started · Buildkite's page

Level
confirmed
Worst impact
Partial outage
Components
Agent API, Job Queue
Down Index
33of 100

What to do

  • Check whether you use Buildkite Agent API, Job Queue. Check your stack

    Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.
  • Confirm your retries, queues and scheduled jobs caught up after the 7h 33m it lasted.

    Anything that failed between 2026-03-03 21:51 UTC and 2026-03-04 05:24 UTC may need a replay.
  • Subscribe to Buildkite's feed to hear about the next one first. RSS feed

    https://down.guide/feed?provider=buildkite works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Updates from Buildkite 7

  1. investigating

    We're seeing elevated job dispatch latency and Agent API latency across multiple shards. We're investigating.

    provider

  2. investigating

    We're still experiencing latency issues for agent api and job dispatch. We continue to investigate and identify the root cause.

    provider

  3. investigating

    We continue to experience high latency on some services. We're continuing to identify root causes.

    provider

  4. monitoring

    We've made some changes to address the issue and are seeing signs of recovery. We continue to monitor the situation.

    provider

  5. monitoring

    We've seen a small number of unrelated issues, each affecting a subset of customers. Most impact is resolved, but we are continuing to monitor impact for a small number of remaining customers. We are in touch with those customers directly.

    provider

  6. monitoring

    We continue to observe high latency on isolated infrastructure serving Agent API endpoints for a subset of customers. We are provisioning additional capacity to address this latency, and have informed impacted customers.

    provider

  7. resolved

    We have completed the provisioning of additional capacity mentioned in our last update, and error rates and response times have returned to normal. This incident is now resolved.

    provider

Reports count in aggregate; nothing about you is shown.

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.

Questions about DWN-7c5f05dcff

Is Buildkite still down?

No, this incident was resolved 2026-03-04 05:24 UTC. For Buildkite's live state, see https://down.guide/buildkite.

How long did it last?

7h 33m, from 2026-03-03 21:51 UTC to 2026-03-04 05:24 UTC, by the times Buildkite posted.

What was affected?

Buildkite named Agent API, Job Queue.

What caused it?

Buildkite hasn't published a root cause. If it does, it shows here.

Where does this come from?

Buildkite's official status page, https://www.buildkitestatus.com, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.