Skip to main content
Buildkite

Buildkite response to the eMudhra certificate compromise

Degraded Lasted 1d · started · Buildkite's page

Level
confirmed
Worst impact
Degraded
Down Index
23of 100

What to do

  • Check whether your product depends on Buildkite. Check your stack

    Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.
  • Confirm your retries, queues and scheduled jobs caught up after the 1d it lasted.

    Anything that failed between 2026-10-20 22:13 UTC and 2026-10-21 22:38 UTC may need a replay.
  • Subscribe to Buildkite's feed to hear about the next one first. RSS feed

    https://down.guide/feed?provider=buildkite works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Updates from Buildkite 4

  1. investigating

    The private keys for eight certificates issued by eMudhra, an external certificate authority, have been compromised. Software that still trusts these certificates may accept fraudulent HTTPS certificates. We’re updating the services that power Buildkite and preparing new CLI and Agent releases, which we expect to ship shortly. We’re also tracking fixes to the libraries and trust stores we depend on and will apply them as they become available. We’ll update this page with the new versions and any action customers need to take. Mozilla has published background on the compromise.

    provider

  2. monitoring

    We're continuing to monitor the situation, and are making releases to many of our components that run in customer infrastructure. At time of writing, we've released versions that distrust the affected eMudhra certificates for: - Buildkite agent: https://github.com/buildkite/agent: - v4.7.0: https://github.com/buildkite/agent/releases/tag/v4.7.0 - v3.138.2: https://github.com/buildkite/agent/releases/tag/v3.138.2 - Buildkite CLI: https://github.com/buildkite/cli/releases/tag/v3.64.2 - bktec: https://github.com/buildkite/test-engine-client/releases/tag/v3.3.1 We recommend updating to these versions to prevent exposure to the affected certificate providers. We will continue to issue updates for the other binaries we distribute, and are updating any internal services that are affected.

    provider

  3. monitoring

    We’ve finished updating the services that power Buildkite so they no longer trust the affected eMudhra certificates. No action is needed from customers for Buildkite hosted services. For components that run in customer infrastructure, we still recommend upgrading to the releases listed in our previous update (Buildkite agent v4.7.0 / v3.138.2, Buildkite CLI v3.64.2, and bktec v3.3.1). We’re continuing to release updates for the other binaries we distribute and will post them here as they ship.

    provider

  4. resolved

    All services that power Buildkite have been updated to distrust the affected certificates, and updated releases are available for the components we distribute that run in customer infrastructure: Buildkite agent: v4.7.0 and v3.138.2 Buildkite CLI: v3.64.2 bktec: v3.3.1 elastic-ci-stack-for-aws: v7.8.0 agent-stack-k8s: v0.52.0 We recommend updating to these versions to prevent exposure to the affected certificate providers.

    provider

Reports count in aggregate; nothing about you is shown.

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.

Questions about DWN-c8c3138b57

Is Buildkite still down?

No, this incident was resolved 2026-10-21 22:38 UTC. For Buildkite's live state, see https://down.guide/buildkite.

How long did it last?

1d, from 2026-10-20 22:13 UTC to 2026-10-21 22:38 UTC, by the times Buildkite posted.

What caused it?

Buildkite hasn't published a root cause. If it does, it shows here.

Where does this come from?

Buildkite's official status page, https://www.buildkitestatus.com, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.