Skip to main content
Bitbucket

Bitbucket Cloud web, api, and Pipelines service outage

Degraded Lasted 8h 38m · started · Bitbucket's page

Level
confirmed
Worst impact
Degraded
Components
Website, API, Git via SSH, Authentication and user management, Git via HTTPS, Webhooks, Source downloads, Pipelines, Git LFS, Email delivery, Purchasing & Licensing, Signup
Down Index
51of 100

What to do

  • Check whether you use Bitbucket Website, API, Git via SSH, Authentication and user management and 8 more. Check your stack

    Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.
  • Confirm your retries, queues and scheduled jobs caught up after the 8h 38m it lasted.

    Anything that failed between 2025-01-21 15:30 UTC and 2025-01-22 00:08 UTC may need a replay.
  • Subscribe to Bitbucket's feed to hear about the next one first. RSS feed

    https://down.guide/feed?provider=bitbucket works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Updates from Bitbucket 9

  1. investigating

    We are investigating an issue with Bitbucket Web and Git operations that is impacting Atlassian Bitbucket Cloud customers. We will provide more details within the next hour.

    provider

  2. investigating

    We are still investigating an issue with Bitbucket Web and Git operations that is impacting Atlassian Bitbucket Cloud customers. We will provide more details within the next hour.

    provider

  3. investigating

    We are investigating an issue with saturated Bitbucket database that impacts all Bitbucket operations. We will provide more details within the next hour.

    provider

  4. investigating

    We are investigating an issue with saturated Bitbucket database that impacts all Bitbucket operations. We will provide more details within the next 30 minutes.

    provider

  5. monitoring

    We have identified the root cause of the database issue and have mitigated the problem. We are now monitoring closely.

    provider

  6. monitoring

    We have identified the root cause of the database issue that impacted Bitbucket website and Git operations; this has been mitigated now. We are experiencing Pipelines degradation that we are working to resolve.

    provider

  7. monitoring

    All Git, Web, API and Pipelines services are now operational. We are continuing to monitor database and Pipelines reliability.

    provider

  8. resolved

    Earlier we experienced database contention on high traffic tables, which resulted in website, API, and Pipelines outages. All Bitbucket services are now operational. A full post mortem will be published.

    provider

  9. postmortem

    ### Summary On January 21, 2025, between 14:02 and 17:49 UTC, Atlassian customers using Bitbucket Cloud were unable to use the website, API, or Pipelines. The event was triggered by write contention in a high traffic database table. The incident was detected within eight minutes. We then worked to both throttle traffic and improve query performance, which allowed services to recover. The total time to resolution was about three hours and 47 minutes. ### **IMPACT** The overall impact was between 14:02 and 17:49 UTC, affecting Bitbucket Cloud. This impacted customers globally, and they were unable to use the website, APIs, or Pipelines services. Git hosting \(SSH\) was unaffected. ### **ROOT CAUSE** The issue was caused by an increase in API traffic triggering write contention on a high-traffic table, resulting in increased CPU usage and degraded database performance. This ultimately impacted the availability of core services \(web, API, and Pipelines\). ### **REMEDIAL ACTIONS PLAN & NEXT STEPS** We know that outages impact your productivity. While we have several testing and preventative processes in place, this specific issue wasn’t identified because the code path being triggered does not commonly experience this type of traffic. We are prioritizing the following improvement actions to avoid repeating this type of incident: * Running additional maintenance on core database tables * Added throttling on write-heavy operations To improve service resilience and recovery time for our environments, we will implement additional preventative measures such as: * Improving database observability to isolate failures * Continuing to shard data to better distribute traffic load We apologize to customers whose services were impacted by this incident and are taking immediate steps to improve the platform’s performance and availability. Thanks, Atlassian Customer Support

    provider

Reports count in aggregate; nothing about you is shown.

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.

Questions about DWN-ffa13642ea

Is Bitbucket still down?

No, this incident was resolved 2025-01-22 00:08 UTC. For Bitbucket's live state, see https://down.guide/bitbucket.

How long did it last?

8h 38m, from 2025-01-21 15:30 UTC to 2025-01-22 00:08 UTC, by the times Bitbucket posted.

What was affected?

Bitbucket named Website, API, Git via SSH, Authentication and user management and 8 more.

What caused it?

Bitbucket hasn't published a root cause. If it does, it shows here.

Where does this come from?

Bitbucket's official status page, https://bitbucket.status.atlassian.com, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.