Skip to main content
Sauce Labs

2026-September-28 Service Incident

Partial outage Lasted 1h 15m · started · Sauce Labs's page

Level
confirmed
Worst impact
Partial outage
Components
US-West
Regions
us, us-west-1
Down Index
36of 100

What to do

  • Check whether you use Sauce Labs US-West in us, us-west-1. Check your stack

    Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.
  • Confirm your retries, queues and scheduled jobs caught up after the 1h 15m it lasted.

    Anything that failed between 2026-09-28 16:04 UTC and 2026-09-28 17:19 UTC may need a replay.
  • Subscribe to Sauce Labs's feed to hear about the next one first. RSS feed

    https://down.guide/feed?provider=saucelabs works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Root cause

The root cause of the elevated error rates for Real Device tests in the US-West-1 data center has been identified.

Category: Data center or power

Read the postmortem

Updates from Sauce Labs 4

  1. investigating

    We are currently seeing elevated error rates for automated real device tests in US-West-1 data center. We are currently investigating.

    provider

  2. monitoring

    The root cause of the elevated error rates for Real Device tests in the US-West-1 data center has been identified. Remediation has been applied, and we are actively monitoring the situation.

    provider

  3. resolved

    After taking remedial action, Real Device test error rates have returned to normal in the US-West-1 data center. All services are fully operational.

    provider

  4. postmortem

    ### **Dates:** Monday, September 28th 2026, 14:19 UTC - 16:52 UTC. ### **What happened:** Real device tests in US West hung and failed to output test artifacts due to slow uploads. ### **Why it happened:** A degraded interconnect link suffered high packet loss from optical errors, but BGP stayed up, preventing automatic failover to healthy paths. ### **How we fixed it:** Manually disabled the degraded port on the edge router, forcing traffic onto healthy alternate interconnects. ### **What we are doing to prevent it from happening again:** Automating link draining based on CRC error thresholds, improving protocols for isolating flapping vendor links, and hardening upload resilience.

    provider

Reports count in aggregate; nothing about you is shown.

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.

Questions about DWN-8a2d32bc38

Is Sauce Labs still down?

No, this incident was resolved 2026-09-28 17:19 UTC. For Sauce Labs's live state, see https://down.guide/saucelabs.

How long did it last?

1h 15m, from 2026-09-28 16:04 UTC to 2026-09-28 17:19 UTC, by the times Sauce Labs posted.

What was affected?

Sauce Labs named US-West in us, us-west-1.

What caused it?

Data center or power. Sauce Labs wrote: "The root cause of the elevated error rates for Real Device tests in the US-West-1 data center has been identified." The postmortem: https://stspg.io/551m8dbsyvqd

Where does this come from?

Sauce Labs's official status page, https://status.saucelabs.com, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.