Skip to main content
1Password

Degraded performance when accessing 1Password

Partial outage Lasted 3h 33m · started · 1Password's page

Level
confirmed
Worst impact
Partial outage
Components
Sign in, Sign up, Syncing items between your devices, Billing, Admin console, SSO (Single Sign On), Multi-factor Authentication (MFA), Command Line Interface (CLI), 1Password Connect
Regions
us
Down Index
34of 100

What to do

  • Check whether you use 1Password Sign in, Sign up, Syncing items between your devices, Billing and 5 more in us. Check your stack

    Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.
  • Confirm your retries, queues and scheduled jobs caught up after the 3h 33m it lasted.

    Anything that failed between 2025-09-26 16:51 UTC and 2025-09-26 20:24 UTC may need a replay.
  • Subscribe to 1Password's feed to hear about the next one first. RSS feed

    https://down.guide/feed?provider=1password works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Updates from 1Password 14

  1. investigating

    We are actively investigating an issue where customers may be experiencing degraded performance and slowdowns when accessing 1Password.

    provider

  2. investigating

    The engineering team is restarting key systems in an attempt to alleviate slowdowns.

    provider

  3. investigating

    Overall service is still degraded, but experiencing periods of improvement.

    provider

  4. investigating

    The engineering team is continuing to investigate and actively managing service degradation. Customers may still experience periods of slowdowns when accessing the 1Password service.

    provider

  5. investigating

    The engineering team is actively managing degraded performance and simultaneously attempting to identify root cause. Customers may still experience some slowdowns when accessing 1Password online.

    provider

  6. investigating

    The engineering team is actively managing degraded performance and continuing attempts to identify root cause. Customers may still experience some slowdowns when accessing 1Password online.

    provider

  7. investigating

    Engineering teams have identified a potential cause and are actively managing customer impact. Customers may see some slowdowns, but due to the active management those slowdowns are unlikely.

    provider

  8. investigating

    Engineering teams are testing a mitigation in our non-production environments to verify before rolling it out to our production environments. Customer impact is being actively managed and slowdowns should be rare if they occur at all.

    provider

  9. identified

    The engineering team has identified the issue and we are continuing to test a mitigation in our test environment before rolling it out to production. Customer impact is being actively managed and slowdowns should be increasingly rare.

    provider

  10. identified

    The engineering team is continuing to test a mitigation in our test environment before deploying it to production. Customer impact is being actively managed and instances of slowdowns should continue to decrease.

    provider

  11. identified

    The engineering team is rolling out a mitigation in our production environment.

    provider

  12. monitoring

    The engineering team deployed a mitigation, which has addressed the issue. We will continue to monitor performance.

    provider

  13. resolved

    This incident has been resolved. We will publish a post-mortem as soon as we complete it.

    provider

  14. postmortem

    # Incident Postmortem - Degraded performance when accessing 1Password **Date of Incident:** 2025-09-26 **Time of Incident:** 4:20pm UTC - 5:39pm UTC **Service\(s\) Affected:** SSO, Web Sign In, Sign Up, Web Interface, CLI **Impact Duration:** ~60 minutes ## Summary On September 26, 2025 at 4:20 UTC 1Password’s web interface and APIs experienced degraded performance for all customers in the US region. This was not a result of a security incident and customer data was not affected. ## Impact on Customers During the duration of the incident: * **Web interface, Administration:** Customers experienced delays when accessing the 1Password web interface. * **Single Sign-on \(SSO\), Multi-factor Authentication \(MFA\):** Users with SSO or MFA enabled experienced delays, and in some cases failures to login. * **Command Line Interface \(CLI\):** CLI users faced increased latency and timeouts when attempting to access our web APIs. * **Browser Extension:** Users requiring web interface authentication experienced delays or failures. * **Number of Affected Customers \(approximate\):** ~30% * **Geographic Regions Affected:** [1password.com](http://1password.com) \(US/Global\) ## What Happened? At 4:20PM UTC and 5 PM UTC There were traffic bursts which caused extra load on one of our caches. This cache was under-provisioned to handle that spike of activity, which resulted in it exhausting available CPU. This caused cascading errors/latency which manifested in slow and failed requests. * **Timeline of Events \(UTC\):** * 2025-09-26 4:20pm: Spike in customer traffic began * 2025-09-26 4:29pm: Automated monitoring detects increased errors and latency * 2025-09-26 4:35pm: The team activates our incident protocol and begins investigation * 2025-09-26 4:58pm: The team decides to restart application servers * 2025-09-26 5:00pm: The servers have been restarted, service is still degraded, as a second traffic burst begins * 2025-09-26 5:18pm: Service starts to improve * 2025-09-26 5:25pm: The team detects increased load for the second time * 2025-09-26 5:33pm: The team restarts application servers again * 2025-09-26 5:39pm: Service is back to normal, team continues to investigate * 2025-09-26 7:26pm: Team has found the issue, and proceeds to upgrade cache instance size * 2025-09-26 7:49pm: Cache upgrade completed successfully * 2025-09-26 7:50pm: Team continues to monitor, performance has returned to nominal levels * 2025-09-26 8:24pm: Incident is marked as resolved * **Root Cause Analysis:** A code library installed in July introduced latency issues for cache connections. Authentication operations weren't properly rate-limited, allowing large traffic influxes. During peak traffic periods, the cache infrastructure was operating near maximum CPU capacity. The incident occurred when a burst of authentication traffic pushed the cache CPU utilization to 100%. The increased latency and CPU usage together directly caused the incident. * **Contributing Factors:** * Latency increase due to cache library version upgrade * Inadequate rate limiting allowed traffic bursts to go unchecked * Cache instance size is under-provisioned ## How Was It Resolved? * **Mitigation Steps:** Restarting application servers temporarily mitigated the latency and errors, but the problems returned when traffic spiked again. * **Resolution Steps:** Increasing the instance size for the cache resolved the issue. * **Verification of Resolution:** The incident team tested the upgrade in a staging deployment before executing it in production. They then monitored metrics to confirm the system returned to normal levels. ## What We Are Doing to Prevent Future Incidents * **Improve capacity planning for cache:** We will ensure our internal infrastructure is properly sized to handle current traffic volumes and accommodate future growth. We'll implement regular resource evaluations to maintain adequate capacity as our traffic increases. We will also implement proactive alerting systems that notify our teams when resource utilization approaches critical thresholds. * **Update library to a more performant version:** We will upgrade our caching library to the latest stable version to eliminate the current latency issues. * **Improve rate limiting for operations that triggered the traffic burst:** Enhancing our rate limiting system will significantly improve our ability to handle future traffic bursts. * **Timeline for Implementation:** Observability improvements have already been implemented, and we will complete the remaining work by the end of Q1, 2026. ## Next Steps and Communication No action is required from our customers at this time. ‌ We are committed to providing a reliable and stable service, and we are taking the necessary steps to learn from this event and prevent it from happening again. Thank you for your understanding. Sincerely, The 1Password Team

    provider

Reports count in aggregate; nothing about you is shown.

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.

Questions about DWN-488fc4ff99

Is 1Password still down?

No, this incident was resolved 2025-09-26 20:24 UTC. For 1Password's live state, see https://down.guide/1password.

How long did it last?

3h 33m, from 2025-09-26 16:51 UTC to 2025-09-26 20:24 UTC, by the times 1Password posted.

What was affected?

1Password named Sign in, Sign up, Syncing items between your devices, Billing and 5 more in us.

What caused it?

1Password hasn't published a root cause. If it does, it shows here.

Where does this come from?

1Password's official status page, https://status.1password.com, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.