- Level
- confirmed
- Worst impact
- Major outage
- Components
- Keeper Security Website (US), Keeper Web Vault (EU), Keeper Web Vault (GovCloud), Keeper Web Vault (US), Keeper Admin Console (EU), Keeper Admin Console (GovCloud), Keeper Admin Console (US)
- Regions
- eu, us
What to do
Check whether you use Keeper Keeper Security Website (US), Keeper Web Vault (EU), Keeper Web Vault (GovCloud), Keeper Web Vault (US) and 3 more in eu, us. Check your stack
Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.Confirm your retries, queues and scheduled jobs caught up after the 1h 1m it lasted.
Anything that failed between 2024-09-24 13:43 UTC and 2024-09-24 14:43 UTC may need a replay.Subscribe to Keeper's feed to hear about the next one first. RSS feed
https://down.guide/feed?provider=keeper works in Slack (/feed subscribe), Discord feed bots and any RSS reader.
Updates from Keeper 6
- investigating
We are currently investigating reports of slow server response times and request timeouts
provider
- identified
Root cause has been identified and we are actively working on a resolution.
provider
- monitoring
A resolution has been rolled out - the team is monitoring system performance.
provider
- monitoring
We are continuing to monitor for any further issues.
provider
- resolved
This incident has been resolved.
provider
- postmortem
On Tues, Sept 24 at 6:06AM PDT, the DevOps Engineering team started receiving notifications regarding API slowness and HTTP 504 errors coming from the Keeper AWS infrastructure. After an investigation, it was determined that our NGINX instances were throwing the errors due to an overload of network traffic. It was then determined that the network traffic increase was caused by an update to the Keeper Desktop application which was published on Monday, the day before. The DevOps team scaled the AWS infrastructure several times over the period of 60 minutes to address the issue. The issue was fully stabilized and resolved by 7:20AM PDT. After a full analysis of the product update process, the engineering team has decided to change the update mechanism of the Keeper Desktop application to utilize a new distributed content delivery network which does not impact the other Keeper AWS infrastructure. This change will be implemented over the next 2 weeks and in preparation of the next Keeper Desktop application update.
provider
Reports count in aggregate; nothing about you is shown.
Corrections
None so far.
Something wrong on this page? Report an error or send us a note. Every fix is listed here.
Questions about DWN-45da306c54
Is Keeper still down?
No, this incident was resolved 2024-09-24 14:43 UTC. For Keeper's live state, see https://down.guide/keeper.
How long did it last?
1h 1m, from 2024-09-24 13:43 UTC to 2024-09-24 14:43 UTC, by the times Keeper posted.
What was affected?
Keeper named Keeper Security Website (US), Keeper Web Vault (EU), Keeper Web Vault (GovCloud), Keeper Web Vault (US) and 3 more in eu, us.
What caused it?
Keeper hasn't published a root cause. If it does, it shows here.
Where does this come from?
Keeper's official status page, https://statuspage.keeper.io, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.