- Level
- confirmed
- Worst impact
- Partial outage
- Components
- Keeper Admin Console (GovCloud)
- Down Index
- 28of 100
What to do
Check whether you use Keeper Keeper Admin Console (GovCloud). Check your stack
Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.Confirm your retries, queues and scheduled jobs caught up after the 47m it lasted.
Anything that failed between 2023-08-30 14:03 UTC and 2023-08-30 14:50 UTC may need a replay.Subscribe to Keeper's feed to hear about the next one first. RSS feed
https://down.guide/feed?provider=keeper works in Slack (/feed subscribe), Discord feed bots and any RSS reader.
Updates from Keeper 4
- identified
We have identified an issue affecting users on the Admin Console in the GovCloud region who have administrative rights over Advanced Reporting & Alerts module (ARAM).
provider
- identified
We are continuing to work on a fix for this issue.
provider
- resolved
The issue has been resolved. Console login to GovCloud for users with ARAM reporting administrative functions has been restored.
provider
- postmortem
The GovCloud DevOps team uses automated infrastructure deployment systems via Terraform to manage all environments. A change was made to subnet VPC routing which inadvertently caused connectivity issues between certain backend services and a specific Redshift cluster. This issue affected admins on the Keeper Admin Console who have ARAM permissions applied to their role policies. Delegated admins without reporting permissions were not affected. Vault login and other client-side vault applications were not affected. Recent improvements to the Vault and Admin Console backend APIs masked the issue for the automated detection systems which would have immediately flagged the error and alerted the DevOps team. We have resolved the infrastructure route and updated the monitoring systems to take this into account and will continue to monitor for any future issues.
provider
Reports count in aggregate; nothing about you is shown.
Corrections
None so far.
Something wrong on this page? Report an error or send us a note. Every fix is listed here.
Questions about DWN-88dce5b0a0
Is Keeper still down?
No, this incident was resolved 2023-08-30 14:50 UTC. For Keeper's live state, see https://down.guide/keeper.
How long did it last?
47m, from 2023-08-30 14:03 UTC to 2023-08-30 14:50 UTC, by the times Keeper posted.
What was affected?
Keeper named Keeper Admin Console (GovCloud).
What caused it?
Keeper hasn't published a root cause. If it does, it shows here.
Where does this come from?
Keeper's official status page, https://statuspage.keeper.io, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.