- Level
- confirmed
- Worst impact
- Partial outage
- Components
- Authentication
- Down Index
- 31of 100
What to do
Check whether you use Mural Authentication. Check your stack
Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.Confirm your retries, queues and scheduled jobs caught up after the 2h 1m it lasted.
Anything that failed between 2021-09-27 22:02 UTC and 2021-09-28 00:03 UTC may need a replay.Subscribe to Mural's feed to hear about the next one first. RSS feed
https://down.guide/feed?provider=mural works in Slack (/feed subscribe), Discord feed bots and any RSS reader.
Updates from Mural 5
- investigating
Some members are currently unable to sign in to MURAL. We’re investigating the issue and will restore regular service ASAP. Thank you for your patience. Please check our status page for the most up-to-date info: status.mural.co/
provider
- identified
The issue has been identified and our team is working on fixing it. We'll update this message as soon as we have more details.
provider
- monitoring
We've implemented a fix that should resolve the issue. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this.
provider
- resolved
The fix we implemented earlier has been successful in resolving the issue and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.
provider
- postmortem
**What happened?** At 21:51 UTC on September 27 2021, we executed a routine operation in our database which inadvertently caused database writes to fail. This in turn overloaded the database and resulted in access requests also failing. Once the original operation finished at 22:42, the database returned to normal operations and access to the MURAL application was restored. **Details and corrective actions** The specifics of how the operation was performed resulted in a less-known bug on our database server to be triggered. We now understand the steps and will update our processes to avoid repeating this scenario. **Summary** The outage resulted in 50 minutes of downtime. No data from prior to the outage was lost during this time. **What we've done to avoid this happening again** We have updated our processes for running database operations to avoid triggering the now-known bug, and will be performing an upgrade to fully mitigate the issue. This upgrade will be announced on the MURAL status page as routine maintenance with the appropriate notice period.
provider
Reports count in aggregate; nothing about you is shown.
Corrections
None so far.
Something wrong on this page? Report an error or send us a note. Every fix is listed here.
Questions about DWN-e97a376ea2
Is Mural still down?
No, this incident was resolved 2021-09-28 00:03 UTC. For Mural's live state, see https://down.guide/mural.
How long did it last?
2h 1m, from 2021-09-27 22:02 UTC to 2021-09-28 00:03 UTC, by the times Mural posted.
What was affected?
Mural named Authentication.
What caused it?
Mural hasn't published a root cause. If it does, it shows here.
Where does this come from?
Mural's official status page, https://status.mural.co, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.