Skip to main content
Mural

Users experience icons disappearing on the mural and are no longer available in the icon library when searched

Partial outage Lasted 7h 45m · started · Mural's page

Level
confirmed
Worst impact
Partial outage
Components
Realtime collaboration
Down Index
34of 100

What to do

  • Check whether you use Mural Realtime collaboration. Check your stack

    Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.
  • Confirm your retries, queues and scheduled jobs caught up after the 7h 45m it lasted.

    Anything that failed between 2021-11-19 09:40 UTC and 2021-11-19 17:25 UTC may need a replay.
  • Subscribe to Mural's feed to hear about the next one first. RSS feed

    https://down.guide/feed?provider=mural works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Updates from Mural 10

  1. investigating

    We're experiencing a service disruption causing icons to disappear on the mural and are no longer available on the icon library when searched. We're investigating the issue and will restore regular service ASAP.

    provider

  2. identified

    The cause of the issue has been identified and our team is working on fixing it.

    provider

  3. identified

    Our team continues to work on fixing the issue. We will post an update as soon as we have more information or in an hour’s time. We appreciate your patience and apologize for this inconvenience.

    provider

  4. identified

    Our team continues to work on this issue. We will post an update as soon as we have more information or in an hour’s time.

    provider

  5. identified

    Our team is still working on this issue. We will post an update as soon as we have more information or in an hour’s time.

    provider

  6. identified

    We are continuing to work on a fix for this issue. We will post an update as soon as we have more information or in an hour’s time.

    provider

  7. identified

    Our team continues to work on this issue. We will post an update as soon as we have more information or in an hour’s time. We appreciate your patience.

    provider

  8. monitoring

    We've implemented a fix that should resolve the issue with icons. We're monitoring the results to make sure this has the intended effect and will update this page within the next hour to confirm.

    provider

  9. resolved

    The fix we implemented has been successful in resolving the issue with icons and full service has been resolved. We apologize for the inconvenience this interruption caused and will be conducting a full review to avoid a repeat in the future.

    provider

  10. postmortem

    **What happened?** At 19:00 UTC on November 18 2021 we started to receive a small number of notifications of some [Noun Project icons](https://support.mural.co/en/articles/2113734-add-icons) disappearing from murals and not being visible in the search bar. During our initial investigations we were unable to reproduce the issue. We continued to receive reports and at 09:40 UTC on November 19 2021 we classified this as a critical incident. The relevant code for displaying icons was retained and no data was lost, however the icons were not being displayed. ‌ **Details and corrective actions** At 16:26 UTC we updated the configuration for the Noun Project integration, which restored full service with no data loss. ‌ **Summary** This incident resulted in a partial outage for a core service, lasting 7 hours and 44 minutes. MURAL remained operational throughout this incident and members were able to log in and access their data; however, some Noun Project icons were not visible in the search menu or on murals. ‌ **What we've done to avoid this happening again** We have resolved the configuration issue and restored full service with the use of icons. We are working on several short- and medium-term initiatives to improve the reliability of this service going forward.

    provider

Reports count in aggregate; nothing about you is shown.

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.

Questions about DWN-b51e51c075

Is Mural still down?

No, this incident was resolved 2021-11-19 17:25 UTC. For Mural's live state, see https://down.guide/mural.

How long did it last?

7h 45m, from 2021-11-19 09:40 UTC to 2021-11-19 17:25 UTC, by the times Mural posted.

What was affected?

Mural named Realtime collaboration.

What caused it?

Mural hasn't published a root cause. If it does, it shows here.

Where does this come from?

Mural's official status page, https://status.mural.co, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.