Skip to main content
Metabase Cloud

Issue with SSL certificates

Major outage Lasted 25m · started · Metabase Cloud's page

Level
confirmed
Worst impact
Major outage
Components
Metabase Cloud Platform
Down Index
47of 100

What to do

  • Check whether you use Metabase Cloud Metabase Cloud Platform. Check your stack

    Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.
  • Confirm your retries, queues and scheduled jobs caught up after the 25m it lasted.

    Anything that failed between 2023-11-09 19:37 UTC and 2023-11-09 20:02 UTC may need a replay.
  • Subscribe to Metabase Cloud's feed to hear about the next one first. RSS feed

    https://down.guide/feed?provider=metabase works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Updates from Metabase Cloud 3

  1. investigating

    We're investigating an issue in our cloud with certificate management that's causing browsers to receive incorrect certificates

    provider

  2. resolved

    Ingress controller certificates are now back to normal. You should be able to get the correct certificate in the browser now. We're very sorry for the inconvenience, we'll publish a retrospective about the issue in the next few days.

    provider

  3. postmortem

    **Summary** On Thursday Nov 9th the default certificate for the external Nginx ingress was replaced with a dummy certificate. Users attempting to reach their hosted instances would get an invalid certificate error. This was due to a misconfiguration in the new CI for releasing our helm charts that used the internal Nginx ingress values files for the external Nginx ingress. **Impact** All hosted customers not using custom domains were affected. **How was the root cause diagnosed?** We identified that the values were properly set in the values files. We Investigated the CI steps to determine why the correct values were not set. It was determined that the wrong values files were being used for external Nginx ingress. **How we’ll make this not happen again?** * Update staging and production value files to match. * Add alert to pagerduty for non-custom domains \(catch alerts faster\)

    provider

Reports count in aggregate; nothing about you is shown.

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.

Questions about DWN-5148ba83d8

Is Metabase Cloud still down?

No, this incident was resolved 2023-11-09 20:02 UTC. For Metabase Cloud's live state, see https://down.guide/metabase.

How long did it last?

25m, from 2023-11-09 19:37 UTC to 2023-11-09 20:02 UTC, by the times Metabase Cloud posted.

What was affected?

Metabase Cloud named Metabase Cloud Platform.

What caused it?

Metabase Cloud hasn't published a root cause. If it does, it shows here.

Where does this come from?

Metabase Cloud's official status page, https://status.metabase.com, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.