Skip to main content
LogRocket

Performance issues with primary search database

Partial outage Lasted 1d 22h · started · LogRocket's page

Level
confirmed
Worst impact
Partial outage
Components
Dashboard, Issues, Metrics, Alerts
Down Index
39of 100

What to do

  • Check whether you use LogRocket Dashboard, Issues, Metrics, Alerts. Check your stack

    Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.
  • Confirm your retries, queues and scheduled jobs caught up after the 1d 22h it lasted.

    Anything that failed between 2023-01-18 15:41 UTC and 2023-01-20 14:00 UTC may need a replay.
  • Subscribe to LogRocket's feed to hear about the next one first. RSS feed

    https://down.guide/feed?provider=logrocket works in Slack (/feed subscribe), Discord feed bots and any RSS reader.

Updates from LogRocket 9

  1. investigating

    We are currently investigating an issue impacting our primary search database. Searching for sessions, loading metric charts, issues and alerting are all impacted. Session data collection has not been impacted.

    provider

  2. identified

    We have identified the issue with our database vendor and are working with them to remedy the situation.

    provider

  3. identified

    We are continuing to work with our vendor to resolve the issue with ingesting new data.

    provider

  4. identified

    We are continuing to work with our vendor to resolve the issue.

    provider

  5. identified

    We are continuing to work with our vendor to remedy the situation. Session data collection continues to be unaffected, but secondary indexing that powers search and metrics continues to be delayed.

    provider

  6. identified

    We have restored some indexing to the database but are continuing to fully resolve the situation.

    provider

  7. monitoring

    We have identified the cause of the issue, applied a fix and have begun processing the backlog of events.

    provider

  8. monitoring

    We have completed processing of our primary indexing backlog, session filtering and metrics will be mostly up-to-date. Our secondary processing system is currently processing and includes some metrics, issues and alerting.

    provider

  9. resolved

    We've seen no additional performance degradation after our mitigation work.

    provider

Reports count in aggregate; nothing about you is shown.

Corrections

None so far.

Something wrong on this page? Report an error or send us a note. Every fix is listed here.

Questions about DWN-fd01b946f1

Is LogRocket still down?

No, this incident was resolved 2023-01-20 14:00 UTC. For LogRocket's live state, see https://down.guide/logrocket.

How long did it last?

1d 22h, from 2023-01-18 15:41 UTC to 2023-01-20 14:00 UTC, by the times LogRocket posted.

What was affected?

LogRocket named Dashboard, Issues, Metrics, Alerts.

What caused it?

LogRocket hasn't published a root cause. If it does, it shows here.

Where does this come from?

LogRocket's official status page, https://status.logrocket.com, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.