- Level
- confirmed
- Worst impact
- Major outage
- Components
- Sync Engine
- Down Index
- 47of 100
What to do
Check whether you use Census Sync Engine. Check your stack
Paste a package.json, lockfile, Terraform or a list of domains at down.guide/stack to see every provider you depend on.Confirm your retries, queues and scheduled jobs caught up after the 1h 34m it lasted.
Anything that failed between 2024-08-23 17:41 UTC and 2024-08-23 19:15 UTC may need a replay.Subscribe to Census's feed to hear about the next one first. RSS feed
https://down.guide/feed?provider=census works in Slack (/feed subscribe), Discord feed bots and any RSS reader.
Updates from Census 6
- identified
Production sync execution has been paused while we investigate an issue
provider
- identified
We have identified an issue which could cause records to be synced multiple times to destinations. Since this can affect the correctness of syncs for certain destinations, we have paused all syncs proactively until the issue can be diagnosed and resolved. We are continuing to investigate and are in the act of rolling back to a previous version of the sync engine.
provider
- identified
We have determined that the bug does not affect all syncs, nor does it cause records to be sent multiple times - this was a red herring. A high percentage of syncs are still failing, but there is not a correctness issue, so we are reenabling the sync engine globally so that syncs that are not affected by the issue can return to operation.
provider
- identified
We have identified the likely root cause and are deploying a fix at this time
provider
- monitoring
Sync success rates have returned to expected levels. There is some delay in sync execution as we work through the backlog during the outage period. We are continuing to monitor
provider
- resolved
This incident has been resolved.
provider
Reports count in aggregate; nothing about you is shown.
Corrections
None so far.
Something wrong on this page? Report an error or send us a note. Every fix is listed here.
Questions about DWN-4b1bb2cc05
Is Census still down?
No, this incident was resolved 2024-08-23 19:15 UTC. For Census's live state, see https://down.guide/census.
How long did it last?
1h 34m, from 2024-08-23 17:41 UTC to 2024-08-23 19:15 UTC, by the times Census posted.
What was affected?
Census named Sync Engine.
What caused it?
Census hasn't published a root cause. If it does, it shows here.
Where does this come from?
Census's official status page, https://status.getcensus.com, quoted verbatim. down.guide's own probes, reports and social counts are labeled as ours.