# Sync execution halted

- Provider: [Census](https://down.guide/census)
- Level: confirmed
- Impact: Major outage
- lasted 1h 34m
- started 2024-08-23 17:41 UTC
- Sync Engine
- id: DWN-4b1bb2cc05
- Official page: https://stspg.io/g9s40c48nzt2

## Updates from Census
### 2024-08-23 17:41 UTC: identified
Production sync execution has been paused while we investigate an issue

### 2024-08-23 17:58 UTC: identified
We have identified an issue which could cause records to be synced multiple times to destinations. Since this can affect the correctness of syncs for certain destinations, we have paused all syncs proactively until the issue can be diagnosed and resolved. We are continuing to investigate and are in the act of rolling back to a previous version of the sync engine.

### 2024-08-23 18:42 UTC: identified
We have determined that the bug does not affect all syncs, nor does it cause records to be sent multiple times - this was a red herring.
A high percentage of syncs are still failing, but there is not a correctness issue, so we are reenabling the sync engine globally so that syncs that are not affected by the issue can return to operation.

### 2024-08-23 18:48 UTC: identified
We have identified the likely root cause and are deploying a fix at this time

### 2024-08-23 19:04 UTC: monitoring
Sync success rates have returned to expected levels. There is some delay in sync execution as we work through the backlog during the outage period. We are continuing to monitor

### 2024-08-23 19:15 UTC: resolved
This incident has been resolved.

---
down.guide reads providers' official status pages every minute and adds its own evidence, always labeled. Free, no account. Agents: MCP at https://down.guide/mcp, REST at https://down.guide/api/v1, feeds at https://down.guide/feed. Built by Sazabi (https://sazabi.com/?utm_source=down-guide&utm_medium=markdown).