# Recent DNS Activity Unavailable

- Provider: [Twingate](https://down.guide/twingate)
- Level: confirmed
- Impact: Degraded
- lasted 20m
- started 2024-04-19 21:45 UTC
- Admin Console
- id: DWN-5494ad85f3
- Official page: https://stspg.io/mslr619k3cbd

## Updates from Twingate
### 2024-04-19 21:45 UTC: identified
Recent DNS Activity on admin is unavailable. We have identified the issue and working on a fix.

### 2024-04-19 21:58 UTC: monitoring
A fix has been implemented and we are monitoring the results.

### 2024-04-19 22:04 UTC: resolved
This incident has been resolved.

### 2024-04-25 14:44 UTC: postmortem
\*\*Components impacted\*\*
Management: Admin Console
\*\*Summary\*\*
On April 20, 2024, between 5:32 GMT and 6:57 GMT, Recent DNS Activity on the Admin Console became unavailable.
Shortly after the incident began, the Twingate on-call team received alerts regarding abnormal database activity. Workers on the clusters that manages DNS filtering logs starting seeing errors from the logs API, leading to excessive retries and database writes. To mitigate the issue, the DNS Log Streaming workers were temporarily disabled.
The root cause was identified as a malfunction in the DNS Filtering Log API caused by a problematic dependency upgrade. Consequently, viewing DNS filtering logs and analytics in the Admin Console was temporarily unavailable.
A rollback of the update was issued, and normal operations were restored at 6:57 GMT after which DNS filtering logs and analytics were available in the Admin Console.
\*\*Root cause\*\*
The DNS Filtering Log API went down due to a bad dependency upgrade.
\*\*Corrective actions\*\*
Already completed:
\* Rectified Admin Console's infinite retry logic by enhancing the retrieval of DNS activity logs during error states.
\* Optimized DNS Log Streaming retry and database write procedures to reduce unnecessary operations when no events are returned from the DNS Filtering API
Short-term:
\* Improve the dependency upgrade process for the DNS FIltering API

---
down.guide reads providers' official status pages every minute and adds its own evidence, always labeled. Free, no account. Agents: MCP at https://down.guide/mcp, REST at https://down.guide/api/v1, feeds at https://down.guide/feed. Built by Sazabi (https://sazabi.com/?utm_source=down-guide&utm_medium=markdown).
