Resolved -
Cluster is back to normal health. Pipeline is up to date. Everything is working nominally!
Nov 30, 23:18 UTC
Monitoring -
We've increased the speed of merges on our ClickHouse cluster and added settings to prevent us from collecting so many parts in the future. We are now monitoring recovery which should be complete within 2-3 hours. Will update once that is done!
Nov 30, 19:33 UTC
Update -
The cluster is currently recovering, although data ingestion is still paused. We're continuing identification of the root cause, and working on accelerating recovery.
Nov 30, 16:42 UTC
Investigating -
Our analytics database cluster is experiencing unusual load, resulting in data ingestion running behind. We're investigating the issue.
Nov 30, 15:29 UTC