All events have been ingested and have been accounted for. There are no more partial time periods. We apologize for the delay and inconvenience here and have a plan to prevent this in the future. Have a great weekend!
Posted Dec 14, 2024 - 01:36 UTC
Update
We are mostly through processing our backlog but some periods may be seeing a 10% under-reporting on certain periods between Dec 10 - Dec 12. From the current rate of recovery we will be 100% complete in ~20 hours. We apologize for the inconvenience and are working to get these last 10% of events available as quickly as we can. Data is fully up to date with no under-reporting from Dec 12 at 6am UTC forward.
Posted Dec 13, 2024 - 00:53 UTC
Monitoring
We've tuned our ingestion stack to catch up as quickly as possible on the missing events. The events have been captured by our database, but are in the process of getting sorted into their final shard destinations. We apologize for the delay here and are working to resolve this as quickly as possible. We expect to be mostly caught up within one day and will update with progress reports on that front.
Posted Dec 12, 2024 - 05:39 UTC
Update
We're still in the process of recovering.
To give some more information, this impacts events from the 8th onwards (but only some events). No data has been lost, and once we're recovered all data should be present for querying.
Posted Dec 11, 2024 - 22:15 UTC
Identified
We've figured out the issue and are currently working on resolving this. No data has been lost. We should have this resolved completely within a few hours.
Posted Dec 11, 2024 - 16:48 UTC
Investigating
We've had some reports of some events being ingested with large delays (up to multiple hours). We're investigating and will update when we have more information.
Posted Dec 11, 2024 - 15:19 UTC
This incident affected: US Cloud 🇺🇸 (Event and Data Ingestion).