Realtime Database Incident #17091
Service Disruption for Realtime Database
Incident began at 2017-10-23 03:00 and ended at 2017-10-23 06:00 (all times are US/Pacific).
| Date | Time | Description | |
|---|---|---|---|
| Oct 23, 2017 | 11:43 | We experienced an issue with Firebase Realtime Database where NSS-226 saw an increased network traffic that started at 03:00 AM causing severe latency increase to all hosted customers as well as elevated HTTP 503 errors. The issue has been resolved for all affected projects as of 06:00 AM US/Pacific. All other customers may have also noticed sporadic 503 during that time. This unfortunately was not caught by our monitoring system. We will conduct an internal investigation of this issue and make appropriate improvements to our systems to prevent or minimize future recurrence. |