Realtime Database Incident #18058
Service Outage for Realtime Database
Incident began at 2018-10-11 16:13 and ended at 2018-10-11 16:57 (all times are US/Pacific).
| Date | Time | Description | |
|---|---|---|---|
| Oct 13, 2018 | 12:52 | SUMMARY: On Thursday 11 October 2018, Firebase Realtime Database became unavailable due to lost connectivity to the Google network backbone that connects to the public internet for a duration of 44 minutes. We apologize if your service or application was impacted by this incident. We are following our postmortem process to determine the exact steps we can take to prevent incidents of this type from recurring. DETAILED DESCRIPTION OF IMPACT: On Thursday 11 October 2018 from 16:13 to 16:57 PDT, Firebase Realtime Database became unavailable due to lost connectivity to the Google network backbone that connects to the public internet. All Realtime Database customers were impacted by this outage and were not able to access data for the duration of the incident. ROOT CAUSE: The outage occurred due to Google Cloud Networking Incident #18016 affecting all Realtime Database backends. REMEDIATION AND PREVENTION: The preventative action items identified so far include the following: Provision Realtime Database proxies in multiple regions to provide additional resilience to connectivity issues to the public internet. |
|
| Oct 11, 2018 | 17:00 | System is recovering. New connections are being processed. |
|
| Oct 11, 2018 | 16:45 | The network is unhealthy. New connections are not making it through. Working on a mitigation. |
|
| Oct 11, 2018 | 16:27 | We are investigating an issue with the Realtime Database. We will provide more information as it becomes available. |