Performance Monitoring Incident #20002
We are experiencing an issue with Firebase Performance Monitoring's exports to Google BigQuery experiencing processing delays and timeout failures occurring since 2020-07-22. Mitigation work is underway.
Incident began at 2020-07-30 15:49 and ended at 2020-07-31 23:19 (all times are US/Pacific).
| Date | Time | Description | |
|---|---|---|---|
| Jul 31, 2020 | 23:19 | The issue with Firebase Performance Monitoring exports to Google BigQuery experiencing processing delays and timeout failures has been resolved for all affected users as of Friday, 2020-07-30 10:22 US/Pacific. Affected customers may need to run a manual backfill to pick up the data from the missing slice dates. You may find more info on that process at: (https://cloud.google.com/bigquery-transfer/docs/working-with-transfers#bq_5) We thank you for your patience while we worked on resolving the issue. |
|
| Jul 31, 2020 | 11:31 | Description: We are experiencing an issue with Firebase Performance Monitoring's exports to Google BigQuery (a beta feature) experiencing processing delays and timeout failures occurring since 2020-07-22. Mitigation work is currently underway by our engineering team, and is taking longer than expected. We do not have an ETA for mitigation at this point, but expect resolution on Monday, 2020-08-03. We will provide more information by Monday, 2020-08-03 11:30 US/Pacific. Diagnosis: Significantly increased processing time followed by timeout errors for exports from Firebase Performance Monitoring to Google BigQuery. Workaround: None at this time. |
|
| Jul 31, 2020 | 09:47 | Description: We are experiencing an issue with Firebase Performance Monitoring's exports to Google BigQuery (a beta feature) experiencing processing delays and timeout failures occurring since 2020-07-22. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point, but expect resolution within the next 24 hours. We will provide more information by Friday, 2020-07-31 16:00 US/Pacific. Diagnosis: Significantly increased processing time followed by timeout errors for exports from Firebase Performance Monitoring to Google BigQuery. Workaround: None at this time. |
|
| Jul 30, 2020 | 22:57 | Description: We are experiencing an issue with Firebase Performance Monitoring's exports to Google BigQuery (a beta feature) experiencing processing delays and timeout failures occurring since 2020-07-22. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point, but expect resolution within the next 24 hours. We will provide more information by Friday, 2020-07-31 10:00 US/Pacific. Diagnosis: Significantly increased processing time followed by timeout errors for exports from Firebase Performance Monitoring to Google BigQuery. Workaround: None at this time. |
|
| Jul 30, 2020 | 21:45 | Description: We are experiencing an issue with Firebase Performance Monitoring's exports to Google BigQuery (a beta feature) experiencing processing delays and timeout failures occurring since 2020-07-22. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point, but expect resolution within the next 24 hours. We will provide more information by Thursday, 2020-07-30 23:00 US/Pacific. Diagnosis: Significantly increased processing time followed by timeout errors for exports from Firebase Performance Monitoring to Google BigQuery. Workaround: None at this time. |
|
| Jul 30, 2020 | 20:45 | Description: We are experiencing an issue with Firebase Performance Monitoring's exports to Google BigQuery (a beta feature) experiencing processing delays and timeout failures occurring since 2020-07-22. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point, but expect resolution within the next 24 hours. We will provide more information by Thursday, 2020-07-30 22:00 US/Pacific. Diagnosis: Significantly increased processing time followed by timeout errors for exports from Firebase Performance Monitoring to Google BigQuery. Workaround: None at this time. |
|
| Jul 30, 2020 | 19:50 | Description: We are experiencing an issue with Firebase Performance Monitoring's exports to Google BigQuery (a beta feature) experiencing processing delays and timeout failures occurring since 2020-07-22. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point, but expect resolution within the next 24 hours. We will provide more information by Thursday, 2020-07-30 21:00 US/Pacific. Diagnosis: Significantly increased processing time followed by timeout errors for exports from Firebase Performance Monitoring to Google BigQuery. Workaround: None at this time. |
|
| Jul 30, 2020 | 18:50 | Description: We are experiencing an issue with Firebase Performance Monitoring's exports to Google BigQuery (a beta feature) experiencing processing delays and timeout failures occurring since 2020-07-22. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point, but expect resolution within the next 24 hours. We will provide more information by Thursday, 2020-07-30 20:00 US/Pacific. Diagnosis: Significantly increased processing time followed by timeout errors for exports from Firebase Performance Monitoring to Google BigQuery. Workaround: None at this time. |
|
| Jul 30, 2020 | 17:50 | Description: We are experiencing an issue with Firebase Performance Monitoring's exports to Google BigQuery (a beta feature) experiencing processing delays and timeout failures occurring since 2020-07-22. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point, but expect resolution within the next 24 hours. We will provide more information by Thursday, 2020-07-30 19:00 US/Pacific. Diagnosis: Significantly increased processing time followed by timeout errors for exports from Firebase Performance Monitoring to Google BigQuery. Workaround: None at this time. |
|
| Jul 30, 2020 | 16:20 | Description: We are experiencing an issue with Firebase Performance Monitoring's exports to Google BigQuery (a beta feature) experiencing processing delays and timeout failures occurring since 2020-07-22. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point, but expect resolution within the next 24 hours. We will provide more information by Thursday, 2020-07-30 18:00 US/Pacific. Diagnosis: Significantly increased processing time followed by timeout errors for exports from Firebase Performance Monitoring to Google BigQuery. Workaround: None at this time. |