Performance Monitoring Incident #20001

The issue with Firebase Performance Monitoring has been partially resolved.

Incident began at 2020-07-07 14:32 and ended at 2020-07-08 16:58 (all times are US/Pacific).

Date Time Description
Jul 08, 2020 16:58

The issue with Firebase Performance Monitoring has been resolved for all affected users as of Wednesday, 2020-07-08 16:45 US/Pacific.

We thank you for your patience while we worked on resolving the issue.

Jul 08, 2020 13:59

Description: The backlog of unavailable data continues to decrease, we do not have an ETA for full resolution at this point.

We will provide an update by Wednesday, 2020-07-08 17:00 US/Pacific with current details.

Diagnosis: Affected customers may not see any performance data for the past 24 hours. Additionally, some partial data may also be unavailable for the past 72 hours.

Workaround: None at this time.

Jul 08, 2020 13:57

Description: The error rate continues to decrease, we expect a full resolution within the next hour.

We will provide an update by Wednesday, 2020-07-08 14:00 US/Pacific with current details.

Diagnosis: Affected customers may not see any performance data for the past 24 hours. Additionally, some partial data may also be unavailable for the past 72 hours.

Workaround: None at this time.

Jul 08, 2020 11:48

Description: We believe the issue with Firebase Performance Monitoring is partially resolved.

We do not have an ETA for full resolution at this point.

We will provide an update by Wednesday, 2020-07-08 14:00 US/Pacific with current details.

Diagnosis: Affected customers may not see any performance data for the past 24 hours. Additionally, some partial data may also be unavailable for the past 72 hours.

Workaround: None at this time.

Jul 07, 2020 20:04

Description: A fix has been submitted, and the backlog of metrics are being processed. Customers may begin to see their recent data in the Firebase Console.

The backlog processing expected to take some time. We do not have an ETA for full mitigation at this point.

We will provide more information by Wednesday, 2020-07-08 12:00 US/Pacific.

Diagnosis: Affected customers will not see any performance data for the past 24 hours. Additionally, some partial data may also be unavailable for the past 72 hours.

Workaround: None at this time.

Jul 07, 2020 16:31

Description: A fix has been submitted, and the backlog of metrics are being processed. Customers may begin to see their recent data in the Firebase Console.

We do not have an ETA for full mitigation at this point.

We will provide more information by Tuesday, 2020-07-07 20:00 US/Pacific.

Diagnosis: Affected customers will not see any performance data for the past 24 hours. Additionally, some partial data may also be unavailable for the past 72 hours.

Workaround: None at this time.

Jul 07, 2020 15:22

Description: Mitigation work is currently underway by our engineering team.

We do not have an ETA for mitigation at this point.

We will provide more information by Tuesday, 2020-07-07 16:45 US/Pacific.

Diagnosis: Affected customers will not see any performance data for the past 24 hours. Additionally, some partial data may also be unavailable for the past 72 hours.

Workaround: None at this time.

Jul 07, 2020 14:39

Description: We are experiencing an issue with Firebase Performance Monitoring not showing data for the past ~24 hours.

Our engineering team continues to investigate the issue.

We will provide an update by Tuesday, 2020-07-07 15:30 US/Pacific with current details.

We apologize to all who are affected by the disruption.

Diagnosis: Affected customers will not see any performance data for the past 24 hours.

Workaround: None at this time.

All times are US/Pacific
Send Feedback