Resolved
All workspaces are now healthy.
Monitoring
We are continuing rolling back affected workspaces as GitHub is recovering from its incident.
Monitoring
We continue to see network failures between the UI and our services.
Roll back is still in progress. Due to an ongoing incident on GitHub's side, this is taking longer than expected (https://www.githubstatus.com/).
Monitoring
The issue should be fixed now for most customers.
The root cause was a bad deployment, we started rolling back the change as soon as we saw the impact.
The Engineering team will compile a post-mortem and conduct root cause analysis to make sure this does not happen again.
Identified
We have identified the issue and are starting to see recovery for some customers already.
Investigating
The Engineering team is aware of this issue and is currently working on mitigation.