This incident has been resolved.
Mar 17, 06:41 UTC
We have fixed the disk space issue and all new builds should now run normally.
Mar 17, 05:50 UTC
A number of instances in our cluster have been identified as having disk issues, that is causing pipelines to error with message "No space left on device". A change is currently in progress of being deployed to alleviate this issue.
Mar 17, 03:32 UTC
We have mitigated the issue. All new pipelines should build as expected. Pipelines started between 00:02 UTC - 1:03 UTC that are currently 'Waiting for Agent' are expected to fail. They can be manually stopped and if rerun should build as expected.
Mar 17, 01:31 UTC
We have identified the cause of the issue and are now working to resolve the incident.
Mar 17, 00:53 UTC
We are investigating an issue where new running pipelines may experience a large delay waiting for an agent.
Mar 17, 00:41 UTC