Macroscope - Incident with API, Git, and Copilot requests – Incident details

All systems operational

Incident with API, Git, and Copilot requests

ResolvedDegraded performance30 minutes

Affected

Third Party

Operational from 1:25 PM to 1:56 PM

GitHub API Requests

Operational from 1:25 PM to 1:56 PM

  • ResolvedUTC

    On November 3, 2026, between 12:34 and 13:51 UTC, some users experienced authentication failures and errors with the REST and GraphQL APIs, pull requests, Issues, and GitHub Copilot. On average, the error rate was 0.46% and peaked at 0.98% of API requests. Copilot API errors averaged 2.0% and peaked at 3.1%.

    This was caused by a bug in our process for replacing control-plane servers in one of our compute clusters. When a replacement server did not receive a timely response from the existing cluster, it incorrectly created a separate cluster. This stopped traffic from reaching much of the cluster's capacity and overloaded the authentication servers that were still handling requests.

    We mitigated the incident by removing the incorrectly configured server.
    We are also fixing the replacement logic and adding safeguards to prevent servers in this state from serving traffic.

  • MonitoringUTC

    The degradation has been mitigated. We are monitoring to ensure stability.

  • InvestigatingUTC

    API Requests is operating normally.

  • MonitoringUTC

    The degradation affecting Copilot has been mitigated. We are monitoring to ensure stability.