SOCKS Proxy Servers (US) on Fixie Status

[Resolved] SOCKS proxy groups experiencing high latency

Mon, 26 Jan 2026 00:50:00 +0000

Resolved - All SOCKS proxy groups have recovered. (00:57 UTC — Jan 26)

Investigating - SOCKS proxy groups bici, century, and speedway are experiencing high latency due to a cascading failure from the previous database connectivity incident. (00:50 UTC — Jan 26)

[Resolved] All proxy groups unavailable

Mon, 26 Jan 2026 00:47:00 +0000

Resolved - All proxy groups have been restored. The root cause was a bad infrastructure as code change that made our databases unreachable from our proxy groups. (00:50 UTC — Jan 26)

Investigating - We are investigating reports that all proxy groups are unavailable. (00:47 UTC — Jan 26)

[Resolved] Major outage on Speedway group

Wed, 31 Dec 2025 09:54:46 +0000

Resolved - This incident was resolved at 10:15 AM UTC after approximately 75 minutes of downtime.

The root cause was a dependency update. We had rolled out incrementally for >6 hours without incident, but hit an edge case in error handling that resulted in an unhandled exception. We mitigated the issue with a forward fix and will review our policy for rolling out dependabot upgrades. (10:28 UTC — Dec 31)

Monitoring - We’ve fixed the issue and monitoring the system. The issue was related to an edge condition around latest dependency security update that didn’t surface during the daytime testing and monitoring. (10:19 UTC — Dec 31)

Investigating - We are investigating an outage (09:54 UTC — Dec 31)

[Resolved] Elevated latency in Speedway group

Tue, 30 Dec 2025 05:24:07 +0000

Resolved - The service is fully restored and we will continue monitoring the proxy group (05:28 UTC — Dec 30)

Monitoring - Speedway group had intermittent (short) failures throughout the day. We’ve identified the issue and in the process of testing monitoring and fixes. (05:26 UTC — Dec 30)

Monitoring - Speedway group had intermittent (short) failures throughout the day. We’ve identified the issue and in the process of testing monitoring and fixes. (05:24 UTC — Dec 30)

[Resolved] Elevated latency in Speedway group

Fri, 12 Dec 2025 17:18:10 +0000

Resolved - Outage was resolved by scaling this group vertically (17:25 UTC — Dec 12)

Investigating (17:18 UTC — Dec 12)

Investigating - We are investigating degraded performance in the Speedway socks proxy group (17:18 UTC — Dec 12)

[Resolved] Elevated latency in the Speedway group

Tue, 01 Apr 2025 14:57:00 +0000

Resolved - The Speedway socks proxy experienced a protracted period of elevated latency on one of its two nodes, causing high latency on ~50% of requests for 90 minutes. This was resolved by scaling vertically. (16:38 UTC — Apr 1)

[Resolved] Elevated latency in Speedway proxy group

Tue, 01 Apr 2025 02:28:40 +0000

Resolved - Fleet update completed and response times have recovered. We will continue to monitor. (02:42 UTC — Apr 1)

Identified - Latency was caused by a significant load spike. We are mitigating the issue by scaling this cluster vertically. Half of the fleet has updated and we are seeing response times recover. (02:39 UTC — Apr 1)

Investigating (02:28 UTC — Apr 1)

[Resolved] All Fixie proxies degraded

Sun, 29 Sep 2019 11:30:00 +0000

Resolved - From approximately 11:30 UTC to 14:30 UTC, Fixie was degraded across all proxy groups. Response times spiked and a high number of requests timed out. The root cause was a load spike which, downstream, caused a spike in load to our database hosts, eventually causing them to run out of CPU credits. This is now resolved. (14:30 UTC — Sep 29)