I scaled SSE to 150k connections (blog on the issue, process and final fix)

https://blog.pranshu-raj.me/posts/scaling-sse-1m-connections/

2 2 7 months ago

I built a real time leaderboard that uses SSE (Server Sent Events) as the main access pattern. When I tried to scale it I hit a limit of 28232 connections, with resource usage being nominal.

This was very peculiar, and the post describes my journey figuring out the cause of the issue and how I went past that limit, eventually scaling to 150k connections on a single machine (and my ideas on how to take this further, as I hit memory limits at this point).

pranshu-raj-2112• 7 months ago

For context, this system was built in Go, Docker being used both by the server and client components. All the testing was done on a laptop running Fedora Linux.

I'd love to learn how this can be taken further, especially how to handle request spikes and reducing memory usage.

I scaled SSE to 150k connections (blog on the issue, process and final fix)

Related Stories