I got nerd sniped by the 1 billion row challenge and ended up spending far too much time playing with file readers in various tools and languages. The results were interesting enough to do a video about
I knew Go would be fast but this was nuts. I was disappointed by the IO perf in Gleam but the response from the team was so good. Overall pretty pumped I took the time to do this
SOURCES
https://github.com/richard-viney/file_streams/issues/4
https://x.com/t3dotgg/status/1796689128207368687
https://gist.github.com/giacomocavalieri/192dd30f4fe5c85b79d1bea2238e4055
https://x.com/jarredsumner/status/1797139905937862658
Check out my Twitch, Twitter, Discord more at https://t3.gg
S/O Ph4se0n3 for the awesome edit 🙏