The billion row challenge: splitting lines using SIMD in Rust

I was scared to do it, but it was actually fine! This time we look at the quickest way to split up massive text files into separate lines, first by implementing our own zero-copy version of `BufReader::lines` and later using SIMD, which allows us to process 64 bytes simultaneously, using a single CPU instruction! I'm pretty sure this is the first time we've ventured into `nightly` Rust on this channel... Read my blog at https://artificialworlds.net/blog Follow me on mastodon: @[email protected]