Building My Own Cloud HPC Setup for AI Research
A simple cloud HPC foundation for AI research, using Lambda GPUs and DigitalOcean CPUs with automated setup and persistent state for fast, repeatable compute environments.
Read moreI like building and tuning language models - figuring out how they think and how to make them better. I code in Python and C++, use JAX a lot, and know my way around GPUs and CUDA. When I'm not doing ML stuff, I mess with chip design - FPGAs, SystemVerilog, and hardware experiments just for fun.
I guess I just like to write — so here's some of my stuff.
A simple cloud HPC foundation for AI research, using Lambda GPUs and DigitalOcean CPUs with automated setup and persistent state for fast, repeatable compute environments.
Read moreMatrix multiplication is everywhere in computing, but it can be slow if done naively by hand. In this article, we'll start with simple calculations and work our way up to the speed of highly optimized CPU libraries like OpenBLAS.
Read moreEver wonder why your computer feels super fast sometimes and sluggish other times? A lot of that magic happens because of the CPU and its little sidekick, the cache — basically the brain and its speedy notepad
Read moredesign inspired by jhey