Samuel Bartlett PRO

AI engineer by day (production LLM agents, evals, observability). In my spare time I poke at how transformers are put together. Currently: a transformer that tries to learn its own architecture. It didn't beat a plain dense model. The code, every checkpoint and the reasons why are all here. Negative results included, on purpose.