Research7 min read
Speculative Decoding: The Inference Trick Hiding in Plain Sight
Speculative decoding promises faster LLM inference without touching model weights. The math holds up — but the production story is messier than the papers admit.
Read
Category
Research
3 posts
Research7 min read
Mechanistic Interpretability: What We Actually Know So Far
Mechanistic interpretability has produced real, reproducible findings. Here is an honest accounting of what those findings actually mean for engineers.
Read
Research13 min read
We Shipped a “Provable” Bound. It Wasn’t Provable.
samkhya's whole reason to exist is a join-cardinality ceiling you can prove — so a model clamped under it can't wreck the query plan. In July I materialized the true output of 926 join trials and checked. The ceiling came in below the true answer in 2,179 of 3,704 evaluations. This is the bug, the repair that took it to zero, and every number I had to retract on the way.
Read