Hacker News new | ask | show | jobs
by FlyingLawnmower 147 days ago
Very nicely written guide!

If the authors or readers are interested in some of the more technical details of how we optimized guidance & llguidance, we wrote up a little paper about it here: https://guidance-ai.github.io/llguidance/llg-go-brrr

1 comments

One of the authors here. I've read the paper. Brilliant work, especially the slicing implementation for denser token masks.