Hacker News new | ask | show | jobs
by thatjoeoverthr 419 days ago
Yes, and the forward-only inference strategy. It seems like a normal question, so it starts answering, then carries on from there.
1 comments

How come there is not the equivalent of a stable diffusion "sampler * selection for LLMs? The restart sampler for stable diffusion is so good compared to most of the original samplers. I often try to get an answer from the LM studio people but I think I really should ask the llama.cpp people.