[vocx2tx]

Unrelated to the plugin but wow the is_prime function in the video demonstration is awful. Even if the input is not divisible by 2, it'll still check it modulo 4, 6, 8, ... which is completely useless. It could be made literally 2x faster by adding a single line of code (a parity check), and then making the loop over odd numbers only. I hope you people using these LLMs are reviewing the code you get before pushing to prod.

[throwaway4good]

If you really need your own is prime implementation a bit of googling would have given you a much better implementation and some good discussions of pro and cons of various techniques.

Llm uis need a lot of work to match that.

[jart]

If you just run this, without Emacs:

    ./wizardcoder-python-34b-v1.0.Q5_K_M.llamafile

Then it'll launch the llama.cpp server and open a tab in your browser.

[skepticATX]

The reviewing that most folks do is a quick glance and a “lgtm”.

If most people actually seriously scrutinized the code (which you should) it’d be apparent that the value proposition of using LLMs is not increased throughout, but better quality code.

If you just accept the output without much scrutiny, sure you’ll increase your throughput, but at the cost of quality and the mental model of the system that you would have otherwise built.