Hacker News new | ask | show | jobs
by sylware 16 days ago
Zero usage of LLM (assembly coding, and sometimes plain and simple C).

I cannot access them to test if they would be of any help in my coding use cases.

You tell me once we get some inference access with a web API with public tokens (probably severely rate limited), or with full interop on noscript/basic HTML.

I may have to run locally open weight coding frontier models (slooooooow).

1 comments

Very interesting - why aren’t you able to access them outside of a web API right now?

Have you tried smaller quantized open weight models that aren’t frontier? They probably can’t automate all your coding but I imagine they could at least help a lot with the drudge work that just takes a lot of time but isn’t necessarily complex?

Do you know of coding inference models I can access with curl? (namely with public access tokens, probably severely rate limited).

Or some coding inference models I can access with a noscript/basic HTML browser? (namely basic HTML forms)

If those inference models are still gated by whatwg cartel web engines, I will have to run full blown coding frontier models locally (if I want to have a chance at getting quality code). It is going to be very slow, and even slower while I am developping "prompt templates".

I did say "quality code", because I did ask some people already to generate classic and basic code paths using AIs, all were quite disappointing. That said, it was millions of years ago (in AI improvement time), namely a few months ago in human time :)