Hacker News new | ask | show | jobs
by intenex 16 days ago
Very interesting - why aren’t you able to access them outside of a web API right now?

Have you tried smaller quantized open weight models that aren’t frontier? They probably can’t automate all your coding but I imagine they could at least help a lot with the drudge work that just takes a lot of time but isn’t necessarily complex?

1 comments

Do you know of coding inference models I can access with curl? (namely with public access tokens, probably severely rate limited).

Or some coding inference models I can access with a noscript/basic HTML browser? (namely basic HTML forms)

If those inference models are still gated by whatwg cartel web engines, I will have to run full blown coding frontier models locally (if I want to have a chance at getting quality code). It is going to be very slow, and even slower while I am developping "prompt templates".

I did say "quality code", because I did ask some people already to generate classic and basic code paths using AIs, all were quite disappointing. That said, it was millions of years ago (in AI improvement time), namely a few months ago in human time :)