[datakan]

I don't know but I would imagine there are a lot of inefficiencies in modern languages from an LLM perspective that it could strip out, reduce token costs, improve speed etc.

[SoftTalker]

So, assembly?

[goosejuice]

That would be less efficient

[pjmlp]

There are already plenty of PLDI and SIGPLAN talks on LLM => Assembly, with some guardrails for determinism, instead of having a "classical" language as translation layer.

[goosejuice]

Sorry are we referring to the efficiency of generating programs (i.e. optimizing LLM software development) or the efficiency of the output (i.e. optimizing software through the generation of assembly)?

[pjmlp]

We are referring to not having to use 3GL languages as intermediate step for LLMs to generate native code.

"Programming Language Design and Implementation in the Era of Machine Learning"

https://www.youtube.com/watch?v=Fc3cW0nqAQ0

[goosejuice]

I'm not seeing strong claims here on improved token efficiency for general use cases, but it's absolutely not my area of expertise.

Completely understandable why this would be valuable research though. Will be interesting to see how it evolves.