[blurbleblurble]

Listen, I really like LLMs and diffusion models and machine learning and all this stuff, and I want to see it happen in a just and sustainable way. "AI" doesn't necessitate extreme waste. If anything, reasonable policy constraints would push "AI" to be even better.

[_fat_santa]

I feel like the way many companies implement AI right now is very very wasteful. For context I'm looking into adding some AI elements to my SaaS app and I'm looking at running on-device TinyBERT intent classifiers then have my API take it from there (still experimenting with this).

I feel like this is a pretty sustainable way to implement AI in an application, meanwhile I see most companies just implement with OpenAI API + some custom prompts on top.

Granted I've had to do this for some of my clients and it's a pretty easy way to implement AI, though I always have the sinking feeling that we could achieve the same thing in a way more efficent manner and a bit more effort.

[bigyabai]

> If anything, reasonable policy constraints would push "AI" to be even better.

Like what, though? I'm not opposed to AI regulation at all, but the very last thing I expect it to fix is the resource constraints around GPGPU compute.