[_fat_santa]

I feel like the way many companies implement AI right now is very very wasteful. For context I'm looking into adding some AI elements to my SaaS app and I'm looking at running on-device TinyBERT intent classifiers then have my API take it from there (still experimenting with this).

I feel like this is a pretty sustainable way to implement AI in an application, meanwhile I see most companies just implement with OpenAI API + some custom prompts on top.

Granted I've had to do this for some of my clients and it's a pretty easy way to implement AI, though I always have the sinking feeling that we could achieve the same thing in a way more efficent manner and a bit more effort.