[wheresmyshadow]

I'm sorry for being ignorant but how does this work? Is there an LLM underneath? Does it use ChatGPT? If so, how do you maintain the privacy and how are you able to cover expenses? I'm just curious, it looks pretty great though.

[pedrok]

Hey! Yeah, it runs on an open-source llama3 image, and since the requests aren’t too wild, it costs me about $2 a month to keep it up. Thanks!

[wheresmyshadow]

I see, thanks for the info! I played with it for a bit and I really enjoy the results. A dark mode would be amazing to have but still great job!

[pedrok]

Thank you so much for your feedback!

[android521]

Could you share a bit on where you host it ? it is 8 B ,right?

[pedrok]

Hi there, I utilize the Groq/Llama-3-Groq-70B-Tool-Use model. I initially hosted it on Hugging Face for some time, but eventually, I transitioned to using the Groq API directly.