[Havoc]

There are a couple now. Groq , sambanova and tenstorrent come to mind.

The more the merrier. If we do need power plants worth of juice then it may as well be dedicated custom hardware to optimise this to the max

[ilaksh]

Thanks for telling me about Sambanova. Too bad they don't have an API. The speed is absolutely incredible. They actually have a demo where it just keeps re-running the chat completion as you are typing your query.

[Havoc]

>Too bad they don't have an API.

Think they do, but I couldn't sign up...the verify email just never arrived and eventually got fed up.

[ilaksh]

Where is the API sign up?