|
|
|
|
|
|
by rthnbgrredf
712 days ago
|
|
|
Such services already exists. I don't want to promote any in particular, but if you do a research on pay-as-you-go inference of e.g. mixtral or llama3 you will find offerings that offer an API and charge just cents for XY amount of tokens, exactly as OpenAI does. |
|
|