|
|
|
|
|
by detente18
528 days ago
|
|
Should we expect the current API (https://docs.goodfire.ai/introduction) to be good for prod or is it for testing only? I see that the sampling API is OpenAI-compatible (nice!). Considering if we can add a native integration for this to LiteLLM with a provider specific route - `goodfire/`. Would let people test this in projects like aider and dspy. ```python from litellm import completion import os os.environ["GOODFIRE_API_KEY"] = "your-api-key" response = completion(
model="goodfire/meta-llama/Llama-3.3-70B-Instruct",
messages=[{ "content": "Hello, how are you?","role": "user"}]
) ``` |
|