|
|
|
|
|
by awwaiid
341 days ago
|
|
It is using the llm library, so you do the plugin and model management through that. Let's say you've already gotten ollama installed and the `gemma3n:e2b` model. Then you use the llm cli to add the ollama extension: llm install llm-ollama
and then you use whatever model you like, anything llm has installed. See https://llm.datasette.io/en/stable/plugins/installing-plugin... for plugin install info.Here is a sample session. You can't see it ... but it is very slow on my CPU-only non-apple machine (each response took like 30 seconds) :) >>> from gremllm import Gremllm
>>> counter = Gremllm("counter", model="gemma3n:e2b")
>>> counter.value = 5
>>> counter.increment()
>>> counter.value
None
>>> counter.value
None
>>> counter.value
None
>>> counter.what_is_your_total()
6
6
... also I don't know why it kept saying my value is None :) . The "6" is doubled because one must have been a print and the other is the return value. |
|