[Nitrolo]

Is there something like oobabooga to easily run this in a click-and-run way? Where I can load up a model, a text, and ask it questions?

[simonw]

See my comment here: https://news.ycombinator.com/item?id=38020655 for a CLI tool that lets you do this.

Note that embedding models are a different kind of thing from a Large Language Model, so it's not the kind of model you can ask questions.

It's a model which can take text and turn it into an array of floating point numbers, which you can then use to implement things like semantic search and related documents.

More on that here: https://simonwillison.net/2023/Oct/23/embeddings/

[minimaxir]

The Hugging Face page for the model has a two line load-and-encode Python code demo: https://huggingface.co/jinaai/jina-embeddings-v2-base-en

[brucethemoose2]

iirc ooba has its own integrated vectordb called superbooga.

I bet you could hack this in.