Yes. The fact that literally no one does this makes me continue to wonder wtf people are actually doing w/ LLMs, since I feel this need so acutely and the solution is so obvious.
I assume that there are people who are doing this. For example, you could set this up via the OpenAI API with an embedding model. The API processes the text using a pre-trained model like
text-embedding-ada-002
which converts the text into a vector to store in the database.
I assume that this sort of functionality will become more commonplace.
I assume that this sort of functionality will become more commonplace.