I'd be delighted to assist you with your inquiries. Indeed, the context store interacts with vector databases to retrieve samples based on vector embeddings and cosine similarity.
In your experience, in general when comparing vector embeddings, what layer of the net works best? Are the embeddings from the first hidden layer, the second, the last, etc?