[Silasdev]

To my knowledge, you cannot mix embeddings from different models. Each dimension has a different meaning for each model.

[TeMPOraL]

There's been some success in creating translation layers that can convert between different LLM embeddings, and even between LLM and an image generation model.