Hacker News new | ask | show | jobs
by nico 1171 days ago
Is someone doing embeddings<>embeddings mapping?

For example, mapping embeddings of Llama to GPT-3?

That way you can see how similar the models “understand the world”.

3 comments

I'm curious about this as well. There are potentially many different versions of embedding models used in production and correlating different versions together could be very important.
I’d be interested to see this as well. I guess you can make a test and see what happens. Ping me if you do!
Isn't this the whole point behind the CLIP architecture?
Could you explain a bit more what the CLIP architecture is? Any good links to a short video demoing it? Thank you!