[jimmySixDOF]

I looked at this on Twitter and will try it out using the integration with Llamaindex !! The idea of Late Interaction sounds like an improvement either on top of or in place of a vector db approach. I was looking at the BERT family in general so while ColBERT is a great implementation it would be interesting to have this same "everything in the one gumbo pot" type library for working with robert(a)/tinybert/qbert/distilbert/.....

Great project and I hope the post gets on the HN second chance loop !

[jkb79]

ColBER: Contextualized Late Interaction over BERT. That is just the name. It can be fine-tuned for retrieval using any encoder-only model like the ones you mention.

[jimmySixDOF]

Yes thanks and anyone looking to swapout ColBERTv2 should look at example.2 "for any BERT/RoBERTa-like model" and then test against use cases to your heart's desire or at least until you run out of time to optimize lol!