Hacker News new | ask | show | jobs
by jbellis 545 days ago
Looks great, thanks for training this!

  - Can I fine tune it with SentenceTransformers?
  - I see ColBERT in the benchmarks, is there an answerai-colbert-small-v2 coming soon?
2 comments
jph00 545 days ago
The creator of answerai-colbert-small-v2 (bclavie) is also the person that launched the ModernBERT project, so yes, you can expect to see a lot of activity in this space! :D

(Also yes, it works great with ST and we provide a full example script.)

link
gunalx 545 days ago
Seems like it. They even have example training scripts available. https://github.com/AnswerDotAI/ModernBERT/blob/main/examples...

Check out their documentation page linked on the bottom of the article. https://huggingface.co/docs/transformers/main/en/model_doc/m...

link