Hacker News new | ask | show | jobs
LightlyTrain X DINOv2: Smarter Self-Supervised Pretraining, Faster (lightly.ai)
4 points by nonocycle 371 days ago
1 comments

Nice to see that distillation also works well. That means I can take the huge pretrained dinov2 models and distill them to my custom model architecture. Very nice!