Hacker News new | ask | show | jobs
by steinvakt2 106 days ago
Don't you find transformer based models perform better? Are they too heavy?
1 comments

they're heavy but we have some post processing tasks related to the smoothness of the countours created by the labels. sometimes CNNs do not have smooth segmentation. We do various calculations to determine deformities or welfare indicators on a fish. For that we need some smoother contours.

Given that, we have trained a variety of models and we are still experimenting on what works the best. We are even considering using VLMs for certain tasks if we can fine-tune them well enough.