[ck_one]

That's actually a pretty good idea to improve your skills. I would highly recommend to implement one of the semantic segmentation papers. Perhaps start with a simple FCN (with and without a pretrained encoder).