the blog post details it but essentially to convert from PaliGemma tokens to bbox:
y0 / 1024 * h
x0 / 1024 * w
y1 / 1024 * h
x1 / 1024 * w
have not played with segmentation yet.