[bboygravity]

Could DINO or some other model be used to identify fillable form fields in webforms and/or PDF forms and/or desktop apps?

Or does it likely just work on real world photos and cartoons and stuff?

[rolisz]

There are dedicated models for recognizing UI elements such as form fields. One example is https://github.com/microsoft/OmniParser