Hacker News new | ask | show | jobs
by rcarmo 22 days ago
Yes, but automatically generated content doesn’t need to do that - like I wrote in another comment, my agents know how to check bounding boxes.
1 comments

But bounding boxes don't always match what you want to do visually. Often you need to align to the baseline of text instead of its bounding box. And often you need to compensate for visual weight, making things different sizes so they appear more similarly sized to the eye

I'm not saying a pure API view won't work, but it will be a quality compromise compared to also having visual inspection

Font kerning software takes into account all of those things without writing to a pixel buffer and visually inspecting it.

Not saying that LLMs can do this, but there are algorithms which can, and neural networks are universal function approximators, so it is plausible.

People overestimate what LLMs can see vs what they tell you they can “see”