On that topic, can anybody chime in on state of the art PDF OCR? Even if that's a multimodal LLM, I've used ChatGPT to extract tabular data from images but need something I can self host for proprietary data.
Azure Document Intelligence (especially with the layout model[0]) is really good. It has both JSON and MD output modes and does a pretty solid job identifying headers, sections, tables, etc.
What's interesting is that they have a self-deployable container model[1] that only phones home for billing so you can self-host the runtime and model.
What's interesting is that they have a self-deployable container model[1] that only phones home for billing so you can self-host the runtime and model.
[0] https://learn.microsoft.com/en-us/azure/ai-services/document...
[1] https://learn.microsoft.com/en-us/azure/ai-services/document...