Injecting pre-computed layout priors from RT-DETR into VLM prompts raises markdown F1 from 0.37 to 0.92 on a 10k-page OOD benchmark and cuts infinite-loop failures across domains.
LayoutLM: Pre-training of Text and Layout for Document Image Under- standing
8 Pith papers cite this work. Polarity classification is still indexing.
8
Pith papers citing it
citation-role summary
background 1
citation-polarity summary
roles
background 1polarities
background 1representative citing papers
Multimodal LLMs process code as images to achieve up to 8x token compression, with visual cues like syntax highlighting aiding tasks and clone detection remaining resilient or even improving under compression.
Training-free graph method with LM edge scoring and max-regret path cover recovers 95% successor edges on Glossa wrap-around layouts vs 50% for XY-cut and 88% on OmniDocBench multi-column vs 75% XY-cut.
Introduces a benchmark dataset for data snapshot extraction focused on semantically meaningful analytical artifacts in institutional documents and shows open-source layout models struggle to generalize from academic benchmarks.
Nougat applies a visual transformer to convert academic PDFs into markup language while accurately handling mathematical content on a new scientific document dataset.
Systematic ablation of TrOCR fine-tuning for medieval HTR finds that freezing up to three encoder or six decoder layers does not significantly harm accuracy and that removing CLAHE contrast normalization yields comparable 7.84% CER on the Cortonese manuscript.
Presents RT-DocLayout, a 33M-parameter end-to-end model extending RT-DETR that unifies layout classification, detection, segmentation, and reading-order prediction at 132.1 FPS with claimed SOTA results on public benchmarks.
Proposes Modality-Aware Credit Assignment (MoCA) with blindfolded-reasoning proxy to reward perception fidelity separately from reasoning in VLMs.
citing papers explorer
-
CodeOCR: On the Effectiveness of Vision Language Models in Code Understanding
Multimodal LLMs process code as images to achieve up to 8x token compression, with visual cues like syntax highlighting aiding tasks and clone detection remaining resilient or even improving under compression.
-
Reading Order Inference for Complex Document Layouts
Training-free graph method with LM edge scoring and max-regret path cover recovers 95% successor edges on Glossa wrap-around layouts vs 50% for XY-cut and 88% on OmniDocBench multi-column vs 75% XY-cut.
-
Benchmarking Open-Source Layout Detection Models for Data Snapshot Extraction from Institutional Documents
Introduces a benchmark dataset for data snapshot extraction focused on semantically meaningful analytical artifacts in institutional documents and shows open-source layout models struggle to generalize from academic benchmarks.
-
TrOCR for Medieval HTR: A Systematic Ablation Study with Cross-Dataset Validation
Systematic ablation of TrOCR fine-tuning for medieval HTR finds that freezing up to three encoder or six decoder layers does not significantly harm accuracy and that removing CLAHE contrast normalization yields comparable 7.84% CER on the Cortonese manuscript.
-
RT-DocLayout: Real-Time End-to-End Document Layout Analysis with Reading Order in the Wild
Presents RT-DocLayout, a 33M-parameter end-to-end model extending RT-DETR that unifies layout classification, detection, segmentation, and reading-order prediction at 132.1 FPS with claimed SOTA results on public benchmarks.
-
Bad Seeing or Bad Thinking? Rewarding Perception for Multimodal Reasoning
Proposes Modality-Aware Credit Assignment (MoCA) with blindfolded-reasoning proxy to reward perception fidelity separately from reasoning in VLMs.