Pith. sign in

REVIEW 5 cited by

BERTgrid: Contextualized Embedding for 2D Document Representation and Understanding

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1909.04948 v2 pith:PZMWJBTY submitted 2019-09-11 cs.CL cs.CVcs.LG

BERTgrid: Contextualized Embedding for 2D Document Representation and Understanding

Timo I. Denk , Christian Reisswig This is my paper
classification cs.CL cs.CVcs.LG
keywords documentbertgridcontextualizedembeddinginformationnetworksemantictask
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

For understanding generic documents, information like font sizes, column layout, and generally the positioning of words may carry semantic information that is crucial for solving a downstream document intelligence task. Our novel BERTgrid, which is based on Chargrid by Katti et al. (2018), represents a document as a grid of contextualized word piece embedding vectors, thereby making its spatial structure and semantics accessible to the processing neural network. The contextualized embedding vectors are retrieved from a BERT language model. We use BERTgrid in combination with a fully convolutional network on a semantic instance segmentation task for extracting fields from invoices. We demonstrate its performance on tabulated line item and document header field extraction.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. SlideAgent: Hierarchical Agentic Framework for Multi-Page Visual Document Understanding

    cs.CL 2025-10 unverdicted novelty 6.0

    SARA combines natural-language snippets with semantic compression vectors in RAG to improve answer relevance, correctness, and similarity on 9 datasets across 5 LLMs.

  2. SlideAgent: Hierarchical Agentic Framework for Multi-Page Visual Document Understanding

    cs.CL 2025-10 conditional novelty 6.0

    A three-level hierarchical agent framework for slide QA improves accuracy by 7.9–9.8 points over its base LLM across multiple slide benchmarks.

  3. Visual Information Extraction from Documents via Classification-Guided Large Vision-Language Models

    cs.CV 2026-07 conditional novelty 4.0

    Classification-guided dynamic prompts improve zero-shot visual information extraction from 16 certificate types, reaching 86.43 F1 without LVLM fine-tuning on a private bidding dataset.

  4. A Survey on MLLM-based Visually Rich Document Understanding: Methods, Challenges, and Emerging Trends

    cs.CV 2025-07 unverdicted novelty 3.0

    A survey of MLLM-based Visually Rich Document Understanding covering feature integration techniques, training paradigms, challenges like data scarcity, and emerging trends such as RAG and agentic frameworks.

  5. Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction

    cs.MM 2024-10 unverdicted novelty 3.0

    Survey proposing a taxonomy for document parsing into pipeline-based systems and VLM-driven unified models, reviewing components, metrics, benchmarks, and challenges.