RECORD
ReceiptSense: Beyond Traditional OCR -- A Dataset for Receipt Understanding
Computer Vision and Pattern Recognition · Submitted 6 Jun 2024
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim We establish baseline performance using traditional methods (Tesseract OCR) and advanced neural networks, demonstrating the dataset's effectiveness for processing complex, noisy real-world receipt layouts.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
Multilingual OCR and information extraction from receipts remains challenging, particularly for complex scripts like Arabic. We introduce \dataset, a comprehensive dataset designed for Arabic-English receipt understanding comprising 20,000 annotated receipts from diverse retail settings, 30,000 OCR-annotated images, and 10,000 item-level annotations, and a new Receipt QA subset with 1265 receipt images paired with 40 question-answer pairs each to support LLM evaluation for receipt understanding. The dataset captures merchant names, item descriptions, prices, receipt numbers, and dates to support object detection, OCR, and information extraction tasks. We establish baseline performance using traditional methods (Tesseract OCR) and advanced neural networks, demonstrating the dataset's effectiveness for processing complex, noisy real-world receipt layouts. Our publicly accessible dataset advances automated multilingual document processing research (see https://github.com/Update-For-Integrated-Business-AI/CORU ).
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Multilingual OCR and information extraction from receipts remains challenging, particularly for complex scripts like Arabic. | background 0.96 | 0.04 | 0.04 | asserted 1.00 |
| s1 | We introduce \dataset, a comprehensive dataset designed for Arabic-English receipt understanding comprising 20,000 annotated receipts from diverse retail settings, 30,000 OCR-annotated images, and 10,000 item-level annotations, and a new Receipt QA subset with 1265 receipt images paired with 40 question-answer pairs each to support LLM evaluation for receipt understanding. | contribution 0.99 | 0.95 | 0.14 | asserted 1.00 |
| s2 | The dataset captures merchant names, item descriptions, prices, receipt numbers, and dates to support object detection, OCR, and information extraction tasks. | contribution 0.64 | 0.53 | 0.06 | asserted 0.99 |
| s3 | We establish baseline performance using traditional methods (Tesseract OCR) and advanced neural networks, demonstrating the dataset's effectiveness for processing complex, noisy real-world receipt layouts. | result 0.49 | 0.95 | 0.27 | asserted 1.00 |
| s4 | Our publicly accessible dataset advances automated multilingual document processing research (see https://github.com/Update-For-Integrated-Business-AI/CORU ). | contribution 0.63 | 0.51 | 0.32 | asserted 1.00 |
What was examined, and what was not
- arXiv listing abstract v2
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
Multilingual OCR and information extraction from receipts remains challenging, particularly for complex scripts like Arabic. We introduce \dataset, a comprehensive dataset designed for Arabic-English receipt understanding comprising 20,000 annotated receipts from diverse retail settings, 30,000 OCR-annotated images, and 10,000 item-level annotations, and a new Receipt QA subset with 1265 receipt images paired with 40 question-answer pairs each to support LLM evaluation for receipt understanding. The dataset captures merchant names, item descriptions, prices, receipt numbers, and dates to support object detection, OCR, and information extraction tasks. We establish baseline performance using traditional methods (Tesseract OCR) and advanced neural networks, demonstrating the dataset's effectiveness for processing complex, noisy real-world receipt layouts. Our publicly accessible dataset advances automated multilingual document processing research (see https://github.com/Update-For-Integrated-Business-AI/CORU ).
Human review
References
How the literature uses it
1 arXiv paper cite this in 2 sentences
Papers citing it · 1 sentence without a confident label
Contests it 1 paper
-
ReceiptSense [ref] provides sparse annotations that hinder complex reasoning.
From Recognition to Reasoning: Benchmarking and Enhancing MLLMs on Real-World Receipt Document Understanding · Benchmarks for VIE · contest 0.80
What it cites · 1 sentence without a confident label
Cites as background 7 papers
-
Our evaluation spans a variety of model types, from convolutional neural networks (CNNs) [ref] and Transformers to cutting-edge language models, providing insights into their performance across different computational tasks and conditions outlined in the dataset.
An Introduction to Convolutional Neural Networks · Models · 0.83
-
DETR [ref] the vision transformer model with Improved Denoising Anchor Boxes (DINO) [ref] employs a Transformer-based architecture that dynamically updates 4D anchor boxes through its decoder, using deformable attention to leverage multi-scale features effectively.
DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection · Object Detection Models · 0.84
-
Zephyr [ref] [<https://huggingface.co/docs/transformers/main/model_doc/zephyr>] is a state-of-the-art model developed by the Hugging Face.
Zephyr: Direct Distillation of LM Alignment · LLM models · 0.97
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.