pith. sign in

arxiv: 2604.07814 · v1 · submitted 2026-04-09 · 💻 cs.CV

AgriChain Visually Grounded Expert Verified Reasoning for Interpretable Agricultural Vision Language Models

Hazza Mahmood , Yongqiang Yu , Rao Anwer This is my paper

Pith reviewed 2026-05-10 17:10 UTC · model grok-4.3

classification 💻 cs.CV
keywords plant disease diagnosisvision language modelsexpert verified reasoningchain of thoughtinterpretable artificial intelligenceagricultural applicationsfine tuned modelsleaf image classification
0
0 comments X

The pith

Expert-verified reasoning chains on a specialized leaf image dataset enable a fine-tuned small vision-language model to outperform larger general models in plant disease diagnosis.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

This work establishes that providing expert-verified step-by-step reasoning during training allows a specialized small vision-language model to achieve higher accuracy in identifying plant diseases while generating explanations that match professional agricultural descriptions. The dataset includes roughly 11,000 leaf images with disease labels, confidence levels, and checked rationales. The fine-tuned model reaches 73 percent top accuracy on a test set of 1,000 images and surpasses several larger multimodal systems. A sympathetic reader would care because this offers a route to more trustworthy and understandable AI tools for farmers facing crop health challenges.

Core claim

Creating a dataset of leaf images paired with expert-verified chain-of-thought rationales and fine-tuning a small vision-language model on the data produces a system that achieves 73.1 percent top-1 accuracy on a 1,000-image test set while generating explanations that align with expert reasoning, outperforming several larger general models.

What carries the argument

Expert-verified chain-of-thought rationales describing specific visual features of leaf lesions and used to supervise the model's reasoning during fine-tuning.

If this is right

  • The approach yields models that are both more accurate and more interpretable for agricultural applications.
  • Generated explanations align closely with those produced by professional agricultural engineers.
  • This supervision method bridges the performance gap between generic multimodal models and domain-specific human expertise.
  • It supports the creation of deployable AI systems for sustainable agriculture worldwide.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Applying similar expert verification to other image-based diagnostic tasks, such as in medicine or ecology, might yield comparable gains in small specialized models.
  • The public release of the dataset and code allows other researchers to test extensions to additional crop types or imaging conditions.
  • If the rationales prove robust, this could lower the computational cost of running effective agricultural AI by favoring smaller fine-tuned models over large general ones.

Load-bearing premise

The process of expert verification creates rationales that remain consistent and accurate when applied to new images from real farm settings that differ in lighting, plant growth stages, or previously unseen diseases.

What would settle it

Evaluating the model on leaf images collected from real farm fields with different lighting, growth stages, and new pathologies to see if accuracy drops below 73 percent or explanations no longer match expert review.

Figures

Figures reproduced from arXiv: 2604.07814 by Hazza Mahmood, Rao Anwer, Yongqiang Yu.

Figure 1
Figure 1. Figure 1: AgriChain training pipeline. Images from PlantVillage ( [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Example leaf disease classification outputs. Each image is paired with an expert-style diagnosis, [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Prompt used in the reasoning chain gen￾eration stage, guiding the model to produce struc￾tured diagnostic analyses of plant diseases with expert-level detail and confidence scoring. the healthy class), covering a total of 34 classes. A model’s prediction for an image is counted as correct if the generated output explicitly contains the true disease name (case-insensitive match). Minor hedging or additional… view at source ↗
Figure 4
Figure 4. Figure 4: Diagnosis: Cedar-apple rust. Confi￾dence: Medium. Reasoning: The leaf shows multiple small, circular, orange to rust-brown spots with distinct margins scattered across the blade. Lesions are not olive, velvety, or sooty, and there is no distortion or corky scabbing typical of apple scab. Illustrative case. In the cedar-apple rust exam￾ple in [PITH_FULL_IMAGE:figures/full_fig_p007_4.png] view at source ↗
read the original abstract

Accurate and interpretable plant disease diagnosis remains a major challenge for vision-language models (VLMs) in real-world agriculture. We introduce AgriChain, a dataset of approximately 11,000 expert-curated leaf images spanning diverse crops and pathologies, each paired with (i) a disease label, (ii) a calibrated confidence score (High/Medium/Low), and (iii) an expert-verified chain-of-thought (CoT) rationale. Draft explanations were first generated by GPT-4o and then verified by a professional agricultural engineer using standardized descriptors (e.g., lesion color, margin, and distribution). We fine-tune Qwen2.5-VL-3B on AgriChain, resulting in a specialized model termed AgriChain-VL3B, to jointly predict diseases and generate visually grounded reasoning. On a 1,000-image test set, our CoT-supervised model achieves 73.1% top-1 accuracy (macro F1 = 0.466; weighted F1 = 0.655), outperforming strong baselines including Gemini 1.5 Flash, Gemini 2.5 Pro, and GPT-4o Mini. The generated explanations align closely with expert reasoning, consistently referencing key visual cues. These findings demonstrate that expert-verified reasoning supervision significantly enhances both accuracy and interpretability, bridging the gap between generic multimodal models and human expertise, and advancing trustworthy, globally deployable AI for sustainable agriculture. The dataset and code are publicly available at: https://github.com/hazzanabeel12-netizen/agrichain

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

1 major / 2 minor

Summary. The paper introduces AgriChain, a dataset of ~11,000 expert-curated leaf images across crops and pathologies, each annotated with a disease label, High/Medium/Low confidence score, and an expert-verified chain-of-thought rationale (initially drafted by GPT-4o and reviewed by a professional agricultural engineer using standardized visual descriptors). The authors fine-tune Qwen2.5-VL-3B on this data to obtain AgriChain-VL3B, which jointly predicts disease labels and generates visually grounded explanations. On a 1,000-image held-out test set the model reports 73.1% top-1 accuracy (macro F1 = 0.466, weighted F1 = 0.655) and outperforms zero-shot Gemini 1.5 Flash, Gemini 2.5 Pro, and GPT-4o Mini; the authors conclude that expert-verified CoT supervision significantly improves both accuracy and interpretability for agricultural VLMs. Dataset and code are released publicly.

Significance. If the central claims are substantiated, the work supplies a valuable public resource for domain-specific agricultural vision-language research and illustrates a practical route to more interpretable models in a high-stakes application area. The explicit release of data and code is a clear strength that supports reproducibility and downstream use. The significance is currently limited by the absence of controls that would isolate the contribution of the verified rationales from ordinary supervised fine-tuning.

major comments (1)
  1. [Experimental evaluation] The experimental evaluation compares the jointly trained AgriChain-VL3B only against untuned commercial VLMs. Because the central claim is that expert-verified CoT supervision 'significantly enhances both accuracy and interpretability,' an ablation that fine-tunes the identical Qwen2.5-VL-3B base model on the AgriChain disease labels alone (standard classification loss, no CoT generation loss) is required. Without this control, observed gains cannot be attributed to the reasoning supervision rather than domain adaptation on the ~10k training images.
minor comments (2)
  1. [Dataset and evaluation] The manuscript provides insufficient detail on test-set construction (stratification by crop/pathology, leakage controls, and how the 1,000-image split was performed) and reports no statistical significance tests or confidence intervals for the accuracy and F1 figures.
  2. [Dataset construction] The description of the expert verification process would benefit from explicit discussion of inter-expert agreement, potential biases in the standardized descriptors, and any steps taken to ensure the rationales generalize beyond the curated collection.

Simulated Author's Rebuttal

1 responses · 0 unresolved

We thank the referee for the constructive feedback on our work. We address the major comment point by point below and will incorporate the suggested changes in the revised manuscript.

read point-by-point responses

  1. Referee: [Experimental evaluation] The experimental evaluation compares the jointly trained AgriChain-VL3B only against untuned commercial VLMs. Because the central claim is that expert-verified CoT supervision 'significantly enhances both accuracy and interpretability,' an ablation that fine-tunes the identical Qwen2.5-VL-3B base model on the AgriChain disease labels alone (standard classification loss, no CoT generation loss) is required. Without this control, observed gains cannot be attributed to the reasoning supervision rather than domain adaptation on the ~10k training images.

    Authors: We agree that this ablation is necessary to strengthen the attribution of gains specifically to the expert-verified CoT supervision rather than domain adaptation alone. Our current evaluation demonstrates that AgriChain-VL3B outperforms zero-shot commercial VLMs, but we acknowledge that a direct comparison to a label-only fine-tuned version of the same base model is required to isolate the contribution of the reasoning component. In the revised manuscript, we will add results from fine-tuning Qwen2.5-VL-3B on the AgriChain disease labels using only a standard classification loss (without the CoT generation loss). This will include updated accuracy, macro/weighted F1 scores, and analysis of whether the CoT supervision provides additional benefits in both performance and explanation quality. We are conducting these experiments and will report them in the next version. revision: yes

Circularity Check

0 steps flagged

No circularity in empirical evaluation chain

full rationale

The paper reports direct empirical results: a VLM is fine-tuned on an ~10k-image training split of the newly introduced AgriChain dataset and evaluated for top-1 accuracy and F1 scores on a held-out 1,000-image test set. These metrics are compared against the zero-shot performance of external commercial models (Gemini 1.5/2.5, GPT-4o Mini). No equations, parameter-fitting steps, self-citations, or ansatzes appear in the provided text that would reduce the reported performance numbers or the claim of enhanced interpretability to the training inputs by construction. The evaluation protocol is therefore self-contained against external benchmarks and does not rely on any load-bearing self-referential derivation.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The central claim rests on standard supervised learning assumptions and the quality of the expert verification step; no free parameters are explicitly fitted beyond normal model training, and no new entities are postulated.

axioms (1)
  • domain assumption Data points are independent and identically distributed between training and test sets
    Implicit in reporting held-out test accuracy without further qualification.

pith-pipeline@v0.9.0 · 5591 in / 1201 out tokens · 86651 ms · 2026-05-10T17:10:49.253073+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

24 extracted references · 24 canonical work pages · 1 internal anchor

  1. [1]

    Introduction The diagnosis of fine-grained plant disease is a complex visual reasoning task: symptoms are often subtle, vary between cultivars and growth stages, andareeasilyconfoundedbyabioticstress. Although large Vision-Language models (VLMs) demonstrate impressive general-purpose reason- ing, they often lackdomain-specific visual ground- ingand calibr...

    work page 2025

  2. [2]

    AgriChain Visually Grounded Expert Verified Reasoning for Interpretable Agricultural Vision Language Models

    AgriChain Dataset:An 11k-image dataset with expert-verified reasoning chains and cali- brated confidence labels. arXiv:2604.07814v1 [cs.CV] 9 Apr 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  3. [3]

    Reasoning-Calibrated Training:A fine- tuning framework that jointly supervises diag- nostic accuracy and rationale coherence via visual–textual alignment

    work page

  4. [4]

    AgriReason-Bench Evaluation:The first benchmark that assesses visual faithfulness using a Region–Text Alignment (RTA) metric, enabling quantitative interpretability analysis

    work page

  5. [5]

    VLMs: Background and Evolution VLMs integrate visual and textual modalities to en- able joint reasoning across images and natural language

    Related Work 2.1. VLMs: Background and Evolution VLMs integrate visual and textual modalities to en- able joint reasoning across images and natural language. Early systems (e.g., image captioning) mapped visual features to text using convolutional neural network (CNN) encoders and recurrent neu- ralnetwork(RNN)decoders. Transformer-basedar- chitectures fu...

    work page 2021

  6. [6]

    Collectively, these stud- ies demonstrate the growing potential of CoT for multimodal reasoning tasks, including fine-grained agricultural diagnostics

    apply CoT prompting to embodied agents, where intermediate visual sub-goals improve plan- ning and decision quality. Collectively, these stud- ies demonstrate the growing potential of CoT for multimodal reasoning tasks, including fine-grained agricultural diagnostics. 2.3. Reasoning and Interpretability in Agricultural AI Although several multimodal agric...

    work page

  7. [7]

    orange-brown vel- vety lesions along the veins characteristic of apple scab

    Methodology The AgriChain methodology employs a structured multi-stage pipeline (Figure 1) that unifies expert- verified data collection, multimodal reasoning gen- eration, and VLM fine-tuning for agricultural dis- easediagnosis. Itbeginswithcuratedplantimages and expert-designed prompts that guide detailed reasoning generation, followed by expert valida-...

    work page 2020

  8. [8]

    likely disease

    Models Evaluation Framework 4.1. Zero-Shot Baseline Comparisons To quantify the benefit of our CoT fine-tuning, we also evaluated several strong pre-trained VLMs as zero-shot baselines under the same input condi- tions: • Gemini 1.5 Flash: a lightweight multimodal model optimized for speed. • Gemini 2.5 Pro (Vision): a larger multimodal model used as a st...

    work page 2023

  9. [9]

    Preliminary Screening:Automated scripts removed duplicates, blurred samples, and low- resolution images

    work page

  10. [10]

    Images showing ambiguous or over- lapping symptoms were excluded to maintain label clarity

    Expert Filtering:Two agricultural engineers independently reviewed remaining images to confirm visible, disease-specific symptoms such as lesion type, color variation, or mold growth. Images showing ambiguous or over- lapping symptoms were excluded to maintain label clarity

    work page

  11. [11]

    Di- agnose the disease of this plant with reasoning

    Final Validation:From the filtered pool, ex- perts curated a balanced subset per disease class, ensuring diversity across lighting condi- tions, growth stages, and background types. This guarantees that the dataset represents both laboratory-quality and realistic field con- ditions without compromising interpretability. This structured selection pipeline ...

    work page

  12. [12]

    Results, Analysis, and Insights Our experiments on theAgriChaindataset show that incorporating explicit CoT reasoning signifi- cantly improves plant–disease diagnosis. Among five evaluated models, theAgrichain-VL3Bat- tained the highest accuracy at73.1%, outperform- ingGemini Pro(55.8%),Gemini Flash(48.7%), andGPT-4o Mini(34.9%), while the baseline Qwen-2...

    work page

  13. [13]

    Domain grounding.Supervised ratio- nales teach the model to attend to dis- criminative, field-relevant cues (e.g., lesion color/margin/texture,interveinalpatterning),re- ducing shortcut features and improving label fidelity (Zhang et al., 2024)

    work page 2024

  14. [14]

    no yellow halos⇒ unlikely bacterial spot

    Structured elimination.CoT encourages ex- plicitnegativeevidence (“no yellow halos⇒ unlikely bacterial spot”), which helps sepa- rate visually similar diseases (e.g., downy vs. powdery mildew) and mitigates plausible-but- wrong guesses (Camburu et al., 2018)

    work page 2018

  15. [15]

    Better calibration and oversight.Producing reasons and confidence promotes calibrated outputs and enables human validation; this improves trust and reduces undetected hallu- cinations in high-stakes use (Lanham et al., 2023). Residual errors and paths forward.Most re- maining errors arise in (i)rare classeswith limited trainingsupport,and(ii)look-alikefol...

    work page 2023

  16. [16]

    velvety olive-brown blotches

    Symptom anchoring and precise lexicon. AgriChain-VL3B consistently namesdiscrimi- nativevisual cues (e.g., “velvety olive-brown blotches”forapplescab;“angularchlorosislim- itedbyveins”fordownymildew)andlinksthem to the diagnosis with explicit evidence–claim links. Thisincreasesfaithfulness,factualaccu- racy, anddomain relevance. In contrast, base Qwenofte...

    work page

  17. [17]

    ab- sence of yellow halos ⇒ unlikely bacterial spot

    Structured differential diagnosis.The model regularly usesnegative evidenceand contrasts look-alike conditions (e.g., “ab- sence of yellow halos ⇒ unlikely bacterial spot”), which improvesinformativenessand coherenceand reduces plausible-but-wrong guesses. This mirrors expert reasoning pat- terns emphasized in multimodal CoT studies (Zhang et al., 2024)

    work page 2024

  18. [18]

    no yellow halos are present, ruling out bacterial spot

    Calibrated, reviewable justifications.By ex- posing intermediate observations and (when applicable) uncertainty, AgriChain-VL3B pro- duces rationales that a practitioner can audit. This supports more calibrated decisions and alignswithfaithfulness-focusedguidance(Lan- ham et al., 2023). Figure 4:Diagnosis:Cedar-apple rust.Confi- dence:Medium.Reasoning:The...

    work page 2023

  19. [19]

    Limitation and Future Work We identify several directions for extending AgriChainand improving reasoning-centric VLMs: • Scalable Annotation Pipelines:Implement semi-automated CoT labeling workflows us- ing model-in-the-loop annotation and expert verification to accelerate dataset expansion. • Multilingual Reasoning:Develop CoT ex- planations in local lan...

    work page

  20. [20]

    Conclusion We introducedAgriChain, an expert-curated dataset that pairs plant-disease images withchain- of-thoughtrationales and calibrated confidence la- bels. Training a VLM on AgriChain resulted in a specialized model,AgriChain-VL3B, which signifi- cantly improved both accuracy and interpretability, achieving state-of-the-art results (73.1% accuracy; m...

    work page

  21. [21]

    Bibliographical References Jean-Baptiste Alayrac et al. 2022. Flamingo: A visual language model for few-shot learning. Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou. 2023a. Qwen-vl: A versatile vision-language model for understand- ing and generation. Y. Bai and et al. 2023. Evaluating do...

    work page 2022

  22. [22]

    Thomas Lanham, Samuel R

    Overview of plantclef 2022: Plant identifi- cation and disease recognition challenges. Thomas Lanham, Samuel R. Bowman, and Ethan Perez. 2023. Measuring faithfulness in chain-of- thought reasoning. JunnanLietal.2022. Blip: Bootstrappinglanguage- image pre-training for unified vision-language understanding and generation. Y. Liu, D. Iter, Y. Xu, and et al....

    work page 2022

  23. [23]

    Roboflow Universe

    Learning transferable visual models from natural language supervision. Roboflow Universe. 2022. Leaf disease dataset. Dhruv Singh et al. 2020. Plantdoc: A dataset for visual plant disease detection. Jason Wei and et al. 2022. Chain-of-thought prompting elicits reasoning in large language models. Bo Yang, Yunkui Chen, Lanfei Feng, Yu Zhang, Xiao Xu, Jianyu...

    work page 2022

  24. [24]

    Yuchen Zhang, Ming Li, Rui Zhao, et al

    Agrigpt-vl: Agricultural vision–language understanding suite. Yuchen Zhang, Ming Li, Rui Zhao, et al. 2024. Multimodal chain-of-thought reasoning in vi- sion–language models. Chenyang Zhao et al. 2025. Planning with chain- of-thought in embodied and multimodal agents

    work page 2024