Pith. sign in

REVIEW 3 major objections 5 minor 1 cited by

ConText: Driving In-context Learning for Text Removal and Segmentation

T0 review · 3 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read ConText claims that adapting visual in-context learning to OCR by chaining text removal and segmentation into a single prompt yields state-of-the-art results on both task families.

desk verdict Solid SOTA numbers for OCR text removal and segmentation, but the in-context learnability evidence is confounded by the self-prompting training trick. read the letter →

arxiv 2506.03799 v1 pith:OEVLLUCN submitted 2025-06-04 cs.CV

classification cs.CV MSC 68T4568T07
keywords visualin-contextlearningtextremovalsegmentationtaskchainingself-promptingcontext-awareaggregationscenemaskedautoencoder
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that visual in-context learning—solving a task from example image-label pairs placed in the prompt—can be made to work for fine-grained OCR tasks such as removing text from photographs and segmenting text into foreground masks. Earlier in-context vision models used a single image-label pair and forced the model to jump straight from input to output in one reconstruction step. ConText instead chains two related tasks into one prompt—original image, text-removed image, and segmentation mask—so the model reasons through an intermediate representation, much as chain-of-thought prompting helps language models. On top of that prompt design, the paper adds a cross-attention module that lets the two demonstrations inform each other and a self-prompting training trick that keeps the model sensitive to the demonstration. The paper reports state-of-the-art numbers on both tasks and takes the large gap between ground-truth and random demonstrations as evidence that genuine in-context learning, rather than context-free specialization, is happening.

What carries the argument

The load-bearing object is the task-chaining compositor: the prompt is built as a 2×3 grid of [original image, removed image, segmentation mask] covering both the demonstration pair and the query. During training both the removal and the segmentation labels are partially masked with spatially aligned masks, and a weight-shared decoder reconstructs both, so the model can exploit the fact that both outputs describe the same text regions. Two supporting mechanisms carry the rest: context-aware aggregation (CAA), a lightweight shared cross-attention module that enriches each label representation with features drawn from the other demonstration, and self-prompting, which with probability 0.2 builds the input from two identical pairs so the model keeps relying on the demonstration rather than becoming a task specialist. The backbone is a ViT-L masked autoencoder initialized from a pre-trained in-context segmentation checkpoint.

What would settle it

Train ConText with the same recipe but replace every pseudo-label with human-annotated removal and segmentation targets on the same images, then re-run the same benchmarks; if the reported margins collapse, the gains were partly fitting the pseudo-label teacher's bias. A second check: evaluate ConText with a demonstration drawn from a different script or style than the query, and if performance barely moves, the model has lost the demonstration sensitivity that self-prompting is claimed to preserve.

Watch

Extended reading notes

Core claim

The central claim is that restructuring the in-context prompt from a single image-label pair into a task chain—original image, removed image, segmentation mask—lets one masked-autoencoder-style model perform text removal and segmentation in a single forward pass, and do so better than models fine-tuned for either task alone. The argument leans on a simple identity: the segmentation mask is exactly the visual difference between the original image and its erased version, so chaining the tasks gives the model an intermediate to reason through instead of demanding a direct one-step mapping. The paper attributes the remaining margin to context-aware aggregation, a shared cross-attention module that injects each demonstration's features into the other's label representation, and to self-prompting, which with probability 0.2 feeds two identical input-output pairs so the model cannot collapse into a demonstration-independent specialist. On the paper's numbers, ConText reaches a PSNR of 38.36 averaged over three text removal benchmarks and an fgIoU of 76.77% averaged over four segmentation datasets, outperforming both in-context generalists and task-specific specialists, and it retains a visible performance gap between ground-truth and randomly sampled demonstrations.

Load-bearing premise

The load-bearing premise is that the training labels are trustworthy, and several are not human-annotated: as disclosed in Appendix B.1, removal images for TextSeg are produced by an external eraser model and segmentation masks for SCUT-EnsText and SCUT-Syn are computed by gray-scale differencing, so part of the reported gains could be fitting those pseudo-labels rather than genuine in-context reasoning.

Editorial extensions

If this is right

  • Any pair of visual tasks joined by a shared logical identity—here, that the segmentation mask equals the difference between an image and its erased version—can be chained into a single prompt to lift performance on both tasks.
  • In-context models trained on visually heterogeneous domains need explicit pressure, such as self-prompting, to stay demonstration-sensitive; without it, the model degrades into a context-free specialist.
  • The growing gap between ground-truth and random demonstration performance as training data scales indicates that the model's gains come partly from genuine in-context inference, and that this capability improves with more data.
  • A single randomly chosen demonstration suffices for the model to beat task-specific specialists, suggesting that costly demonstration retrieval is not needed for OCR-style in-context tasks.
  • The model can follow explicit human-style visual prompts—colored circles, boxes, and strokes drawn on the query image—without ever training on such annotations, which the paper presents as evidence of generalized in-context understanding.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the intermediate-reasoning story is right, then adding a third linked task to the chain—say, text detection or recognition—should further improve removal and segmentation; this is a direct and cheap test of the task-chaining mechanism.
  • Because the removal labels for TextSeg come from another eraser model and the segmentation masks for SCUT-EnsText and SCUT-Syn come from gray-scale differencing, the reported margins may partly encode that teacher's biases; retraining with purely human annotations would measure that contamination.
  • The fixed self-prompting probability of 0.2 trades off in-context sensitivity against task accuracy, so a schedule that anneals the probability during training, or adapts it per sample, might dominate the fixed setting.
  • The watermark-removal result suggests the same chain composer transfers beyond OCR to any foreground-erasure task pair, such as shadow or reflection removal, where an erasure output and a foreground mask are naturally paired.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper proposes ConText, a visual in-context learning (V-ICL) framework for text removal and segmentation. Three components are introduced: a task-chaining prompt that combines image, removal, and segmentation labels; a context-aware aggregation (CAA) module that fuses cross-demonstration information; and a self-prompting (SP) training strategy that occasionally feeds the model two identical input-output pairs. Experiments on multiple text removal and segmentation benchmarks report state-of-the-art results for random-demonstration inference (average PSNR 38.36 over three removal benchmarks; average fgIoU 76.77 over four segmentation benchmarks) and further claim generalized in-context learnability, evidenced by a large performance gap when the demonstration is the ground-truth label instead of a randomly selected sample.

Significance. If the central claims hold, this is a useful contribution to V-ICL for OCR: it is the first OCR-focused V-ICL generalist, it releases code, and it reports strong improvements over both generalist baselines and task-specific specialists on standard benchmarks. The random-demonstration SOTA numbers are supported by extensive comparisons and appear independent of the learnability-protocol confound discussed below. However, the paper's broader claim that self-prompting preserves generalized in-context learnability rests on a GT-demonstration measurement that may be in-distribution for ConText but out-of-distribution for the baselines, so the ICL-specific conclusion needs additional controls or a reinterpretation before the contribution is fully established.

major comments (3)
  1. [Section 5.3, Figure 5, Table 5, Appendix B.2] The ground-truth demonstration protocol is not precisely defined, and the reported numbers indicate a confound. If the 'ground-truth-based demonstration' is the query image paired with its own ground-truth label, then this input is exactly the self-prompting condition described in Section 4.3 ('two identical input-output pairs'), which ConText was trained on with probability 0.2 but the Painter and SegGPT baselines were not. Table 5 shows that the RS-versus-GT gap on TotalText segmentation and SCUT-EnsText removal grows from +0.65 fgIoU / +0.37 PSNR without SP to +3.98 fgIoU / +1.42 PSNR with SP-0.2. This pattern is consistent with the model memorizing the identical-pair training condition rather than with a general ability to reason from arbitrary GT demonstrations. Please (a) define the protocol explicitly, (b) add a control with a non-identical but ground-truth demonstration, and (c) either train baselines under the same self-prompting schedule or reinterpret the gap as an upper-bound measurement rather than evidence against 'context-free inference'.
  2. [Appendix B.1 and Impact Statement] The training targets for ConTextV include pseudo-labels: removal labels for TextSeg are generated by ViT-Eraser, and segmentation masks for SCUT-EnsText and SCUT-Syn are produced by gray-scale distance between original and erased images. The Impact Statement itself acknowledges that these labels can introduce noise and bias. Because ConTextV is trained on these pseudo-labeled datasets and then compared with specialists on TextSeg segmentation (Table 2) and SCUT-EnsText removal (Table 3), a systematic bias in the pseudo-labels could inflate the reported specialist-level results. Please quantify the quality of the pseudo-labels (for example, IoU against human masks on a subset) or provide an ablation that removes the pseudo-labeled datasets; without such evidence, the specialist comparison does not fully isolate the effect of the model design from the effect of the training labels.
  3. [Section 5.3, PromptText, Appendix B.4] The claim that PromptText is 'not training-involved' is inaccurate for ConTextV and for any baseline trained on TextSeg, because PromptText is constructed from the TextSeg validation set. Since ConTextV is trained on TextSeg training data, the evaluation is not fully held-out for that model. The HierText-trained ConText row provides a partially clean check, but the section should either restrict the claim to ConText or evaluate PromptText on a dataset that is disjoint from all training sets; the current wording overstates the generalization evidence.
minor comments (5)
  1. [Section 1 (contribution bullet)] The bullet lists '+4.50PNSR'; 'PNSR' should be 'PSNR.'
  2. [Section 5.4, Table 5] The table headers 'RS / GT' are ambiguous: clarify that the first value is the random-selected score and the second value is the delta from the GT-demonstration score, not an absolute GT score.
  3. [Appendix B.2, Tables 11-13] The rows reporting ground-truth-demonstration results are not visually labeled; add a caption note or row labels (e.g., 'GT demo') so readers can distinguish them from random-demonstration rows.
  4. [Figure 5 caption] The phrase 'a sounding upper and lower bounds' should be 'a sound upper and lower bound' (or 'sound upper and lower bounds').
  5. [Section 5.4] The sentence 'the intuitivelinear fusion (eF1) yields a significant improvement (+3.61%) fgIoU for segmentation and +1.33 PSNR for removal)' has a mismatched parenthesis and should be reworded for clarity.

Circularity Check

1 steps flagged · score 4.0 of 10

The GT-demonstration 'upper bound' behind the generalized in-context learnability claim is the self-prompting training distribution, so that claim is partly forced; the random-demonstration SOTA numbers remain independent.

  1. fitted input called prediction [Section 4.3 (Self-prompting); Section 5.3 (In-context Learnability); Table 5; Appendix B.1]
    "we propose constructing model inputs by using two identical input-output pairs (eFi = eFj) with a certain probability ... The probability of self-prompting is set to 0.2 ... Figure 5 reports all models’ performance given both the randomly-selected and ground-truth-based demonstration samples, yielding the upper and the normal in-context inference abilities ... RS (GT) denotes the model’s performance with randomly-selected (ground-truth) demonstration."

    The 'ground-truth demonstration' evaluation is the same input condition as the self-prompting training strategy: the demonstration and query are identical input-output pairs (eFi = eFj). ConText was trained on exactly this pattern with probability 0.2, while the Painter/SegGPT baselines were not, so the large RS-vs-GT gap in Table 5 (+3.98 fgIoU / +1.42 PSNR with SP-0.2, vs +0.65 / +0.37 without SP) largely measures recall of the trained self-prompting condition rather than generalized in-context inference from novel demonstrations. The paper uses this gap as the central evidence that self-prompting 'prevent[s] the model's in-context learnability from devolving into specialist-like, context-free inference,' but the upper bound is in-distribution by construction.

full rationale

The main SOTA results (Section 5.2, Tables 1-3, 9) are evaluated on held-out benchmarks with random demonstrations and are independent of the training-design choices, so they are not circular. The only load-bearing circularity is the in-context learnability metric in Section 5.3: the GT-demonstration condition duplicates the self-prompting training input defined in Section 4.3 (eFi = eFj, p=0.2), so the claimed 'upper bound' and the resulting RS-vs-GT gap are in part forced by the training distribution rather than by genuine ICL. This is a fitted training augmentation presented as a prediction of an upper bound, and it is the central evidence for the paper's claim that self-prompting preserves generalized in-context learnability. The pseudo-label caveats acknowledged in the Impact Statement are real data-quality risks but are not circular, since the reported comparisons use independent human-annotated benchmarks for the headline numbers. No load-bearing self-citation chain was found.

Assumptions & free parameters 5 free parameters · 4 assumptions · 0 invented entities

The method relies on domain assumptions about task relationships and label quality, plus several hand-chosen hyperparameters. No new physical or mathematical entities are introduced.

free parameters (5)
  • self-prompting probability = 0.2
    Chosen by hand and ablated in Table 5; SP-0.2 vs SP-0.6 changes the trade-off between task-specific accuracy and in-context responsiveness.
  • masking ratio = 85%
    Ablated in Table 6; the model peaks at 85% masking, with declines at 95%.
  • removal reconstruction loss weight = 0.3
    Set in Appendix B.1 without ablation, affects the balance between segmentation and removal reconstruction losses.
  • pixel-level supervision loss weight = 1
    Set in Appendix B.1, weights the extra cross-entropy pixel supervision used during training.
  • CAA learnable weights alpha_o, alpha_y = learned
    Learnable scalar weights in the context-free fusion step, Section 4.2; optimized during training, not derived from first principles.
assumptions (4)
  • domain assumption The segmentation mask corresponds to the visual difference between the original image and its erased counterpart.
    This is the motivation for task-chaining in Section 4.1; if false, the intermediate removal output would not provide useful supervision for segmentation.
  • domain assumption MAE-style mask reconstruction is a suitable training objective for text removal and segmentation.
    The whole framework uses masked reconstruction as the surrogate task, following Bar et al. 2022 and the Painter/SegGPT baselines, Section 3.
  • domain assumption Cross-attention aggregation at the query label position improves in-context reasoning.
    CAA is motivated by an ICL label-anchor hypothesis from cited works, Section 4.2; the module is evaluated only in ablation, not by an external theoretical justification.
  • domain assumption Pseudo-labeled removal and segmentation targets are accurate enough to serve as ground truth.
    Appendix B.1 uses ViT-eraser outputs for TextSeg and gray-scale distance for SCUT-EnsText/SCUT-Syn masks; the paper acknowledges the labels are noisy.

how reviews work

0 comments
Cite this review

Pith. "Pith review of ConText: Driving In-context Learning for Text Removal and Segmentation." pith.science (2026). https://pith.science/paper/OEVLLUCN

@misc{pith2026250603799,
  author       = {Pith},
  title        = {Pith review of: ConText: Driving In-context Learning for Text Removal and Segmentation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/OEVLLUCN}},
  note         = {Machine review of arXiv:2506.03799}
}
read the original abstract

This paper presents the first study on adapting the visual in-context learning (V-ICL) paradigm to optical character recognition tasks, specifically focusing on text removal and segmentation. Most existing V-ICL generalists employ a reasoning-as-reconstruction approach: they turn to using a straightforward image-label compositor as the prompt and query input, and then masking the query label to generate the desired output. This direct prompt confines the model to a challenging single-step reasoning process. To address this, we propose a task-chaining compositor in the form of image-removal-segmentation, providing an enhanced prompt that elicits reasoning with enriched intermediates. Additionally, we introduce context-aware aggregation, integrating the chained prompt pattern into the latent query representation, thereby strengthening the model's in-context reasoning. We also consider the issue of visual heterogeneity, which complicates the selection of homogeneous demonstrations in text recognition. Accordingly, this is effectively addressed through a simple self-prompting strategy, preventing the model's in-context learnability from devolving into specialist-like, context-free inference. Collectively, these insights culminate in our ConText model, which achieves new state-of-the-art across both in- and out-of-domain benchmarks. The code is available at https://github.com/Ferenas/ConText.

Figures

Figures reproduced from arXiv: 2506.03799 by the authors.

Figure 1
Figure 1. Comparison with previous V-ICL paradigm and our pro￾posed OCR-adapted in-context system. Instead of relying simply on task-specific tuning, our ConText focuses on chaining together related visual tasks to leverage their mutual benefits, thereby em￾bracing a more powerful in-context understanding and reasoning. powerful reasoning capabilities. Notably, in-context learn￾ing (ICL) (Rubin et al., 2021; Dong et al., 2022… view at source ↗
Figure 2
Figure 2. The training pipeline of previous V-ICL generalists (ob￾ject segmentation as the illustrative task). This MAE-based frame￾work formalize ICL as an composited-image (image-label) recon￾struction process. During training, the two image-label pairs serve as the mutual in-context demonstration for each other, while during inference, only one pairs’ label is masked to generate the query output. This baseline possesses 3 … view at source ↗
Figure 3
Figure 3. The training pipeline of ConText, a V-ICL framework for text removal and segmentation, enhances the baseline by leveraging inherent characteristics. We create an end-to-end multi-task generation through task-chaining. Additionally, our context-aware aggregation (CAA) enhances label representation towards better in-context understanding. We also employ a self-prompting strategy to ensure in￾context learnability for t… view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: Visualized TotalText samples generated from several in-context generalists. Each set of samples consists of the (original image, removal result, segmentation map). The prompt refers to the given visual demonstration. The red circles indicate the differences in segmenta…
Figure 5
Figure 5. Figure 5: Comparison of several visual generalists on text segmen￾tation and removal tasks when given the randomly-selected (RS) and ground-truth-based (GT) prompts. Here the segmentation (re￾moval) task is evaluated against four (SCUT-EnsText) benchmarks. This two-case performa…
Figure 6
Figure 6. Figure 6: Visualized samples of several methods on the prompting datasets. The results of the specialists are obtained through Hi￾SAM and ViT-eraser, respectively. Other generalists are prompted by the given demonstration. Zoom in for a better view [PITH_FULL_IMAGE:figures/full…
Figure 7
Figure 7. Figure 7: Illustration of label role proposed in Yu & Ananiadou (2024). Intuitively, shallow layers merge features into label positions and last position within ICL. This mechanism also inspires the design of our context-aware module. B. Experiments B.1. More Training Details Ou…
Figure 8
Figure 8. Figure 8: Visualized samples of our designed PromptText. Zoom in for a better view. Removal Segmentation Input ViT-eraser ConTextV Ground-Truth Input Hi-SAM ConTextV Ground-Truth [PITH_FULL_IMAGE:figures/full_fig_p019_8.png]
Figure 9
Figure 9. Figure 9: Qualitative comparison of our method and existing specialists on SCUT-EnsText and HierText. Our method is prompted by random demonstration. Clearly, our framework demonstrates promising performance across these tasks. Zoom in for a better view. 19 [PITH_FULL_IMAGE:fig…

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Decouple before Align: Visual Disentanglement Enhances Prompt Tuning

    cs.CV 2025-08 conditional novelty 6.0 of 10

    Decoupling images into foreground and background before aligning them with text improves CLIP prompt tuning on few-shot and generalization benchmarks.

Reference graph

Works this paper leans on

97 extracted references · 49 canonical work pages · cited by 1 Pith paper

  1. [1]

    What learning algorithm is in-context learning? investigations with linear models

    Aky \"u rek, E., Schuurmans, D., Andreas, J., Ma, T., and Zhou, D. What learning algorithm is in-context learning? investigations with linear models. arXiv preprint arXiv:2211.15661, 2022

  2. [2]

    L., Darrell, T., Malik, J., and Efros, A

    Bai, Y., Geng, X., Mangalam, K., Bar, A., Yuille, A. L., Darrell, T., Malik, J., and Efros, A. A. Sequential modeling enables scalable learning for large vision models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 22861--22872, 2024

  3. [3]

    Visual prompting via image inpainting

    Bar, A., Gandelsman, Y., Darrell, T., Globerson, A., and Efros, A. Visual prompting via image inpainting. Advances in Neural Information Processing Systems, 35: 0 25005--25017, 2022

  4. [4]

    Scene text removal via cascaded text stroke detection and erasing

    Bian, X., Wang, C., Quan, W., Ye, J., Zhang, X., and Yan, D.-M. Scene text removal via cascaded text stroke detection and erasing. Computational Visual Media, 8: 0 273--287, 2022

  5. [5]

    Coco\_ts dataset: pixel--level annotations based on weak supervision for scene text segmentation

    Bonechi, S., Andreini, P., Bianchini, M., and Scarselli, F. Coco\_ts dataset: pixel--level annotations based on weak supervision for scene text segmentation. In International Conference on Artificial Neural Networks, pp.\ 238--250. Springer, 2019

  6. [6]

    D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al

    Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. Language models are few-shot learners. Advances in neural information processing systems, 33: 0 1877--1901, 2020

  7. [7]

    Textdiffuser: Diffusion models as text painters

    Chen, J., Huang, Y., Lv, T., Cui, L., Chen, Q., and Wei, F. Textdiffuser: Diffusion models as text painters. Advances in Neural Information Processing Systems, 36, 2023

  8. [8]

    Encoder-decoder with atrous separable convolution for semantic image segmentation

    Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European conference on computer vision (ECCV), pp.\ 801--818, 2018

Show all 97 references
  1. [9]

    Ch'ng, C. K. and Chan, C. S. Total-text: A comprehensive dataset for scene text detection and recognition. In 2017 14th IAPR international conference on document analysis and recognition (ICDAR), volume 1, pp.\ 935--942. IEEE, 2017

  2. [10]

    and Chen, P.-I

    Conrad, B. and Chen, P.-I. Two-stage seamless text erasing on real-world scene images. In 2021 IEEE International Conference on Image Processing (ICIP), pp.\ 1309--1313. IEEE, 2021

  3. [11]

    Why can gpt learn in-context? language models implicitly perform gradient descent as meta-optimizers

    Dai, D., Sun, Y., Dong, L., Hao, Y., Ma, S., Sui, Z., and Wei, F. Why can gpt learn in-context? language models implicitly perform gradient descent as meta-optimizers. arXiv preprint arXiv:2212.10559, 2022

  4. [12]

    A survey on in-context learning

    Dong, Q., Li, L., Dai, D., Zheng, C., Ma, J., Li, R., Xia, H., Xu, J., Wu, Z., Liu, T., et al. A survey on in-context learning. arXiv preprint arXiv:2301.00234, 2022

  5. [13]

    An image is worth 16x16 words: Transformers for image recognition at scale

    Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020

  6. [14]

    Modeling stroke mask for end-to-end text erasing

    Du, X., Zhou, Z., Zheng, Y., Ma, T., Wu, X., and Jin, C. Modeling stroke mask for end-to-end text erasing. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp.\ 6151--6159, 2023 a

  7. [15]

    Progressive scene text erasing with self-supervision

    Du, X., Zhou, Z., Zheng, Y., Wu, X., Ma, T., and Jin, C. Progressive scene text erasing with self-supervision. Computer Vision and Image Understanding, 233: 0 103712, 2023 b

  8. [16]

    Progressive scene text erasing with self-supervision

    Du, X., Zhou, Z., Zheng, Y., Wu, X., Ma, T., and Jin, C. Progressive scene text erasing with self-supervision. Computer Vision and Image Understanding, 233: 0 103712, 2023 c

  9. [17]

    M., Loy, C

    Fang, Z., Li, X., Li, X., Buhmann, J. M., Loy, C. C., and Liu, M. Explore in-context learning for 3d point cloud understanding. Advances in Neural Information Processing Systems, 36, 2023

  10. [18]

    S., and Valiant, G

    Garg, S., Tsipras, D., Liang, P. S., and Valiant, G. What can transformers learn in-context? a case study of simple function classes. Advances in Neural Information Processing Systems, 35: 0 30583--30598, 2022

  11. [19]

    Masked autoencoders are scalable vision learners

    He, K., Chen, X., Xie, S., Li, Y., Doll \'a r, P., and Girshick, R. Masked autoencoders are scalable vision learners. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 16000--16009, 2022

  12. [20]

    J., and Wang, Z

    Hou, Y., Chen, J. J., and Wang, Z. Multi-branch network with ensemble learning for text removal in the wild. In Proceedings of the Asian Conference on Computer Vision, pp.\ 1333--1349, 2022

  13. [21]

    Self-supervised text erasing with controllable image synthesis

    Jiang, G., Wang, S., Ge, T., Jiang, Y., Wei, Y., and Lian, D. Self-supervised text erasing with controllable image synthesis. In Proceedings of the 30th ACM International Conference on Multimedia, pp.\ 1973--1983, 2022

  14. [22]

    C., and Gevers, T

    Karaoglu, S., Van Gemert, J. C., and Gevers, T. Object reading: text recognition for object recognition. In Computer Vision--ECCV 2012. Workshops and Demonstrations: Florence, Italy, October 7-13, 2012, Proceedings, Part III 12, pp.\ 456--465. Springer, 2012

  15. [23]

    G., Mestre, S

    Karatzas, D., Shafait, F., Uchida, S., Iwamura, M., i Bigorda, L. G., Mestre, S. R., Mas, J., Mota, D. F., Almazan, J. A., and De Las Heras, L. P. Icdar 2013 robust reading competition. In 2013 12th international conference on document analysis and recognition, pp.\ 1484--1493...

  16. [24]

    Kingma, D. P. and Ba, J. Adam: A method for stochastic optimization. International Conference on Learning Representations (ICLR), 2015

  17. [25]

    C., Lo, W.-Y., et al

    Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A. C., Lo, W.-Y., et al. Segment anything. arXiv preprint arXiv:2304.02643, 2023

  18. [26]

    Crafting papers on machine learning

    Langley, P. Crafting papers on machine learning. In Langley, P. (ed.), Proceedings of the 17th International Conference on Machine Learning (ICML 2000), pp.\ 1207--1216, Stanford, CA, 2000. Morgan Kaufmann

  19. [27]

    and Choi, C

    Lee, H. and Choi, C. The surprisingly straightforward scene text removal method with gated attention and region of interest generation: A comprehensive prominent model analysis. In European Conference on Computer Vision, pp.\ 457--472. Springer, 2022

  20. [28]

    Monte carlo linear clustering with single-point supervision is enough for infrared small target detection

    Li, B., Wang, Y., Wang, L., Zhang, F., Liu, T., Lin, Z., An, W., and Guo, Y. Monte carlo linear clustering with single-point supervision is enough for infrared small target detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 1009--1019, 2023 a

  21. [29]

    Ddaug: Differentiable data augmentation for weakly supervised semantic segmentation

    Li, B., Zhang, F., Wang, L., Wang, Y., Liu, T., Lin, Z., An, W., and Guo, Y. Ddaug: Differentiable data augmentation for weakly supervised semantic segmentation. IEEE Transactions on Multimedia, 26: 0 4764--4775, 2023 b

  22. [30]

    The closeness of in-context learning and weight shifting for softmax regression

    Li, S., Song, Z., Xia, Y., Yu, T., and Zhou, T. The closeness of in-context learning and weight shifting for softmax regression. arXiv preprint arXiv:2304.13276, 2023 c

  23. [31]

    and Qiu, X

    Li, X. and Qiu, X. Finding supporting examples for in-context learning. CoRR, 2023

  24. [32]

    Erasenet: End-to-end text removal in the wild

    Liu, C., Liu, Y., Jin, L., Zhang, S., Luo, C., and Wang, Y. Erasenet: End-to-end text removal in the wild. IEEE Transactions on Image Processing, 29: 0 8760--8775, 2020

  25. [33]

    Don’t forget me: accurate background recovery for text removal via modeling local-global context

    Liu, C., Jin, L., Liu, Y., Luo, C., Chen, B., Guo, F., and Ding, K. Don’t forget me: accurate background recovery for text removal via modeling local-global context. In European Conference on Computer Vision, pp.\ 409--426. Springer, 2022 a

  26. [34]

    Don’t forget me: accurate background recovery for text removal via modeling local-global context

    Liu, C., Jin, L., Liu, Y., Luo, C., Chen, B., Guo, F., and Ding, K. Don’t forget me: accurate background recovery for text removal via modeling local-global context. In European Conference on Computer Vision, pp.\ 409--426. Springer, 2022 b

  27. [35]

    Audio-visual segmentation via unlabeled frame exploitation

    Liu, J., Liu, Y., Zhang, F., Ju, C., Zhang, Y., and Wang, Y. Audio-visual segmentation via unlabeled frame exploitation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 26328--26339, 2024

  28. [36]

    In-context vectors: Making in context learning more effective and controllable through latent space steering

    Liu, S., Ye, H., Xing, L., and Zou, J. In-context vectors: Making in context learning more effective and controllable through latent space steering. arXiv preprint arXiv:2311.06668, 2023

  29. [37]

    Wdnet: Watermark-decomposition network for visible watermark removal

    Liu, Y., Zhu, Z., and Bai, X. Wdnet: Watermark-decomposition network for visible watermark removal. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp.\ 3685--3693, 2021

  30. [38]

    Towards end-to-end unified scene text detection and layout analysis

    Long, S., Qin, S., Panteleev, D., Bissacco, A., Fujii, Y., and Raptis, M. Towards end-to-end unified scene text detection and layout analysis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 1049--1059, 2022

  31. [39]

    and Zhu, A

    Lyu, G. and Zhu, A. Psstrnet: progressive segmentation-guided scene text removal network. In 2022 IEEE International Conference on Multimedia and Expo (ICME), pp.\ 1--6. IEEE, 2022

  32. [40]

    Lyu, G., Liu, K., Zhu, A., Uchida, S., and Iwana, B. K. Fetnet: Feature erasing and transferring network for scene text removal. Pattern Recognition, 140: 0 109531, 2023

  33. [41]

    Diffusionseg: Adapting diffusion towards unsupervised object discovery

    Ma, C., Yang, Y., Ju, C., Zhang, F., Liu, J., Wang, Y., Zhang, Y., and Wang, Y. Diffusionseg: Adapting diffusion towards unsupervised object discovery. arXiv preprint arXiv:2303.09813, 2023

  34. [42]

    Which examples to annotate for in-context learning? towards effective and efficient selection

    Mavromatis, C., Srinivasan, B., Shen, Z., Zhang, J., Rangwala, H., Faloutsos, C., and Karypis, G. Which examples to annotate for in-context learning? towards effective and efficient selection. arXiv preprint arXiv:2310.20046, 2023

  35. [43]

    Rethinking the role of demonstrations: What makes in-context learning work? arXiv preprint arXiv:2202.12837, 2022

    Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., and Zettlemoyer, L. Rethinking the role of demonstrations: What makes in-context learning work? arXiv preprint arXiv:2202.12837, 2022

  36. [44]

    Conditional generative adversarial nets

    Mirza, M. Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784, 2014

  37. [45]

    Scene text eraser

    Nakamura, T., Zhu, A., Yanai, K., and Uchida, S. Scene text eraser. In 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), volume 1, pp.\ 832--837. IEEE, 2017

  38. [46]

    Fine-grained visible watermark removal

    Niu, L., Zhao, X., Zhang, B., and Zhang, L. Fine-grained visible watermark removal. In Proceedings of the IEEE/CVF international conference on computer vision, pp.\ 12770--12779, 2023

  39. [47]

    Otsu, N. et al. A threshold selection method from gray-level histograms. Automatica, 11 0 (285-296): 0 23--27, 1975

  40. [48]

    What in-context learning “learns” in-context: Disentangling task recognition and task learning

    Pan, J. What in-context learning “learns” in-context: Disentangling task recognition and task learning. Master's thesis, Princeton University, 2023

  41. [49]

    Viteraser: Harnessing the power of vision transformers for scene text removal with segmim pretraining

    Peng, D., Liu, C., Liu, Y., and Jin, L. Viteraser: Harnessing the power of vision transformers for scene text removal with segmim pretraining. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pp.\ 4468--4477, 2024 a

  42. [50]

    Upocr: Towards unified pixel-level ocr interface

    Peng, D., Yang, Z., Zhang, J., Liu, C., Shi, Y., Ding, K., Guo, F., and Jin, L. Upocr: Towards unified pixel-level ocr interface. In Forty-first International Conference on Machine Learning, 2024 b

  43. [51]

    Image-to-image translation with conditional adversarial networks

    Phillip, I., Jun-Yan, Z., Tinghui, Z., Alexei, A., et al. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, volume 3, 2017

  44. [52]

    Looking from a higher-level perspective: Attention and recognition enhanced multi-scale scene text segmentation

    Ren, Y., Zhang, J., Chen, B., Zhang, X., and Jin, L. Looking from a higher-level perspective: Attention and recognition enhanced multi-scale scene text segmentation. In Proceedings of the Asian Conference on Computer Vision, pp.\ 3138--3154, 2022

  45. [53]

    High-resolution image synthesis with latent diffusion models

    Rombach, R., Blattmann, A., Lorenz, D., Esser, P., and Ommer, B. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 10684--10695, 2022

  46. [54]

    Learning to retrieve prompts for in-context learning

    Rubin, O., Herzig, J., and Berant, J. Learning to retrieve prompts for in-context learning. arXiv preprint arXiv:2112.08633, 2021

  47. [55]

    and Coustaty, M

    Sahay, R. and Coustaty, M. An enhanced prototypical network architecture for few-shot handwritten urdu character recognition. IEEE Access, 11: 0 33682--33696, 2023

  48. [56]

    What does clip know about a red circle? visual prompt engineering for vlms

    Shtedritski, A., Rupprecht, C., and Vedaldi, A. What does clip know about a red circle? visual prompt engineering for vlms. arXiv preprint arXiv:2304.06712, 2023

  49. [57]

    A., Forn \'e s, A., Kessentini, Y., and Megyesi, B

    Souibgui, M. A., Forn \'e s, A., Kessentini, Y., and Megyesi, B. Few shots are all you need: A progressive few shot learning approach for low resource handwritten text recognition. arXiv preprint arXiv:2107.10064, 2021

  50. [58]

    H., Shi, W., Wang, T., Xin, J., Zhang, R., Ostendorf, M., Zettlemoyer, L., Smith, N

    Su, H., Kasai, J., Wu, C. H., Shi, W., Wang, T., Xin, J., Zhang, R., Ostendorf, M., Zettlemoyer, L., Smith, N. A., et al. Selective annotation makes language models better few-shot learners. arXiv preprint arXiv:2209.01975, 2022

  51. [59]

    Exploring effective factors for improving visual in-context learning

    Sun, Y., Chen, Q., Wang, J., Wang, J., and Li, Z. Exploring effective factors for improving visual in-context learning. arXiv preprint arXiv:2304.04748, 2023

  52. [60]

    Stroke-based scene text erasing using synthetic data for training

    Tang, Z., Miyazaki, T., Sugaya, Y., and Omachi, S. Stroke-based scene text erasing using synthetic data for training. IEEE Transactions on Image Processing, 30: 0 9306--9320, 2021

  53. [61]

    Llama: Open and efficient foundation language models

    Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozi \`e re, B., Goyal, N., Hambro, E., Azhar, F., et al. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971, 2023

  54. [62]

    Mtrnet++: One-stage mask-based scene text eraser

    Tursun, O., Denman, S., Zeng, R., Sivapalan, S., Sridharan, S., and Fookes, C. Mtrnet++: One-stage mask-based scene text eraser. Computer Vision and Image Understanding, 201: 0 103066, 2020

  55. [63]

    N., Kim, S

    Vo, Q. N., Kim, S. H., Yang, H. J., and Lee, G. Binarization of degraded document images based on hierarchical deep supervised network. Pattern Recognition, 74: 0 568--586, 2018

  56. [64]

    Transformers learn in-context by gradient descent

    Von Oswald, J., Niklasson, E., Randazzo, E., Sacramento, J., Mordvintsev, A., Zhmoginov, A., and Vladymyrov, M. Transformers learn in-context by gradient descent. In International Conference on Machine Learning, pp.\ 35151--35174. PMLR, 2023

  57. [65]

    Deep high-resolution representation learning for visual recognition

    Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., Wang, X., et al. Deep high-resolution representation learning for visual recognition. IEEE transactions on pattern analysis and machine intelligence, 43 0 (10): 0 3349--3364, 2020

  58. [66]

    Label words are anchors: An information flow perspective for understanding in-context learning

    Wang, L., Li, L., Dai, D., Chen, D., Zhou, H., Meng, F., Zhou, J., and Sun, X. Label words are anchors: An information flow perspective for understanding in-context learning. arXiv preprint arXiv:2305.14160, 2023 a

  59. [67]

    and Zhou, D

    Wang, X. and Zhou, D. Chain-of-thought reasoning without prompting. arXiv preprint arXiv:2402.10200, 2024

  60. [68]

    Images speak in images: A generalist painter for in-context visual learning

    Wang, X., Wang, W., Cao, Y., Shen, C., and Huang, T. Images speak in images: A generalist painter for in-context visual learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 6830--6839, 2023 b

  61. [69]

    Textformer: component-aware text segmentation with transformer

    Wang, X., Wu, C., Yu, H., Li, B., and Xue, X. Textformer: component-aware text segmentation with transformer. In 2023 IEEE International Conference on Multimedia and Expo (ICME), pp.\ 1877--1882. IEEE, 2023 c

  62. [70]

    Seggpt: Segmenting everything in context

    Wang, X., Zhang, X., Cao, Y., Wang, W., Shen, C., and Huang, T. Seggpt: Segmenting everything in context. arXiv preprint arXiv:2304.03284, 2023 d

  63. [71]

    Skeleton-in-context: Unified skeleton sequence modeling with in-context learning

    Wang, X., Fang, Z., Li, X., Li, X., Chen, C., and Liu, M. Skeleton-in-context: Unified skeleton sequence modeling with in-context learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 2436--2446, 2024

  64. [72]

    What is the real need for scene text removal? exploring the background integrity and erasure exhaustivity properties

    Wang, Y., Xie, H., Wang, Z., Qu, Y., and Zhang, Y. What is the real need for scene text removal? exploring the background integrity and erasure exhaustivity properties. IEEE Transactions on Image Processing, 2023 e

  65. [73]

    In-context learning unlocked for diffusion models

    Wang, Z., Jiang, Y., Lu, Y., He, P., Chen, W., Wang, Z., Zhou, M., et al. In-context learning unlocked for diffusion models. Advances in Neural Information Processing Systems, 36: 0 8542--8562, 2023 f

  66. [74]

    V., Zhou, D., et al

    Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., Le, Q. V., Zhou, D., et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35: 0 24824--24837, 2022

  67. [75]

    The learnability of in-context learning

    Wies, N., Levine, Y., and Shashua, A. The learnability of in-context learning. Advances in Neural Information Processing Systems, 36: 0 36637--36651, 2023

  68. [76]

    M., and Luo, P

    Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J. M., and Luo, P. Segformer: Simple and efficient design for semantic segmentation with transformers. Advances in neural information processing systems, 34: 0 12077--12090, 2021 a

  69. [77]

    M., Raghunathan, A., Liang, P., and Ma, T

    Xie, S. M., Raghunathan, A., Liang, P., and Ma, T. An explanation of in-context learning as implicit bayesian inference. arXiv preprint arXiv:2111.02080, 2021 b

  70. [78]

    Rethinking text segmentation: A novel dataset and a text-specific refinement approach

    Xu, X., Zhang, Z., Wang, Z., Price, B., Wang, Z., and Shi, H. Rethinking text segmentation: A novel dataset and a text-specific refinement approach. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 12045--12055, 2021

  71. [79]

    Bts: a bi-lingual benchmark for text segmentation in the wild

    Xu, X., Qi, Z., Ma, J., Zhang, H., Shan, Y., and Qie, X. Bts: a bi-lingual benchmark for text segmentation in the wild. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 19152--19162, 2022

  72. [80]

    Set-of-mark prompting unleashes extraordinary visual grounding in gpt-4v

    Yang, J., Zhang, H., Li, F., Zou, X., Li, C., and Gao, J. Set-of-mark prompting unleashes extraordinary visual grounding in gpt-4v. arXiv preprint arXiv:2310.11441, 2023

  73. [81]

    Multi-modal prototypes for open-world semantic segmentation

    Yang, Y., Ma, C., Ju, C., Zhang, F., Yao, J., Zhang, Y., and Wang, Y. Multi-modal prototypes for open-world semantic segmentation. International Journal of Computer Vision, 132 0 (12): 0 6004--6020, 2024

  74. [82]

    Hi-sam: Marrying segment anything model for hierarchical text segmentation

    Ye, M., Zhang, J., Liu, J., Liu, C., Yin, B., Liu, C., Du, B., and Tao, D. Hi-sam: Marrying segment anything model for hierarchical text segmentation. arXiv preprint arXiv:2401.17904, 2024

  75. [83]

    Scene text segmentation with text-focused transformers

    Yu, H., Wang, X., Niu, K., Li, B., and Xue, X. Scene text segmentation with text-focused transformers. In Proceedings of the 31st ACM International Conference on Multimedia, pp.\ 2898--2907, 2023 a

  76. [84]

    Scene text segmentation with text-focused transformers

    Yu, H., Wang, X., Niu, K., Li, B., and Xue, X. Scene text segmentation with text-focused transformers. In Proceedings of the 31st ACM International Conference on Multimedia, pp.\ 2898--2907, 2023 b

  77. [85]

    Eaformer: Scene text segmentation with edge-aware transformers

    Yu, H., Fu, T., Li, B., and Xue, X. Eaformer: Scene text segmentation with edge-aware transformers. In European Conference on Computer Vision, pp.\ 410--427. Springer, 2024

  78. [86]

    and Ananiadou, S

    Yu, Z. and Ananiadou, S. How do large language models learn in-context? query and key matrices of in-context heads are two towers for metric learning. arXiv preprint arXiv:2402.02872, 2024

  79. [87]

    and Nakayama, H

    Zdenek, J. and Nakayama, H. Erasing scene text with weak supervision. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp.\ 2238--2246, 2020

  80. [88]

    Choose what you need: Disentangled representation learning for scene text recognition removal and editing

    Zhang, B., Xie, H., Gao, Z., and Wang, Y. Choose what you need: Disentangled representation learning for scene text recognition removal and editing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 28358--28368, 2024 a

  81. [89]

    Complementary patch for weakly supervised semantic segmentation

    Zhang, F., Gu, C., Zhang, C., and Dai, Y. Complementary patch for weakly supervised semantic segmentation. In Proceedings of the IEEE/CVF international conference on computer vision, pp.\ 7242--7251, 2021

  82. [90]

    Uncovering prototypical knowledge for weakly open-vocabulary semantic segmentation

    Zhang, F., Zhou, T., Li, B., He, H., Ma, C., Zhang, T., Yao, J., Zhang, Y., and Wang, Y. Uncovering prototypical knowledge for weakly open-vocabulary semantic segmentation. Advances in Neural Information Processing Systems, 36: 0 73652--73665, 2023 a

  83. [91]

    Instruct me more! random prompting for visual in-context learning

    Zhang, J., Wang, B., Li, L., Nakashima, Y., and Nagahara, H. Instruct me more! random prompting for visual in-context learning. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp.\ 2597--2606, 2024 b

  84. [92]

    Ensnet: Ensconce text in the wild

    Zhang, S., Liu, Y., Jin, L., Huang, Y., and Lai, S. Ensnet: Ensconce text in the wild. In Proceedings of the AAAI conference on artificial intelligence, volume 33, pp.\ 801--808, 2019

  85. [93]

    G4seg: Generation for inexact segmentation refinement with diffusion models, 2025

    Zhang, T., Zhang, F., Yao, J., Zhang, Y., and Wang, Y. G4seg: Generation for inexact segmentation refinement with diffusion models, 2025. URL https://arxiv.org/abs/2506.01539

  86. [94]

    What makes good examples for visual in-context learning? Advances in Neural Information Processing Systems, 36: 0 17773--17794, 2023 b

    Zhang, Y., Zhou, K., and Liu, Z. What makes good examples for visual in-context learning? Advances in Neural Information Processing Systems, 36: 0 17773--17794, 2023 b

  87. [95]

    Image segmentation in foundation model era: A survey

    Zhou, T., Xia, W., Zhang, F., Chang, B., Wang, W., Yuan, Y., Konukoglu, E., and Cremers, D. Image segmentation in foundation model era: A survey. arXiv preprint arXiv:2408.12957, 2024

  88. [96]

    Visual text generation in the wild

    Zhu, Y., Liu, J., Gao, F., Liu, W., Wang, X., Wang, P., Huang, F., Yao, C., and Yang, Z. Visual text generation in the wild. arXiv preprint arXiv:2407.14138, 2024

  89. [97]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.