Pith. sign in

REVIEW 4 major objections 6 minor 108 references

KptLLM++: Towards Generic Keypoint Comprehension with Large Language Model

T0 review · 4 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read This paper claims that a single multimodal large language model can both interpret the meaning of a keypoint and output its precise pixel position, achieving state-of-the-art accuracy on human, animal, and object benchmarks.

desk verdict A worthwhile step toward a single MLLM for keypoint semantics and detection, but the evidence is uneven; send to review, expect a major revision. read the letter →

arxiv 2507.11102 v1 pith:ZAL5AMIP submitted 2025-07-15 cs.CV

Jie Yang , Wang Zeng , Sheng Jin , Lumin Xu , Wentao Liu , Chen Qian , Zhen Li , Ruimao Zhang This is my paper
classification cs.CV
keywords keypointdetectionposeestimationmultimodallargelanguagemodelgenericcomprehensioncategory-agnosticopen-vocabularyidentify-then-detectchain-of-thought
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper claims that a multimodal large language model can become a generic keypoint engine: one model that reads the semantic meaning of a keypoint and outputs its location at pixel precision, whether the prompt is an image, a keypoint name, or a detailed text description. The proposed system, KptLLM++, uses an identify-then-detect chain-of-thought in which the model first states what the keypoint is and then writes its normalized coordinates as plain text, so no special token or regression head is needed. Trained on more than 500,000 samples spanning humans, animals, vehicles, and occluded or artistic scenes, it reports the best results among compared methods on MP-100, AP-10K, COCO, Human-Art, MacaquePose, Animal Kingdom, and CarFusion, and 79.2 PCK@0.2 on AnimalPose, which the paper treats as an unseen test set. If correct, this removes the presumed accuracy ceiling on LLM-based keypoint detection and turns keypoint understanding into a conversational, instruction-driven task.

What carries the argument

The load-bearing mechanism is the Identify-then-Detect (ItD) strategy: a single autoregressive response first names or interprets the keypoint's semantics and then emits its normalized coordinates as text, within the same chain-of-thought. Supporting components are the prompt feature extractor, which uses cross-attention layers over the support-image features to isolate keypoint-specific visual evidence and disambiguate mirror-symmetric keypoints; the DINOv2 visual encoder; LoRA fine-tuning of the LLM; and a joint training pool of eight datasets. The textual-coordinate decoder matters because it eliminates the need for a new vocabulary token and a regression head, which the paper argues makes training simpler and scales cleanly to many keypoint categories.

What would settle it

Train the same model on the same eight datasets after deleting every training image labeled dog, cat, cow, horse, or sheep, then measure PCK@0.2 on AnimalPose; if it stays near 79.2 the generalization claim holds, and if it falls toward the 59.1 no-scaling level or below X-Pose's 73.4, the claimed unseen-category gain is an artifact of category overlap.

Watch

Extended reading notes

Core claim

The central claim, stated in Section 4.5, is that KptLLM++ outperforms every compared vision-only and vision-language method on the tested keypoint benchmarks, breaking the previously perceived performance upper bound for LLM-based approaches. The key design is the identify-then-detect paradigm: the LLM first interprets the semantic meaning of the prompted keypoint and then localizes it through a structured chain-of-thought, which helps resolve ambiguous left/right and symmetric-keypoint cases. Coordinates are normalized to [0,1], rounded to three decimal places, and generated directly as text tokens, replacing the special keypoint token and feed-forward regression head of the earlier KptLLM. Switching the visual encoder from CLIP to DINOv2 and scaling the training mixture to eight datasets with over half a million samples are credited with converting these choices into large gains, including a jump on AnimalPose from 55.9 to 79.2 PCK@0.2.

Load-bearing premise

The generalization result assumes that the AnimalPose categories are genuinely unseen, but the training pool includes animal datasets that plausibly already contain dogs, cats, cows, horses, and sheep.

Editorial extensions

If this is right

  • A single model can answer keypoint-semantic questions, visual-prompt detection, and text-prompt detection without changing architecture or adding task heads.
  • Textual coordinate output makes keypoint detection human-readable and lets users batch multiple keypoint queries into one conversation turn.
  • The same architecture without dataset scaling scores 59.1 on AnimalPose; with scaling it scores 79.2, so data diversity is presented as the main driver of out-of-domain accuracy.
  • Adding the identify-then-detect step raises PCK on MP-100 Split-1 from 87.68 to 91.66, so semantic interpretation is a direct contributor to localization accuracy.
  • Combining the model with an open-world object detector yields a multi-object pipeline, since the detector supplies crops and the model localizes keypoints within each crop.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The AnimalPose number is probably not a clean zero-shot result: the five test categories are common animals, and the training pool includes AnimalWeb, Animal Kingdom, and AP-10K, so the 79.2 PCK likely measures familiar-category generalization, not unseen-keypoint generalization; a held-out-order experiment would settle this.
  • If text-based coordinate decoding is what enables scaling, then the 3-decimal rounding (one part in a thousand of image size) sets a floor on localization precision; testing finer or coarser rounding would show whether this is the current bottleneck.
  • The identify-then-detect recipe should transfer to other pixel-level grounding tasks, such as part segmentation or landmark-conditioned generation, wherever an LLM can verbalize the semantics before emitting coordinates; that transfer is not demonstrated in the paper.
  • An end-to-end multi-object variant that trains the detector together with the keypoint model could reduce sensitivity to box errors, which the paper's own failure analysis identifies as a main source of mistakes.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper proposes KptLLM++, a multimodal large language model for generic keypoint comprehension, unifying three tasks: keypoint semantic understanding, visual-prompt-based keypoint detection, and textual-prompt-based keypoint detection. The model uses an identify-then-detect strategy, first generating semantic keypoint descriptions and then localizing keypoints via textual coordinate output, with a DINOv2 visual encoder and Vicuna-7B backbone. Training is scaled to over 500K samples across eight datasets. Experiments report state-of-the-art results on COCO, AP-10K, Human-Art, MacaquePose, Animal Kingdom, and CarFusion, plus a generalization result on AnimalPose (PCK@0.2=79.2 vs X-Pose's 73.4). Ablations on the earlier KptLLM model support design choices such as the identify-then-detect strategy and the prompt feature extractor.

Significance. If the results hold, this is a valuable step toward unified keypoint understanding, demonstrating that an MLLM can combine semantic interpretation with pixel-precision localization across diverse object categories. The paper's main strengths are the clearly described architecture, the large-scale training recipe, the textual-coordinate decoding simplification, and the explicit identify-then-detect mechanism. The claimed contributions are significant for the keypoint detection and vision-language communities. However, the evidence as currently presented is not yet sufficient to support the 'generic' and 'state-of-the-art' claims because the generalization experiment is not clean, several core results are reported for the predecessor model KptLLM rather than KptLLM++, and the SOTA comparisons lack protocol details.

major comments (4)
  1. [Section 4.1.1(4) and Table 9] The claim that AnimalPose is an 'unseen dataset' for evaluating generalization is not supported by the reported training pool. Section 3.7 and Section 4.1.1(3) list AnimalWeb (334 species with facial keypoints), AP-10K (23 animal families, 54 species), APT-36K, and Animal Kingdom among the eight joint-training datasets, and the five AnimalPose categories (dog, cat, cow, horse, sheep) are common domestic animals almost certainly represented in those sources. The paper provides no per-category breakdown, no category-overlap analysis, and no leave-family-out re-split. Consequently, the PCK@0.2=79.2 in Table 9 may measure familiar-category detection rather than zero-shot generalization to unseen keypoints, which is exactly the load-bearing premise of the 'generic' claim. This tension is reinforced by Section 4.7, which acknowledges that KptLLM++ 'struggles with generalizing to completely unseen keypoints.' The authors should provide a category-overlap audit, per-category PCK on AnimalPose, and a leave-family-out evaluation that excludes all animal families present in the training pool.
  2. [Sections 4.2–4.4 and Tables 1–4] The paper's title and abstract present KptLLM++ as the unified model, but the keypoint semantic understanding results (Table 1), visual-prompt-based detection results (Tables 2 and 3), and textual-prompt-based AP-10K results (Table 4) are all reported for the earlier KptLLM model, not for KptLLM++. KptLLM++ is evaluated only in Section 4.5's joint generic detection section. Since KptLLM uses a different decoding strategy (special-token regression head), a CLIP visual encoder, and a smaller training set, the unified three-task capability claimed for KptLLM++ is not directly evidenced. The paper should either report KptLLM++ results on MP-100 and AP-10K or clearly reframe these tables as KptLLM-baseline comparisons, and the abstract/conclusion should not attribute these results to KptLLM++.
  3. [Section 4.5, Tables 6–12] The 'state-of-the-art' comparisons in the joint generic detection section lack the protocol detail needed to support the central claim. Table 6 states that all top-down methods use GT bounding boxes and that no flip tests are used, but it does not report matched input resolutions, backbone sizes, training data, or whether the comparison methods were evaluated under identical single-scale conditions. The margins over strong baselines are small (e.g., 78.1 vs 77.4 for ViTPose and LocLLM on COCO), so small protocol differences could change the ranking. Table 12 compares AP for ED-Pose with PCK@0.2 for other methods on CarFusion, and the text does not specify whether ED-Pose is a top-down method using GT boxes. The authors should provide complete experimental configurations for every baseline and the proposed model, and ideally report standard deviations or significance tests where margins are narrow.
  4. [Section 4.6, Tables 13–16] All four ablation studies are conducted on the visual prompt-based keypoint detection task using MP-100 Split-1 with the KptLLM model, not KptLLM++. The identify-then-detect strategy, prompt feature extractor, and combined visual-textual prompts are therefore validated only for the predecessor architecture that uses special-token regression and a CLIP encoder. Because KptLLM++ changes the decoding to textual coordinates and replaces the visual encoder with DINOv2, the transferability of these ablations to the proposed model is not established. The authors should run the key ablations on KptLLM++ (or explicitly justify why the earlier model's ablations carry over), since the identify-then-detect mechanism is a central architectural claim.
minor comments (6)
  1. [Section 4.1.2, paragraph (1)] The sentence 'We aggregate the results to derive accuracy rates ((2)' is incomplete and contains a formatting error; it should be rewritten.
  2. [Section 3.4 heading] There is a typo in the heading: 'Indentify-then-Detect' should be 'Identify-then-Detect'.
  3. [Section 3, first paragraph and Figure 2] The text says 'KptLLM accepts multiple images' but the figure caption and surrounding context refer to KptLLM++; the naming should be made consistent throughout.
  4. [Table 5] The 'Scaling Up' column uses symbols '×' and '✓' without a legend; the paper should clarify that '×' means no scaling and '✓' means joint training with the eight datasets.
  5. [Section 4.5] The phrase 'breaking the previously perceived performance upper bound for LLM-based approaches' is vague; the authors should cite the specific prior result or bound they are referring to.
  6. [Section 4.1.3] The model name 'LLaV A-V1.5-7B' appears with an inconsistent space; it should be written consistently as 'LLaVA-V1.5-7B'.

Circularity Check

0 steps flagged · score 1.0 of 10

No material circularity: SOTA claims are benchmarked against external systems and the identify-then-detect design is internally ablated; self-citations to KptLLM are preliminary but not load-bearing.

full rationale

The paper's central claims are empirical: KptLLM++ is trained on public datasets with a standard LM loss (Eq. 8) and compared on COCO, AP-10K, Human-Art, MacaquePose, Animal Kingdom, CarFusion, and MP-100 against external baselines (ViTPose, HRNet, X-Pose, LocLLM, VisionLLM v2, etc.). No reported number is obtained by fitting a parameter to the evaluation quantity and then renaming it a prediction. The identify-then-detect strategy is justified by the paper's own ablation (Tab. 13: w/o ItD 87.68 vs w/ ItD 91.66 PCK), not by citation alone. The coordinate-decoding change from KptLLM's FFN regression (Eq. 7) to textual coordinates (Eq. 8) is an architectural modification evaluated independently. The self-citations to the authors' KptLLM describe the preliminary system and motivate upgrades, but the SOTA and generalization tables do not depend on an unverified self-cited theorem; they are direct comparisons. The one substantive weakness is Section 4.1.1(4)'s characterization of AnimalPose as 'the unseen dataset' while the training pool contains AnimalWeb, AP-10K, Animal Kingdom, and APT-36K; the five AnimalPose classes (dog, cat, cow, horse, sheep) are plausibly represented in those sources, so PCK@0.2=79.2 may not be a clean zero-shot generalization result. That is an evaluation-contamination / protocol risk, not a circular derivation: the paper does not use AnimalPose labels in training, and no equation reduces to its own input. Similarly, the 'Generic Keypoint Comprehension' formulation is a task definition, not a derived result. Overall, no prediction is equivalent to its inputs by construction, so the circularity score is low.

Assumptions & free parameters 6 free parameters · 4 assumptions · 0 invented entities

No new physical entities are introduced. The paper's contributions are a task framing, an architecture, and a data recipe; the load-bearing premises are the cleanliness of the unseen-data evaluation and the transferability of pretrained LLM and vision features.

free parameters (6)
  • LLM LoRA rank and alpha = rank=128, alpha=256
    Hand-chosen hyperparameters in Section 4.1.3; capacity affects performance.
  • Input image resolution = 224x224 for KptLLM++; 336x336 for KptLLM
    Chosen in Section 4.1.3; affects local precision and computational cost.
  • Coordinate rounding precision = 3 decimal places in [0,1]
    Introduced in Section 3.4; caps the finest coordinate granularity and is a design choice.
  • Loss weight lambda = 2 (only in Eq. 7 for KptLLM)
    Used for the earlier keypoint regression model; not used for KptLLM++.
  • Optimizer and schedule settings = AdamW, lr 2e-4, weight decay 0, batch 16 per GPU on 8 A100s
    Training settings in Section 4.1.3; standard but hand-tuned.
  • Number of cross-attention layers in prompt feature extractor = 2
    Specified in Section 3.3 as a two-layer transformer; selected by hand.
assumptions (4)
  • domain assumption AnimalPose categories are unseen during training
    Section 4.1.1 labels AnimalPose as the unseen dataset, but AnimalWeb, Animal Kingdom, and AP-10K in the training pool likely contain the same species (dog, cat, cow, horse, sheep).
  • domain assumption Vicuna-7B provides the commonsense knowledge needed for keypoint semantics
    The LLM is the knowledge source for the identify step, per Sections 1 and 3.4.
  • domain assumption Evaluation protocols (top-down with GT boxes, PCK, OKS) are accepted ways to compare keypoint detectors
    Used throughout Section 4 without justification; reasonable for the field.
  • domain assumption The MP-100 semantic labels from X-Pose are accurate enough to measure semantic understanding
    Section 4.1.2 adopts X-Pose's keypoint semantic labels and excludes ambiguous ones.

how reviews work

0 comments
Cite this review

Pith. "Pith review of KptLLM++: Towards Generic Keypoint Comprehension with Large Language Model." pith.science (2026). https://pith.science/paper/ZAL5AMIP

@misc{pith2026250711102,
  author       = {Pith},
  title        = {Pith review of: KptLLM++: Towards Generic Keypoint Comprehension with Large Language Model},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/ZAL5AMIP}},
  note         = {Machine review of arXiv:2507.11102}
}
read the original abstract

The emergence of Multimodal Large Language Models (MLLMs) has revolutionized image understanding by bridging textual and visual modalities. However, these models often struggle with capturing fine-grained semantic information, such as the precise identification and analysis of object keypoints. Keypoints, as structure-aware, pixel-level, and compact representations of objects, particularly articulated ones, play a crucial role in applications such as fine-grained image analysis, object retrieval, and behavior recognition. In this paper, we propose KptLLM++, a novel multimodal large language model that specifically designed for generic keypoint comprehension through the integration of diverse input modalities guided by user-defined instructions. By unifying keypoint detection across varied contexts, KptLLM++ establishes itself as an advanced interface, fostering more effective human-AI collaboration. The model is built upon a novel identify-then-detect paradigm, which first interprets keypoint semantics and subsequently localizes their precise positions through a structured chain-of-thought reasoning mechanism. To push the boundaries of performance, we have scaled up the training dataset to over 500K samples, encompassing diverse objects, keypoint categories, image styles, and scenarios with complex occlusions. This extensive scaling enables KptLLM++ to unlock its potential, achieving remarkable accuracy and generalization. Comprehensive experiments on multiple keypoint detection benchmarks demonstrate its state-of-the-art performance, underscoring its potential as a unified solution for fine-grained image understanding and its transformative implications for human-AI interaction.

Figures

Figures reproduced from arXiv: 2507.11102 by the authors.

Figure 1
Figure 1. This work aims to address the problem of generic keypoint comprehension, which aims to understand keypoints [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. We introduce KptLLM++, a unified framework designed to address three tasks of generic keypoint comprehension: [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. User interface of our model for keypoint comprehension under different scenarios. On the left, when a text description [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figures from the paper (5 more)
Figure 4
Figure 4. Figure 4: Statistical analysis of the datasets used for joint train [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]
Figure 5
Figure 5. Figure 5: Using the same support image with support keypoints, our model could effectively detect different query images with [PITH_FULL_IMAGE:figures/full_fig_p010_5.png]
Figure 6
Figure 6. Figure 6: Visualization Results of KptLLM++, including COCO, Human-Art, AP-10K, MacaquePose, Animal Kingdom and [PITH_FULL_IMAGE:figures/full_fig_p012_6.png]
Figure 7
Figure 7. Figure 7: Visualization results of KptLLM++ via Textual Prompt-based Keypoint Detection on the images from the Internet containing arbitrary categories. As illustrated in Sec. 3.7, we employ the open-set object detector-GroundingDINO (Liu et al., 2025) to provide boundingbox of …
Figure 8
Figure 8. Figure 8: Failure Case Analysis [PITH_FULL_IMAGE:figures/full_fig_p015_8.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

108 extracted references · 36 canonical work pages

  1. [1]

    Gpt-4 technical report

    Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774, 2023

    arXiv 2023

  2. [2]

    Flamingo: a visual language model for few-shot learning

    Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, et al. Flamingo: a visual language model for few-shot learning. Advances in neural information processing systems, 35: 0 23716--23736, 2022

    2022

  3. [3]

    2d human pose estimation: New benchmark and state of the art analysis

    Mykhaylo Andriluka, Leonid Pishchulin, Peter Gehler, and Bernt Schiele. 2d human pose estimation: New benchmark and state of the art analysis. In IEEE Conf. Comput. Vis. Pattern Recog., 2014

    2014

  4. [4]

    Qwen-vl: A frontier large vision-language model with versatile abilities

    Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou. Qwen-vl: A frontier large vision-language model with versatile abilities. arXiv preprint arXiv:2308.12966, 2023

    arXiv 2023

  5. [5]

    Language models are few-shot learners

    Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. Advances in neural information processing systems, 33: 0 1877--1901, 2020

    1901

  6. [6]

    Cross-domain adaptation for animal pose estimation

    Jinkun Cao, Hongyang Tang, Hao-Shu Fang, Xiaoyong Shen, Cewu Lu, and Yu-Wing Tai. Cross-domain adaptation for animal pose estimation. In Int. Conf. Comput. Vis., 2019

    2019

  7. [7]

    Shikra: Unleashing multimodal llm's referential dialogue magic

    Keqin Chen, Zhao Zhang, Weili Zeng, Richong Zhang, Feng Zhu, and Rui Zhao. Shikra: Unleashing multimodal llm's referential dialogue magic. arXiv preprint arXiv:2306.15195, 2023

    arXiv 2023

  8. [8]

    Motionllm: Understanding human behaviors from human motions and videos

    Ling-Hao Chen, Shunlin Lu, Ailing Zeng, Hao Zhang, Benyou Wang, Ruimao Zhang, and Lei Zhang. Motionllm: Understanding human behaviors from human motions and videos. arXiv preprint arXiv:2405.20340, 2024

    arXiv 2024

Show all 108 references
  1. [9]

    Cascaded pyramid network for multi-person pose estimation

    Yilun Chen, Zhicheng Wang, Yuxiang Peng, Zhiqiang Zhang, Gang Yu, and Jian Sun. Cascaded pyramid network for multi-person pose estimation. In IEEE Conf. Comput. Vis. Pattern Recog., 2018

    2018

  2. [10]

    Higherhrnet: Scale-aware representation learning for bottom-up human pose estimation

    Bowen Cheng, Bin Xiao, Jingdong Wang, Honghui Shi, Thomas S Huang, and Lei Zhang. Higherhrnet: Scale-aware representation learning for bottom-up human pose estimation. In IEEE Conf. Comput. Vis. Pattern Recog., 2020

    2020

  3. [11]

    Palm: Scaling language modeling with pathways

    Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al. Palm: Scaling language modeling with pathways. Journal of Machine Learning Research, 24 0 (240): 0 1--113, 2023

    2023

  4. [12]

    Instructblip: Towards general-purpose vision-language models with instruction tuning

    Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale N Fung, and Steven Hoi. Instructblip: Towards general-purpose vision-language models with instruction tuning. Advances in Neural Information Processing Systems, 36, 2024

    2024

  5. [13]

    Model-agnostic meta-learning for fast adaptation of deep networks

    Chelsea Finn, Pieter Abbeel, and Sergey Levine. Model-agnostic meta-learning for fast adaptation of deep networks. In Int. Conf. Mach. Learn., 2017

    2017

  6. [14]

    Deepfashion2: A versatile benchmark for detection, pose estimation, segmentation and re-identification of clothing images

    Yuying Ge, Ruimao Zhang, Xiaogang Wang, Xiaoou Tang, and Ping Luo. Deepfashion2: A versatile benchmark for detection, pose estimation, segmentation and re-identification of clothing images. In IEEE Conf. Comput. Vis. Pattern Recog., 2019

    2019

  7. [15]

    Liveportrait: Efficient portrait animation with stitching and retargeting control

    Jianzhu Guo, Dingyun Zhang, Xiaoqiang Liu, Zhizhou Zhong, Yuan Zhang, Pengfei Wan, and Di Zhang. Liveportrait: Efficient portrait animation with stitching and retargeting control. arXiv preprint arXiv:2407.03168, 2024

    2024 arXiv

  8. [16]

    Lora: Low-rank adaptation of large language models

    Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685, 2021

    2021 arXiv

  9. [17]

    Mistral 7b

    Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al. Mistral 7b. arXiv preprint arXiv:2310.06825, 2023

    arXiv

  10. [18]

    Multi-person articulated tracking with spatial and temporal embeddings

    Sheng Jin, Wentao Liu, Wanli Ouyang, and Chen Qian. Multi-person articulated tracking with spatial and temporal embeddings. In IEEE Conf. Comput. Vis. Pattern Recog., 2019

    2019

  11. [19]

    Differentiable hierarchical graph grouping for multi-person pose estimation

    Sheng Jin, Wentao Liu, Enze Xie, Wenhai Wang, Chen Qian, Wanli Ouyang, and Ping Luo. Differentiable hierarchical graph grouping for multi-person pose estimation. In Eur. Conf. Comput. Vis., 2020 a

    2020

  12. [20]

    Whole-body human pose estimation in the wild

    Sheng Jin, Lumin Xu, Jin Xu, Can Wang, Wentao Liu, Chen Qian, Wanli Ouyang, and Ping Luo. Whole-body human pose estimation in the wild. In Eur. Conf. Comput. Vis., 2020 b

    2020

  13. [21]

    Human-art: A versatile human-centric dataset bridging natural and artificial scenes

    Xuan Ju, Ailing Zeng, Jianan Wang, Qiang Xu, and Lei Zhang. Human-art: A versatile human-centric dataset bridging natural and artificial scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 618--629, 2023 a

    2023

  14. [22]

    Humansd: A native skeleton-guided diffusion model for human image generation

    Xuan Ju, Ailing Zeng, Chenchen Zhao, Jianan Wang, Lei Zhang, and Qiang Xu. Humansd: A native skeleton-guided diffusion model for human image generation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 15988--15998, 2023 b

    2023

  15. [23]

    Animalweb: A large-scale hierarchical dataset of annotated animal faces

    Muhammad Haris Khan, John McDonagh, Salman Khan, Muhammad Shahabuddin, Aditya Arora, Fahad Shahbaz Khan, Ling Shao, and Georgios Tzimiropoulos. Animalweb: A large-scale hierarchical dataset of annotated animal faces. In IEEE Conf. Comput. Vis. Pattern Recog., 2020

    2020

  16. [24]

    Segment anything

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al. Segment anything. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 4015--4026, 2023

    2023

  17. [25]

    in the wild

    Rollyn Labuguen, Jumpei Matsumoto, Salvador Blanco Negrete, Hiroshi Nishimaru, Hisao Nishijo, Masahiko Takada, Yasuhiro Go, Ken-ichi Inoue, and Tomohiro Shibata. Macaquepose: A novel “in the wild” macaque monkey pose dataset for markerless motion capture. Frontiers in behavior...

    2021

  18. [26]

    Lisa: Reasoning segmentation via large language model

    Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, and Jiaya Jia. Lisa: Reasoning segmentation via large language model. arXiv preprint arXiv:2308.00692, 2023

    2023 arXiv

  19. [27]

    What matters when building vision-language models? arXiv preprint arXiv:2405.02246, 2024

    Hugo Lauren c on, L \'e o Tronchon, Matthieu Cord, and Victor Sanh. What matters when building vision-language models? arXiv preprint arXiv:2405.02246, 2024

    2024 arXiv

  20. [28]

    Mimic-it: Multi-modal in-context instruction tuning

    Bo Li, Yuanhan Zhang, Liangyu Chen, Jinghao Wang, Fanyi Pu, Jingkang Yang, Chunyuan Li, and Ziwei Liu. Mimic-it: Multi-modal in-context instruction tuning. arXiv preprint arXiv:2306.05425, 2023 a

    2023 arXiv

  21. [29]

    Crowdpose: Efficient crowded scenes pose estimation and a new benchmark

    Jiefeng Li, Can Wang, Hao Zhu, Yihuan Mao, Hao-Shu Fang, and Cewu Lu. Crowdpose: Efficient crowded scenes pose estimation and a new benchmark. In IEEE Conf. Comput. Vis. Pattern Recog., 2019

    2019

  22. [30]

    Human pose regression with residual log-likelihood estimation

    Jiefeng Li, Siyuan Bian, Ailing Zeng, Can Wang, Bo Pang, Wentao Liu, and Cewu Lu. Human pose regression with residual log-likelihood estimation. In Int. Conf. Comput. Vis., 2021 a

    2021

  23. [31]

    Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models

    Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. In International conference on machine learning, pages 19730--19742. PMLR, 2023 b

    2023

  24. [32]

    Tokenpose: Learning keypoint tokens for human pose estimation

    Yanjie Li, Shoukui Zhang, Zhicheng Wang, Sen Yang, Wankou Yang, Shu-Tao Xia, and Erjin Zhou. Tokenpose: Learning keypoint tokens for human pose estimation. arXiv preprint arXiv:2104.03516, 2021 b

    2021 arXiv

  25. [33]

    Simcc: A simple coordinate classification perspective for human pose estimation

    Yanjie Li, Sen Yang, Peidong Liu, Shoukui Zhang, Yunxiao Wang, Zhicheng Wang, Wankou Yang, and Shu-Tao Xia. Simcc: A simple coordinate classification perspective for human pose estimation. In European Conference on Computer Vision, pages 89--106. Springer, 2022

    2022

  26. [34]

    Mini-gemini: Mining the potential of multi-modality vision language models

    Yanwei Li, Yuechen Zhang, Chengyao Wang, Zhisheng Zhong, Yixin Chen, Ruihang Chu, Shaoteng Liu, and Jiaya Jia. Mini-gemini: Mining the potential of multi-modality vision language models. arXiv:2403.18814, 2023 c

    2023 arXiv

  27. [35]

    Vila: On pre-training for visual language models

    Ji Lin, Hongxu Yin, Wei Ping, Yao Lu, Pavlo Molchanov, Andrew Tao, Huizi Mao, Jan Kautz, Mohammad Shoeybi, and Song Han. Vila: On pre-training for visual language models. arXiv preprint arXiv:2312.07533, 2023

    2023 arXiv

  28. [36]

    Microsoft coco: Common objects in context

    Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll \'a r, and C Lawrence Zitnick. Microsoft coco: Common objects in context. In Eur. Conf. Comput. Vis., 2014

    2014

  29. [37]

    Improved baselines with visual instruction tuning, 2023 a

    Haotian Liu, Chunyuan Li, Yuheng Li, and Yong Jae Lee. Improved baselines with visual instruction tuning, 2023 a

    2023

  30. [38]

    Visual instruction tuning, 2023 b

    Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. Visual instruction tuning, 2023 b

    2023

  31. [39]

    Llava-next: Improved reasoning, ocr, and world knowledge, January 2024

    Haotian Liu, Chunyuan Li, Yuheng Li, Bo Li, Yuanhan Zhang, Sheng Shen, and Yong Jae Lee. Llava-next: Improved reasoning, ocr, and world knowledge, January 2024. URL https://llava-vl.github.io/blog/2024-01-30-llava-next/

    2024

  32. [40]

    Grounding dino: Marrying dino with grounded pre-training for open-set object detection

    Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang, Hang Su, et al. Grounding dino: Marrying dino with grounded pre-training for open-set object detection. In European Conference on Computer Vision, pages 38--55. Springer, 2025

    2025

  33. [41]

    A convnet for the 2020s

    Zhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell, and Saining Xie. A convnet for the 2020s. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11976--11986, 2022

    2022

  34. [42]

    Deepseek-vl: Towards real-world vision-language understanding, 2024

    Haoyu Lu, Wen Liu, Bo Zhang, Bingxuan Wang, Kai Dong, Bo Liu, Jingxiang Sun, Tongzheng Ren, Zhuoshu Li, Hao Yang, Yaofeng Sun, Chengqi Deng, Hanwei Xu, Zhenda Xie, and Chong Ruan. Deepseek-vl: Towards real-world vision-language understanding, 2024

    2024

  35. [43]

    Humantomato: Text-aligned whole-body motion generation

    Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing Lin, Ruimao Zhang, Lei Zhang, and Heung-Yeung Shum. Humantomato: Text-aligned whole-body motion generation. arXiv preprint arXiv:2310.12978, 2023

    2023 arXiv

  36. [44]

    From keypoints to object landmarks via self-training correspondence: A novel approach to unsupervised landmark discovery

    Dimitrios Mallis, Enrique Sanchez, Matt Bell, and Georgios Tzimiropoulos. From keypoints to object landmarks via self-training correspondence: A novel approach to unsupervised landmark discovery. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45 0 (7): 0 8390-...

    2023

  37. [45]

    Mm1: Methods, analysis & insights from multimodal llm pre-training

    Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, Bowen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Floris Weers, et al. Mm1: Methods, analysis & insights from multimodal llm pre-training. arXiv preprint arXiv:2403.09611, 2024

    2024 arXiv

  38. [46]

    Gemma: Open models based on gemini research and technology

    Thomas Mesnard, Cassidy Hardin, Robert Dadashi, Surya Bhupatiraju, Shreya Pathak, Laurent Sifre, Morgane Rivi \`e re, Mihir Sanjay Kale, Juliette Love, et al. Gemma: Open models based on gemini research and technology. arXiv preprint arXiv:2403.08295, 2024

    2024 arXiv

  39. [47]

    Interhand2.6m: A dataset and baseline for 3d interacting hand pose estimation from a single rgb image

    Gyeongsik Moon, Shoou-I Yu, He Wen, Takaaki Shiratori, and Kyoung Mu Lee. Interhand2.6m: A dataset and baseline for 3d interacting hand pose estimation from a single rgb image. In Eur. Conf. Comput. Vis., 2020

    2020

  40. [48]

    Revisiting fine-tuning for few-shot learning

    Akihiro Nakamura and Tatsuya Harada. Revisiting fine-tuning for few-shot learning. arXiv preprint arXiv:1910.00216, 2019

    1910 arXiv

  41. [49]

    Stacked hourglass networks for human pose estimation

    Alejandro Newell, Kaiyu Yang, and Jia Deng. Stacked hourglass networks for human pose estimation. In Eur. Conf. Comput. Vis., 2016

    2016

  42. [50]

    Animal kingdom: A large and diverse dataset for animal behavior understanding

    Xun Long Ng, Kian Eng Ong, Qichen Zheng, Yun Ni, Si Yong Yeo, and Jun Liu. Animal kingdom: A large and diverse dataset for animal behavior understanding. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 19023--19034, 2022

    2022

  43. [51]

    Single-stage multi-person pose machines

    Xuecheng Nie, Jiashi Feng, Jianfeng Zhang, and Shuicheng Yan. Single-stage multi-person pose machines. In Int. Conf. Comput. Vis., 2019

    2019

  44. [52]

    Dinov2: Learning robust visual features without supervision

    Maxime Oquab, Timoth \'e e Darcet, Th \'e o Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023

    2023 arXiv

  45. [53]

    Instruction tuning with gpt-4

    Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, and Jianfeng Gao. Instruction tuning with gpt-4. arXiv preprint arXiv:2304.03277, 2023 a

    2023 arXiv

  46. [54]

    Kosmos-2: Grounding multimodal large language models to the world

    Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, and Furu Wei. Kosmos-2: Grounding multimodal large language models to the world. arXiv preprint arXiv:2306.14824, 2023 b

    2023 arXiv

  47. [55]

    Detgpt: Detect what you need via reasoning

    Renjie Pi, Jiahui Gao, Shizhe Diao, Rui Pan, Hanze Dong, Jipeng Zhang, Lewei Yao, Jianhua Han, Hang Xu, and Lingpeng Kong Tong Zhang. Detgpt: Detect what you need via reasoning. arXiv preprint arXiv:2305.14167, 2023 a

    2023 arXiv

  48. [56]

    Perceptiongpt: Effectively fusing visual perception into llm

    Renjie Pi, Lewei Yao, Jiahui Gao, Jipeng Zhang, and Tong Zhang. Perceptiongpt: Effectively fusing visual perception into llm. arXiv preprint arXiv:2311.06612, 2023 b

    2023 arXiv

  49. [57]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In Int. Conf. Mach. Learn., 2021

    2021

  50. [58]

    Carfusion: Combining point tracking and part detection for dynamic 3d reconstruction of vehicles

    N Dinesh Reddy, Minh Vo, and Srinivasa G Narasimhan. Carfusion: Combining point tracking and part detection for dynamic 3d reconstruction of vehicles. In IEEE Conf. Comput. Vis. Pattern Recog., 2018

    2018

  51. [59]

    Zafeiriou, and M

    Christos Sagonas, Epameinondas Antonakos, Georgios Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-the-wild challenge: database and results. Image and Vision Computing, 2016

    2016

  52. [60]

    Matching is not enough: A two-stage framework for category-agnostic pose estimation

    Min Shi, Zihao Huang, Xianzheng Ma, Xiaowei Hu, and Zhiguo Cao. Matching is not enough: A two-stage framework for category-agnostic pose estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7308--7317, 2023

    2023

  53. [61]

    Prototypical networks for few-shot learning

    Jake Snell, Kevin Swersky, and Richard Zemel. Prototypical networks for few-shot learning. Adv. Neural Inform. Process. Syst., 2017

    2017

  54. [62]

    Self-supervised keypoint discovery in behavioral videos

    Jennifer J Sun, Serim Ryou, Roni H Goldshmid, Brandon Weissbourd, John O Dabiri, David J Anderson, Ann Kennedy, Yisong Yue, and Pietro Perona. Self-supervised keypoint discovery in behavioral videos. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Reco...

    2022

  55. [63]

    Deep high-resolution representation learning for human pose estimation

    Ke Sun, Bin Xiao, Dong Liu, and Jingdong Wang. Deep high-resolution representation learning for human pose estimation. In IEEE Conf. Comput. Vis. Pattern Recog., 2019

    2019

  56. [64]

    Compositional human pose regression

    Xiao Sun, Jiaxiang Shang, Shuang Liang, and Yichen Wei. Compositional human pose regression. In Int. Conf. Comput. Vis., 2017

    2017

  57. [65]

    Deeppose: Human pose estimation via deep neural networks

    Alexander Toshev and Christian Szegedy. Deeppose: Human pose estimation via deep neural networks. In IEEE Conf. Comput. Vis. Pattern Recog., 2014

    2014

  58. [66]

    Llama: Open and efficient foundation language models

    Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timoth \'e e Lacroix, Baptiste Rozi \`e re, Naman Goyal, Eric Hambro, Faisal Azhar, et al. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971, 2023 a

    2023 arXiv

  59. [67]

    Llama 2: Open foundation and fine-tuned chat models

    Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288, 2023 b

    2023 arXiv

  60. [68]

    Attention is all you need

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, ukasz Kaiser, and Illia Polosukhin. Attention is all you need. Adv. Neural Inform. Process. Syst., 2017

    2017

  61. [69]

    Locllm: Exploiting generalizable human keypoint localization via large language model

    Dongkai Wang, Shiyu Xuan, and Shiliang Zhang. Locllm: Exploiting generalizable human keypoint localization via large language model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 614--623, 2024 a

    2024

  62. [70]

    Visionllm: Large language model is also an open-ended decoder for vision-centric tasks

    Wenhai Wang, Zhe Chen, Xiaokang Chen, Jiannan Wu, Xizhou Zhu, Gang Zeng, Ping Luo, Tong Lu, Jie Zhou, Yu Qiao, et al. Visionllm: Large language model is also an open-ended decoder for vision-centric tasks. Advances in Neural Information Processing Systems, 36, 2024 b

    2024

  63. [71]

    Convolutional pose machines

    Shih-En Wei, Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh. Convolutional pose machines. In IEEE Conf. Comput. Vis. Pattern Recog., 2016

    2016

  64. [72]

    Visionllm v2: An end-to-end generalist multimodal large language model for hundreds of vision-language tasks

    Jiannan Wu, Muyan Zhong, Sen Xing, Zeqiang Lai, Zhaoyang Liu, Wenhai Wang, Zhe Chen, Xizhou Zhu, Lewei Lu, Tong Lu, et al. Visionllm v2: An end-to-end generalist multimodal large language model for hundreds of vision-language tasks. arXiv preprint arXiv:2406.08394, 2024 a

    2024 arXiv

  65. [73]

    F-lmm: Grounding frozen large multimodal models

    Size Wu, Sheng Jin, Wenwei Zhang, Lumin Xu, Wentao Liu, Wei Li, and Chen Change Loy. F-lmm: Grounding frozen large multimodal models. arXiv preprint arXiv:2406.05821, 2024 b

    2024 arXiv

  66. [74]

    Look at boundary: A boundary-aware face alignment algorithm

    Wayne Wu, Chen Qian, Shuo Yang, Quan Wang, Yici Cai, and Qiang Zhou. Look at boundary: A boundary-aware face alignment algorithm. In IEEE Conf. Comput. Vis. Pattern Recog., 2018

    2018

  67. [75]

    Simple baselines for human pose estimation and tracking

    Bin Xiao, Haiping Wu, and Yichen Wei. Simple baselines for human pose estimation and tracking. In Eur. Conf. Comput. Vis., 2018

    2018

  68. [76]

    Pixel-aligned language model

    Jiarui Xu, Xingyi Zhou, Shen Yan, Xiuye Gu, Anurag Arnab, Chen Sun, Xiaolong Wang, and Cordelia Schmid. Pixel-aligned language model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13030--13039, 2024

    2024

  69. [77]

    Vipnas: Efficient video pose estimation via neural architecture search

    Lumin Xu, Yingda Guan, Sheng Jin, Wentao Liu, Chen Qian, Ping Luo, Wanli Ouyang, and Xiaogang Wang. Vipnas: Efficient video pose estimation via neural architecture search. In IEEE Conf. Comput. Vis. Pattern Recog., 2021

    2021

  70. [78]

    Pose for everything: Towards category-agnostic pose estimation

    Lumin Xu, Sheng Jin, Wang Zeng, Wentao Liu, Chen Qian, Wanli Ouyang, Ping Luo, and Xiaogang Wang. Pose for everything: Towards category-agnostic pose estimation. In European conference on computer vision, pages 398--416. Springer, 2022 a

    2022

  71. [79]

    Vitpose: Simple vision transformer baselines for human pose estimation

    Yufei Xu, Jing Zhang, Qiming Zhang, and Dacheng Tao. Vitpose: Simple vision transformer baselines for human pose estimation. Advances in Neural Information Processing Systems, 35: 0 38571--38584, 2022 b

    2022

  72. [80]

    Boosting human-object interaction detection with text-to-image diffusion model

    Jie Yang, Bingliang Li, Fengyu Yang, Ailing Zeng, Lei Zhang, and Ruimao Zhang. Boosting human-object interaction detection with text-to-image diffusion model. arXiv preprint arXiv:2305.12252, 2023 a

    2023 arXiv

  73. [81]

    Semantic human parsing via scalable semantic transfer over multiple label domains

    Jie Yang, Chaoqun Wang, Zhen Li, Junle Wang, and Ruimao Zhang. Semantic human parsing via scalable semantic transfer over multiple label domains. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 19424--19433, 2023 b

    2023

  74. [82]

    Neural interactive keypoint detection

    Jie Yang, Ailing Zeng, Feng Li, Shilong Liu, Ruimao Zhang, and Lei Zhang. Neural interactive keypoint detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 15122--15132, 2023 c

    2023

  75. [83]

    Explicit box detection unifies end-to-end multi-person pose estimation

    Jie Yang, Ailing Zeng, Shilong Liu, Feng Li, Ruimao Zhang, and Lei Zhang. Explicit box detection unifies end-to-end multi-person pose estimation. arXiv preprint arXiv:2302.01593, 2023 d

    2023 arXiv

  76. [84]

    Unipose: Detecting any keypoints

    Jie Yang, Ailing Zeng, Ruimao Zhang, and Lei Zhang. Unipose: Detecting any keypoints. arXiv preprint arXiv:2310.08530, 2023 e

    2023 arXiv

  77. [85]

    F-hoi: Toward fine-grained semantic-aligned 3d human-object interactions

    Jie Yang, Xuesong Niu, Nan Jiang, Ruimao Zhang, and Siyuan Huang. F-hoi: Toward fine-grained semantic-aligned 3d human-object interactions. arXiv preprint arXiv:2407.12435, 2024 a

    2024 arXiv

  78. [86]

    Kptllm: Unveiling the power of large language model for keypoint comprehension

    Jie Yang, Wang Zeng, Sheng Jin, Lumin Xu, Wentao Liu, Chen Qian, and Ruimao Zhang. Kptllm: Unveiling the power of large language model for keypoint comprehension. Adv. Neural Inform. Process. Syst., 2024 b

    2024

  79. [87]

    Ed-pose++: Enhanced explicit box detection for conventional and interactive multi-object keypoint detection

    Jie Yang, Ailing Zeng, Tianhe Ren, Shilong Liu, Feng Li, Ruimao Zhang, and Lei Zhang. Ed-pose++: Enhanced explicit box detection for conventional and interactive multi-object keypoint detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025

    2025

  80. [88]

    Apt-36k: A large-scale benchmark for animal pose estimation and tracking

    Yuxiang Yang, Junjie Yang, Yufei Xu, Jing Zhang, Long Lan, and Dacheng Tao. Apt-36k: A large-scale benchmark for animal pose estimation and tracking. Advances in Neural Information Processing Systems, 35: 0 17301--17313, 2022

    2022

  81. [89]

    mplug-owl: Modularization empowers large language models with multimodality

    Qinghao Ye, Haiyang Xu, Guohai Xu, Jiabo Ye, Ming Yan, Yiyang Zhou, Junyang Wang, Anwen Hu, Pengcheng Shi, Yaya Shi, et al. mplug-owl: Modularization empowers large language models with multimodality. arXiv preprint arXiv:2304.14178, 2023

    2023 arXiv

  82. [90]

    Ferret: Refer and ground anything anywhere at any granularity

    Haoxuan You, Haotian Zhang, Zhe Gan, Xianzhi Du, Bowen Zhang, Zirui Wang, Liangliang Cao, Shih-Fu Chang, and Yinfei Yang. Ferret: Refer and ground anything anywhere at any granularity. arXiv preprint arXiv:2310.07704, 2023

    2023 arXiv

  83. [91]

    Ap-10k: A benchmark for animal pose estimation in the wild

    Hang Yu, Yufei Xu, Jing Zhang, Wei Zhao, Ziyu Guan, and Dacheng Tao. Ap-10k: A benchmark for animal pose estimation in the wild. arXiv preprint arXiv:2108.12617, 2021

    2021 arXiv

  84. [92]

    Hrformer: High-resolution transformer for dense prediction

    Yuhui Yuan, Rao Fu, Lang Huang, Weihong Lin, Chao Zhang, Xilin Chen, and Jingdong Wang. Hrformer: High-resolution transformer for dense prediction. arXiv preprint arXiv:2110.09408, 2021

    2021 arXiv

  85. [93]

    Contextual object detection with multimodal large language models

    Yuhang Zang, Wei Li, Jun Han, Kaiyang Zhou, and Chen Change Loy. Contextual object detection with multimodal large language models. arXiv preprint arXiv:2305.18279, 2023

    2023 arXiv

  86. [94]

    Sigmoid loss for language image pre-training

    Xiaohua Zhai, Basil Mustafa, Alexander Kolesnikov, and Lucas Beyer. Sigmoid loss for language image pre-training. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 11975--11986, 2023

    2023

  87. [95]

    Open-vocabulary animal keypoint detection with semantic-feature matching

    Hao Zhang, Lumin Xu, Shenqi Lai, Wenqi Shao, Nanning Zheng, Ping Luo, Yu Qiao, and Kaipeng Zhang. Open-vocabulary animal keypoint detection with semantic-feature matching. International Journal of Computer Vision, pages 1--18, 2024

    2024

  88. [96]

    Adding conditional control to text-to-image diffusion models

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3836--3847, 2023 a

    2023

  89. [97]

    Gpt4roi: Instruction tuning large language model on region-of-interest

    Shilong Zhang, Peize Sun, Shoufa Chen, Min Xiao, Wenqi Shao, Wenwei Zhang, Kai Chen, and Ping Luo. Gpt4roi: Instruction tuning large language model on region-of-interest. arXiv preprint arXiv:2307.03601, 2023 b

    2023 arXiv

  90. [98]

    Opt: Open pre-trained transformer language models

    Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, et al. Opt: Open pre-trained transformer language models. arXiv preprint arXiv:2205.01068, 2022

    2022 arXiv

  91. [99]

    Clamp: Prompt-based contrastive learning for connecting language and animal pose

    Xu Zhang, Wen Wang, Zhe Chen, Yufei Xu, Jing Zhang, and Dacheng Tao. Clamp: Prompt-based contrastive learning for connecting language and animal pose. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 23272--23281, 2023 c

    2023

  92. [100]

    Minigpt-4: Enhancing vision-language understanding with advanced large language models

    Deyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li, and Mohamed Elhoseiny. Minigpt-4: Enhancing vision-language understanding with advanced large language models. arXiv preprint arXiv:2304.10592, 2023

    2023 arXiv

  93. [101]

    , " * write output.state after.block = add.period write newline

    ENTRY address archive author booktitle chapter doi edition editor eid eprint howpublished institution journal key keywords month note number organization pages publisher school series title type url volume year archivePrefix primaryClass adsurl adsnote version label extra.labe...

  94. [102]

    write newline

    " write newline "" before.all 'output.state := FUNCTION add.period duplicate empty 'skip "." * add.blank if FUNCTION if.digit duplicate "0" = swap duplicate "1" = swap duplicate "2" = swap duplicate "3" = swap duplicate "4" = swap duplicate "5" = swap duplicate "6" = swap dupl...

  95. [103]

    , " * write output.state after.block = add.period write newline

    ENTRY address archive author booktitle chapter doi edition editor eid eprint howpublished institution journal key month note number organization pages publisher school series title type url volume year label extra.label sort.label short.list INTEGERS output.state before.all mi...

  96. [104]

    write newline

    " write newline "" before.all 'output.state := FUNCTION add.period duplicate empty 'skip "." * add.blank if FUNCTION if.digit duplicate "0" = swap duplicate "1" = swap duplicate "2" = swap duplicate "3" = swap duplicate "4" = swap duplicate "5" = swap duplicate "6" = swap dupl...

  97. [105]

    , " * write output.state after.block = add.period write newline

    ENTRY address author booktitle chapter doi edition editor eid howpublished institution journal key month note number organization pages publisher school series title type url volume year label INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION in...

  98. [106]

    write newline

    " write newline "" before.all 'output.state := FUNCTION if.digit duplicate "0" = swap duplicate "1" = swap duplicate "2" = swap duplicate "3" = swap duplicate "4" = swap duplicate "5" = swap duplicate "6" = swap duplicate "7" = swap duplicate "8" = swap "9" = or or or or or or...

  99. [107]

    , " * write output.state after.block = add.period write newline

    ENTRY address author booktitle chapter doi edition editor eid howpublished institution journal key month note number organization pages publisher school series title type url volume year label INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION in...

  100. [108]

    write newline

    " write newline "" before.all 'output.state := FUNCTION if.digit duplicate "0" = swap duplicate "1" = swap duplicate "2" = swap duplicate "3" = swap duplicate "4" = swap duplicate "5" = swap duplicate "6" = swap duplicate "7" = swap duplicate "8" = swap "9" = or or or or or or...

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.