{"record_type":"pith_number_record","schema_url":"https://pith.science/schemas/pith-number/v1.json","pith_number":"pith:2024:Y6RQ3DSEO5GRVDQUIZPKY2FERD","short_pith_number":"pith:Y6RQ3DSE","schema_version":"1.0","canonical_sha256":"c7a30d8e44774d1a8e14465eac68a488ffa391f8085a09122c8f05c2dfdd2daf","source":{"kind":"arxiv","id":"2405.17247","version":1},"attestation_state":"computed","paper":{"title":"An Introduction to Vision-Language Modeling","license":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/","headline":"","cross_cats":[],"primary_cat":"cs.LG","authors_text":"Adrien Bardes, Aishwarya Agrawal, Alexander C. Li, Anas Mahmoud, Anurag Ajay, Arjang Talattof, Asli Celikyilmaz, Bargav Jayaraman, Candace Ross, Chuan Guo, Diane Bouchacourt, Florian Bordes, Haider Al-Tahan, Hu Xu, Jonathan Lebensold, Jun Chen, Kamalika Chaudhuri, Karen Ullrich, Karthik Padthe, Kate Saenko, Kushal Tirumala, Mark Ibrahim, Mazda Moayeri, Megan Richards, Melissa Hall, Oscar Ma\\~nas, Pietro Astolfi, Quentin Garrido, Reyhane Askari Hemmat, Richard Yuanzhe Pang, Rim Assouel, Samuel Lavoie, Srihari Jayakumar, Suzanne Petryk, Vasu Sharma, Vikas Chandra, Xiaoqing Ellen Tan, Xilun Chen, Yunyang Xiong, Zechun Liu, Zhiqiu Lin","submitted_at":"2024-05-27T15:01:23Z","abstract_excerpt":"Following the recent popularity of Large Language Models (LLMs), several attempts have been made to extend them to the visual domain. From having a visual assistant that could guide us through unfamiliar environments to generative models that produce images using only a high-level text description, the vision-language model (VLM) applications will significantly impact our relationship with technology. However, there are many challenges that need to be addressed to improve the reliability of those models. While language is discrete, vision evolves in a much higher dimensional space in which con"},"verification_status":{"content_addressed":true,"pith_receipt":true,"author_attested":false,"weak_author_claims":0,"strong_author_claims":0,"externally_anchored":false,"storage_verified":false,"citation_signatures":0,"replication_records":0,"graph_snapshot":true,"references_resolved":false,"formal_links_present":false},"canonical_record":{"source":{"id":"2405.17247","kind":"arxiv","version":1},"metadata":{"license":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/","primary_cat":"cs.LG","submitted_at":"2024-05-27T15:01:23Z","cross_cats_sorted":[],"title_canon_sha256":"b1c86ce28c9c76844e22aeede00264b2a1acb768f895f524fb633a563026fe13","abstract_canon_sha256":"e606524b7628f142fb6b777e632ce4b174a53d3a5b787f99489108f1eefefe8a"},"schema_version":"1.0"},"receipt":{"kind":"pith_receipt","key_id":"pith-v1-2026-05","algorithm":"ed25519","signed_at":"2026-07-05T08:23:41.939163Z","signature_b64":"Q0UXTjtBdgDUIfH0g9+XjIVODzq9E9syKFs1zjhWbUQi9sc6eSTvDlwGk+HLs1qGs9vnUFIYJ5Mfdti/bMQVAQ==","signed_message":"canonical_sha256_bytes","builder_version":"pith-number-builder-2026-05-17-v1","receipt_version":"0.3","canonical_sha256":"c7a30d8e44774d1a8e14465eac68a488ffa391f8085a09122c8f05c2dfdd2daf","last_reissued_at":"2026-07-05T08:23:41.938664Z","signature_status":"signed_v1","first_computed_at":"2026-07-05T08:23:41.938664Z","public_key_fingerprint":"8d4b5ee74e4693bcd1df2446408b0d54"},"graph_snapshot":{"paper":{"title":"An Introduction to Vision-Language Modeling","license":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/","headline":"","cross_cats":[],"primary_cat":"cs.LG","authors_text":"Adrien Bardes, Aishwarya Agrawal, Alexander C. Li, Anas Mahmoud, Anurag Ajay, Arjang Talattof, Asli Celikyilmaz, Bargav Jayaraman, Candace Ross, Chuan Guo, Diane Bouchacourt, Florian Bordes, Haider Al-Tahan, Hu Xu, Jonathan Lebensold, Jun Chen, Kamalika Chaudhuri, Karen Ullrich, Karthik Padthe, Kate Saenko, Kushal Tirumala, Mark Ibrahim, Mazda Moayeri, Megan Richards, Melissa Hall, Oscar Ma\\~nas, Pietro Astolfi, Quentin Garrido, Reyhane Askari Hemmat, Richard Yuanzhe Pang, Rim Assouel, Samuel Lavoie, Srihari Jayakumar, Suzanne Petryk, Vasu Sharma, Vikas Chandra, Xiaoqing Ellen Tan, Xilun Chen, Yunyang Xiong, Zechun Liu, Zhiqiu Lin","submitted_at":"2024-05-27T15:01:23Z","abstract_excerpt":"Following the recent popularity of Large Language Models (LLMs), several attempts have been made to extend them to the visual domain. From having a visual assistant that could guide us through unfamiliar environments to generative models that produce images using only a high-level text description, the vision-language model (VLM) applications will significantly impact our relationship with technology. However, there are many challenges that need to be addressed to improve the reliability of those models. While language is discrete, vision evolves in a much higher dimensional space in which con"},"claims":{"count":0,"items":[],"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"source":{"id":"2405.17247","kind":"arxiv","version":1},"verdict":{"id":null,"model_set":{},"created_at":null,"strongest_claim":"","one_line_summary":"","pipeline_version":null,"weakest_assumption":"","pith_extraction_headline":""},"integrity":{"clean":true,"summary":{"advisory":0,"critical":0,"by_detector":{},"informational":0},"endpoint":"/pith/2405.17247/integrity.json","findings":[],"available":true,"detectors_run":[],"snapshot_sha256":"c28c3603d3b5d939e8dc4c7e95fa8dfce3d595e45f758748cecf8e644a296938"},"references":{"count":0,"sample":[],"resolved_work":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57","internal_anchors":0},"formal_canon":{"evidence_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"},"aliases":[{"alias_kind":"arxiv","alias_value":"2405.17247","created_at":"2026-07-05T08:23:41.938724+00:00"},{"alias_kind":"arxiv_version","alias_value":"2405.17247v1","created_at":"2026-07-05T08:23:41.938724+00:00"},{"alias_kind":"doi","alias_value":"10.48550/arxiv.2405.17247","created_at":"2026-07-05T08:23:41.938724+00:00"},{"alias_kind":"pith_short_12","alias_value":"Y6RQ3DSEO5GR","created_at":"2026-07-05T08:23:41.938724+00:00"},{"alias_kind":"pith_short_16","alias_value":"Y6RQ3DSEO5GRVDQU","created_at":"2026-07-05T08:23:41.938724+00:00"},{"alias_kind":"pith_short_8","alias_value":"Y6RQ3DSE","created_at":"2026-07-05T08:23:41.938724+00:00"}],"events":[],"event_summary":{},"paper_claims":[],"inbound_citations":{"count":34,"internal_anchor_count":0,"sample":[{"citing_arxiv_id":"2606.27660","citing_title":"MVPruner: Dynamic Token Pruning for Accelerating Multi-view Vision-Language Models in Autonomous Driving","ref_index":3,"is_internal_anchor":false},{"citing_arxiv_id":"2606.07861","citing_title":"The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models","ref_index":5,"is_internal_anchor":false},{"citing_arxiv_id":"2606.01671","citing_title":"When Meaning Travels: A Granular Lens on Hybrid-MoE's Role in Idiomatic Understanding for Language Models","ref_index":68,"is_internal_anchor":false},{"citing_arxiv_id":"2605.24019","citing_title":"MGVQ: Synergizing Multi-dimensional Sensitivity-Aware and Gradient-Hessian Fusion for Vector Quantization","ref_index":2,"is_internal_anchor":false},{"citing_arxiv_id":"2606.31204","citing_title":"AC3S: Adaptive Conditioning for 3D-Aware Synthetic Data Generation","ref_index":2,"is_internal_anchor":false},{"citing_arxiv_id":"2605.01284","citing_title":"Chain of Evidence: Pixel-Level Visual Attribution for Iterative Retrieval-Augmented Generation","ref_index":6,"is_internal_anchor":false},{"citing_arxiv_id":"2605.14845","citing_title":"Exploring Vision-Language Models for Online Signature Verification: A Zero-Shot Capability Study","ref_index":8,"is_internal_anchor":false},{"citing_arxiv_id":"2605.18106","citing_title":"Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers","ref_index":18,"is_internal_anchor":false},{"citing_arxiv_id":"2606.27660","citing_title":"MVPruner: Dynamic Token Pruning for Accelerating Multi-view Vision-Language Models in Autonomous Driving","ref_index":3,"is_internal_anchor":false},{"citing_arxiv_id":"2605.27885","citing_title":"Reflective Dialogue between Teacher and Solver Agents for Video Question Answering","ref_index":2,"is_internal_anchor":false},{"citing_arxiv_id":"2606.07779","citing_title":"Do Vision-Language Models See Dwarf Galaxies the Way We Do?","ref_index":2,"is_internal_anchor":false},{"citing_arxiv_id":"2502.16060","citing_title":"Tokenizing Single-Channel EEG with Time-Frequency Motif Learning","ref_index":1,"is_internal_anchor":false},{"citing_arxiv_id":"2504.06925","citing_title":"Are Vision-Language Models Ready for Dietary Assessment? Exploring the Next Frontier in AI-Powered Food Image Recognition","ref_index":5,"is_internal_anchor":false},{"citing_arxiv_id":"2604.20665","citing_title":"The Expense of Seeing: Attaining Trustworthy Multimodal Reasoning Within the Monolithic Paradigm","ref_index":2,"is_internal_anchor":false},{"citing_arxiv_id":"2505.17352","citing_title":"Alignment and Safety of Diffusion Models via Reinforcement Learning and Reward Modeling: A Survey","ref_index":5,"is_internal_anchor":false},{"citing_arxiv_id":"2509.21979","citing_title":"Benchmarking and Mitigating Sycophancy in Medical Vision Language Models","ref_index":4,"is_internal_anchor":false},{"citing_arxiv_id":"2510.25404","citing_title":"SemanticOpt: Towards LLM-Based Semantic Black-Box Optimization","ref_index":1,"is_internal_anchor":false},{"citing_arxiv_id":"2605.20837","citing_title":"ArchSIBench: Benchmarking the Architectural Spatial Intelligence of Vision-Language Models","ref_index":19,"is_internal_anchor":false},{"citing_arxiv_id":"2605.07333","citing_title":"Beyond Linear Attention: Softmax Transformers Implement In-Context Reinforcement Learning","ref_index":223,"is_internal_anchor":false},{"citing_arxiv_id":"2605.18106","citing_title":"Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers","ref_index":18,"is_internal_anchor":false},{"citing_arxiv_id":"2605.18455","citing_title":"OrganicHAR: Towards Activity Discovery in Organic Settings for Privacy Preserving Sensors Using Efficient Video Analysis","ref_index":15,"is_internal_anchor":false},{"citing_arxiv_id":"2509.21979","citing_title":"Benchmarking and Mitigating Sycophancy in Medical Vision Language Models","ref_index":4,"is_internal_anchor":false},{"citing_arxiv_id":"2511.08439","citing_title":"Dataset Safety in Autonomous Driving: Requirements, Risks, and Assurance","ref_index":33,"is_internal_anchor":false},{"citing_arxiv_id":"2511.13131","citing_title":"MM-Telco: Benchmarks and Multimodal Large Language Models for Telecom Applications","ref_index":6,"is_internal_anchor":false},{"citing_arxiv_id":"2605.03426","citing_title":"Replacing Parameters with Preferences: Federated Alignment of Heterogeneous Vision-Language Models","ref_index":44,"is_internal_anchor":false}]},"formal_canon":{"evidence_count":0,"sample":[],"anchors":[]},"links":{"html":"https://pith.science/pith/Y6RQ3DSEO5GRVDQUIZPKY2FERD","json":"https://pith.science/pith/Y6RQ3DSEO5GRVDQUIZPKY2FERD.json","graph_json":"https://pith.science/api/pith-number/Y6RQ3DSEO5GRVDQUIZPKY2FERD/graph.json","events_json":"https://pith.science/api/pith-number/Y6RQ3DSEO5GRVDQUIZPKY2FERD/events.json","paper":"https://pith.science/paper/Y6RQ3DSE"},"agent_actions":{"view_html":"https://pith.science/pith/Y6RQ3DSEO5GRVDQUIZPKY2FERD","download_json":"https://pith.science/pith/Y6RQ3DSEO5GRVDQUIZPKY2FERD.json","view_paper":"https://pith.science/paper/Y6RQ3DSE","resolve_alias":"https://pith.science/api/pith-number/resolve?arxiv=2405.17247&json=true","fetch_graph":"https://pith.science/api/pith-number/Y6RQ3DSEO5GRVDQUIZPKY2FERD/graph.json","fetch_events":"https://pith.science/api/pith-number/Y6RQ3DSEO5GRVDQUIZPKY2FERD/events.json","actions":{"anchor_timestamp":"https://pith.science/pith/Y6RQ3DSEO5GRVDQUIZPKY2FERD/action/timestamp_anchor","attest_storage":"https://pith.science/pith/Y6RQ3DSEO5GRVDQUIZPKY2FERD/action/storage_attestation","attest_author":"https://pith.science/pith/Y6RQ3DSEO5GRVDQUIZPKY2FERD/action/author_attestation","sign_citation":"https://pith.science/pith/Y6RQ3DSEO5GRVDQUIZPKY2FERD/action/citation_signature","submit_replication":"https://pith.science/pith/Y6RQ3DSEO5GRVDQUIZPKY2FERD/action/replication_record"}},"created_at":"2026-07-05T08:23:41.938724+00:00","updated_at":"2026-07-05T08:23:41.938724+00:00"}