{"work":{"id":"21b3ccfe-d24a-404b-9be7-60598d6879df","openalex_id":null,"doi":null,"arxiv_id":"2303.08128","raw_key":null,"title":"ViperGPT: Visual Inference via Python Execution for Reasoning","authors":null,"authors_text":"D\\'idac Sur\\'is, Sachit Menon, Carl Vondrick","year":2023,"venue":"cs.CV","abstract":"Answering visual queries is a complex task that requires both visual processing and reasoning. End-to-end models, the dominant approach for this task, do not explicitly differentiate between the two, limiting interpretability and generalization. Learning modular programs presents a promising alternative, but has proven challenging due to the difficulty of learning both the programs and modules simultaneously. We introduce ViperGPT, a framework that leverages code-generation models to compose vision-and-language models into subroutines to produce a result for any query. ViperGPT utilizes a provided API to access the available modules, and composes them by generating Python code that is later executed. This simple approach requires no further training, and achieves state-of-the-art results across various complex visual tasks.","external_url":"https://arxiv.org/abs/2303.08128","cited_by_count":null,"metadata_source":"pith","metadata_fetched_at":"2026-05-24T02:33:47.720040+00:00","pith_arxiv_id":"2303.08128","created_at":"2026-05-08T17:08:34.363109+00:00","updated_at":"2026-05-24T02:33:47.720040+00:00","title_quality_ok":true,"display_title":"ViperGPT: Visual Inference via Python Execution for Reasoning","render_title":"ViperGPT: Visual Inference via Python Execution for Reasoning"},"hub":{"state":{"work_id":"21b3ccfe-d24a-404b-9be7-60598d6879df","tier":"hub","tier_reason":"10+ Pith inbound or 1,000+ external citations","pith_inbound_count":23,"external_cited_by_count":null,"distinct_field_count":7,"first_pith_cited_at":"2023-03-20T18:31:47+00:00","last_pith_cited_at":"2026-05-18T17:33:50+00:00","author_build_status":"not_needed","summary_status":"needed","contexts_status":"needed","graph_status":"needed","ask_index_status":"not_needed","reader_status":"not_needed","recognition_status":"not_needed","updated_at":"2026-05-30T21:41:35.997269+00:00","tier_text":"hub"},"tier":"hub","role_counts":[{"context_role":"background","n":7}],"polarity_counts":[{"context_polarity":"background","n":7}],"runs":{},"summary":{},"graph":{},"authors":[]}}