{"record_type":"pith_number_record","schema_url":"https://pith.science/schemas/pith-number/v1.json","pith_number":"pith:2024:T67RFLUHECYGUMUX66Y3BBB26S","short_pith_number":"pith:T67RFLUH","schema_version":"1.0","canonical_sha256":"9fbf12ae8720b06a3297f7b1b0843af487b372e635e2599f16308dda4ecc14b6","source":{"kind":"arxiv","id":"2405.03162","version":1},"attestation_state":"computed","paper":{"title":"Advancing Multimodal Medical Capabilities of Gemini","license":"http://creativecommons.org/licenses/by/4.0/","headline":"","cross_cats":["cs.AI","cs.CL","cs.LG"],"primary_cat":"cs.CV","authors_text":"Akshay Goel, Andrew Sellergren, Arnav Agharwal, Atilla Kiraly, Christopher Kelly, Chuck Lau, Cory McLean, Daniel Golden, Daniel Tse, Dave Steiner, David Fleet, David G. T. Barrett, Ellery Wulczyn, Eric Wang, Farhad Hormozdiari, Faruk Ahmed, Fayaz Jamil, Greg Corrado, Gregory Sorensen, Ira Ktena, Joelle Barral, Jorge Cuadros, Katherine Chou, Kendall Park, Khaled Saab, Lin Yang, Mozziyar Etemadi, Nick George, Rory Pilgrim, Ryutaro Tanno, Shawn Xu, Shekoofeh Azizi, Shravya Shetty, Shruthi Prabhakara, Siyuan Qiao, S. M. Ali Eslami, Sreenivasa Raju Kalidindi, S. Sara Mahdavi, Tao Tu, Theo Guidroz, Tiam Jaroensri, Timo Kohlberger, Wei-Hung Weng, Yang Wang, Yossi Matias, Yuchen Zhou, Yun Liu","submitted_at":"2024-05-06T04:44:22Z","abstract_excerpt":"Many clinical tasks require an understanding of specialized data, such as medical images and genomics, which is not typically found in general-purpose large multimodal models. Building upon Gemini's multimodal models, we develop several models within the new Med-Gemini family that inherit core capabilities of Gemini and are optimized for medical use via fine-tuning with 2D and 3D radiology, histopathology, ophthalmology, dermatology and genomic data. Med-Gemini-2D sets a new standard for AI-based chest X-ray (CXR) report generation based on expert evaluation, exceeding previous best results ac"},"verification_status":{"content_addressed":true,"pith_receipt":true,"author_attested":false,"weak_author_claims":0,"strong_author_claims":0,"externally_anchored":false,"storage_verified":false,"citation_signatures":0,"replication_records":0,"graph_snapshot":true,"references_resolved":false,"formal_links_present":false},"canonical_record":{"source":{"id":"2405.03162","kind":"arxiv","version":1},"metadata":{"license":"http://creativecommons.org/licenses/by/4.0/","primary_cat":"cs.CV","submitted_at":"2024-05-06T04:44:22Z","cross_cats_sorted":["cs.AI","cs.CL","cs.LG"],"title_canon_sha256":"a60d9c4da24dee75cba3c7eeaed0e9405ed1d56a3ba3a7e8f54096a4b953a170","abstract_canon_sha256":"7928fa1e35816f510e615439a9eb7f56d4134ffb7c21eea124d5eefb9909b7bb"},"schema_version":"1.0"},"receipt":{"kind":"pith_receipt","key_id":"pith-v1-2026-05","algorithm":"ed25519","signed_at":"2026-07-05T08:15:59.726528Z","signature_b64":"ewM3XRo8J8cJS09byB+wTi6ofW8Zs3/7t38C09YvlDqrxYYKRXJ8pBLNz2btZKtWl6bd/Ae1FzIU71d/WqaIBA==","signed_message":"canonical_sha256_bytes","builder_version":"pith-number-builder-2026-05-17-v1","receipt_version":"0.3","canonical_sha256":"9fbf12ae8720b06a3297f7b1b0843af487b372e635e2599f16308dda4ecc14b6","last_reissued_at":"2026-07-05T08:15:59.726080Z","signature_status":"signed_v1","first_computed_at":"2026-07-05T08:15:59.726080Z","public_key_fingerprint":"8d4b5ee74e4693bcd1df2446408b0d54"},"graph_snapshot":{"paper":{"title":"Advancing Multimodal Medical Capabilities of Gemini","license":"http://creativecommons.org/licenses/by/4.0/","headline":"","cross_cats":["cs.AI","cs.CL","cs.LG"],"primary_cat":"cs.CV","authors_text":"Akshay Goel, Andrew Sellergren, Arnav Agharwal, Atilla Kiraly, Christopher Kelly, Chuck Lau, Cory McLean, Daniel Golden, Daniel Tse, Dave Steiner, David Fleet, David G. T. Barrett, Ellery Wulczyn, Eric Wang, Farhad Hormozdiari, Faruk Ahmed, Fayaz Jamil, Greg Corrado, Gregory Sorensen, Ira Ktena, Joelle Barral, Jorge Cuadros, Katherine Chou, Kendall Park, Khaled Saab, Lin Yang, Mozziyar Etemadi, Nick George, Rory Pilgrim, Ryutaro Tanno, Shawn Xu, Shekoofeh Azizi, Shravya Shetty, Shruthi Prabhakara, Siyuan Qiao, S. M. Ali Eslami, Sreenivasa Raju Kalidindi, S. Sara Mahdavi, Tao Tu, Theo Guidroz, Tiam Jaroensri, Timo Kohlberger, Wei-Hung Weng, Yang Wang, Yossi Matias, Yuchen Zhou, Yun Liu","submitted_at":"2024-05-06T04:44:22Z","abstract_excerpt":"Many clinical tasks require an understanding of specialized data, such as medical images and genomics, which is not typically found in general-purpose large multimodal models. Building upon Gemini's multimodal models, we develop several models within the new Med-Gemini family that inherit core capabilities of Gemini and are optimized for medical use via fine-tuning with 2D and 3D radiology, histopathology, ophthalmology, dermatology and genomic data. Med-Gemini-2D sets a new standard for AI-based chest X-ray (CXR) report generation based on expert evaluation, exceeding previous best results ac"},"claims":{"count":0,"items":[],"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"source":{"id":"2405.03162","kind":"arxiv","version":1},"verdict":{"id":null,"model_set":{},"created_at":null,"strongest_claim":"","one_line_summary":"","pipeline_version":null,"weakest_assumption":"","pith_extraction_headline":""},"integrity":{"clean":true,"summary":{"advisory":0,"critical":0,"by_detector":{},"informational":0},"endpoint":"/pith/2405.03162/integrity.json","findings":[],"available":true,"detectors_run":[],"snapshot_sha256":"c28c3603d3b5d939e8dc4c7e95fa8dfce3d595e45f758748cecf8e644a296938"},"references":{"count":0,"sample":[],"resolved_work":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57","internal_anchors":0},"formal_canon":{"evidence_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"},"aliases":[{"alias_kind":"arxiv","alias_value":"2405.03162","created_at":"2026-07-05T08:15:59.726141+00:00"},{"alias_kind":"arxiv_version","alias_value":"2405.03162v1","created_at":"2026-07-05T08:15:59.726141+00:00"},{"alias_kind":"doi","alias_value":"10.48550/arxiv.2405.03162","created_at":"2026-07-05T08:15:59.726141+00:00"},{"alias_kind":"pith_short_12","alias_value":"T67RFLUHECYG","created_at":"2026-07-05T08:15:59.726141+00:00"},{"alias_kind":"pith_short_16","alias_value":"T67RFLUHECYGUMUX","created_at":"2026-07-05T08:15:59.726141+00:00"},{"alias_kind":"pith_short_8","alias_value":"T67RFLUH","created_at":"2026-07-05T08:15:59.726141+00:00"}],"events":[],"event_summary":{},"paper_claims":[],"inbound_citations":{"count":15,"internal_anchor_count":1,"sample":[{"citing_arxiv_id":"2607.05880","citing_title":"Harrison.Rad 1.5 Technical Report: A radiology foundation model that can draft reports from images, priors and clinical context","ref_index":50,"is_internal_anchor":true},{"citing_arxiv_id":"2606.09489","citing_title":"LLM-Orchestrated Conformance Checking in Stroke Care Without Computer-Interpretable Guidelines","ref_index":24,"is_internal_anchor":false},{"citing_arxiv_id":"2606.03180","citing_title":"GLINT: Sparsely Gated Vision-Language Alignment for Fine-Grained Radiology Representations","ref_index":67,"is_internal_anchor":false},{"citing_arxiv_id":"2606.27484","citing_title":"Fine-tuning a multimodal large language model for clinician-grade autism behavioral scoring from short home videos","ref_index":45,"is_internal_anchor":false},{"citing_arxiv_id":"2605.27960","citing_title":"Mags-RL: Wearing Multimodal LLMs a Magnifying Glass via Agentic Reinforcement Learning For Complex Scene Reasoning","ref_index":45,"is_internal_anchor":false},{"citing_arxiv_id":"2408.16213","citing_title":"M4CXR: Exploring Multi-task Potentials of Multi-modal Large Language Models for Chest X-ray Interpretation","ref_index":55,"is_internal_anchor":false},{"citing_arxiv_id":"2502.16022","citing_title":"Enhancing LLMs for Identifying and Prioritizing Important Medical Jargons from Electronic Health Record Notes Utilizing Data Augmentation: A Comparative Study","ref_index":51,"is_internal_anchor":false},{"citing_arxiv_id":"2504.07415","citing_title":"RA-RRG: Multimodal Retrieval-Augmented Radiology Report Generation with Key Phrase Extraction","ref_index":54,"is_internal_anchor":false},{"citing_arxiv_id":"2507.09028","citing_title":"From Classical Machine Learning to Emerging Foundation Models: Review on Multimodal Data Integration for Cancer Research","ref_index":166,"is_internal_anchor":false},{"citing_arxiv_id":"2412.03555","citing_title":"PaliGemma 2: A Family of Versatile VLMs for Transfer","ref_index":103,"is_internal_anchor":false},{"citing_arxiv_id":"2605.09679","citing_title":"DeepTumorVQA: A Hierarchical 3D CT Benchmark for Stage-Wise Evaluation of Medical VLMs and Tool-Augmented Agents","ref_index":57,"is_internal_anchor":false},{"citing_arxiv_id":"2605.00876","citing_title":"GAZE: Grounded Agentic Zero-shot Evaluation with Viewer-Level Tools and Literature Retrieval on Rare Brain MRI","ref_index":24,"is_internal_anchor":false},{"citing_arxiv_id":"2604.05081","citing_title":"MedGemma 1.5 Technical Report","ref_index":19,"is_internal_anchor":false},{"citing_arxiv_id":"2604.13756","citing_title":"MedRCube: A Multidimensional Framework for Fine-Grained and In-Depth Evaluation of MLLMs in Medical Imaging","ref_index":79,"is_internal_anchor":false},{"citing_arxiv_id":"2605.01779","citing_title":"MedScribe: Clinically Grounded CT Reporting through Agentic Workflows","ref_index":6,"is_internal_anchor":false}]},"formal_canon":{"evidence_count":0,"sample":[],"anchors":[]},"links":{"html":"https://pith.science/pith/T67RFLUHECYGUMUX66Y3BBB26S","json":"https://pith.science/pith/T67RFLUHECYGUMUX66Y3BBB26S.json","graph_json":"https://pith.science/api/pith-number/T67RFLUHECYGUMUX66Y3BBB26S/graph.json","events_json":"https://pith.science/api/pith-number/T67RFLUHECYGUMUX66Y3BBB26S/events.json","paper":"https://pith.science/paper/T67RFLUH"},"agent_actions":{"view_html":"https://pith.science/pith/T67RFLUHECYGUMUX66Y3BBB26S","download_json":"https://pith.science/pith/T67RFLUHECYGUMUX66Y3BBB26S.json","view_paper":"https://pith.science/paper/T67RFLUH","resolve_alias":"https://pith.science/api/pith-number/resolve?arxiv=2405.03162&json=true","fetch_graph":"https://pith.science/api/pith-number/T67RFLUHECYGUMUX66Y3BBB26S/graph.json","fetch_events":"https://pith.science/api/pith-number/T67RFLUHECYGUMUX66Y3BBB26S/events.json","actions":{"anchor_timestamp":"https://pith.science/pith/T67RFLUHECYGUMUX66Y3BBB26S/action/timestamp_anchor","attest_storage":"https://pith.science/pith/T67RFLUHECYGUMUX66Y3BBB26S/action/storage_attestation","attest_author":"https://pith.science/pith/T67RFLUHECYGUMUX66Y3BBB26S/action/author_attestation","sign_citation":"https://pith.science/pith/T67RFLUHECYGUMUX66Y3BBB26S/action/citation_signature","submit_replication":"https://pith.science/pith/T67RFLUHECYGUMUX66Y3BBB26S/action/replication_record"}},"created_at":"2026-07-05T08:15:59.726141+00:00","updated_at":"2026-07-05T08:15:59.726141+00:00"}