{"record_type":"pith_number_record","schema_url":"https://pith.science/schemas/pith-number/v1.json","pith_number":"pith:2024:TMGAYAUUIXM7HQ6FSW5SJD7QRO","short_pith_number":"pith:TMGAYAUU","schema_version":"1.0","canonical_sha256":"9b0c0c029445d9f3c3c595bb248ff08b8d98c3d35ac511d64c3f99a7a3f52176","source":{"kind":"arxiv","id":"2402.10189","version":2},"attestation_state":"computed","paper":{"title":"Uncertainty Quantification for In-Context Learning of Large Language Models","license":"http://creativecommons.org/licenses/by/4.0/","headline":"","cross_cats":["cs.LG"],"primary_cat":"cs.CL","authors_text":"Chen Ling, Guangji Bai, Haifeng Chen, Jie Ji, Katsushi Matsuda, Liang Zhao, Mika Oishi, Takao Osaki, Wei Cheng, Xuchao Zhang, Xujiang Zhao, Yanchi Liu, Yiyou Sun","submitted_at":"2024-02-15T18:46:24Z","abstract_excerpt":"In-context learning has emerged as a groundbreaking ability of Large Language Models (LLMs) and revolutionized various fields by providing a few task-relevant demonstrations in the prompt. However, trustworthy issues with LLM's response, such as hallucination, have also been actively discussed. Existing works have been devoted to quantifying the uncertainty in LLM's response, but they often overlook the complex nature of LLMs and the uniqueness of in-context learning. In this work, we delve into the predictive uncertainty of LLMs associated with in-context learning, highlighting that such unce"},"verification_status":{"content_addressed":true,"pith_receipt":true,"author_attested":false,"weak_author_claims":0,"strong_author_claims":0,"externally_anchored":false,"storage_verified":false,"citation_signatures":0,"replication_records":0,"graph_snapshot":true,"references_resolved":false,"formal_links_present":false},"canonical_record":{"source":{"id":"2402.10189","kind":"arxiv","version":2},"metadata":{"license":"http://creativecommons.org/licenses/by/4.0/","primary_cat":"cs.CL","submitted_at":"2024-02-15T18:46:24Z","cross_cats_sorted":["cs.LG"],"title_canon_sha256":"45e9b5c3ee7af1dd0356b25174b38056e1e56c228c71f08f713fc240fdf7db84","abstract_canon_sha256":"afd13ee5cfc1aedf9ce3a9187da28d55ccdcaee98214fe8798b0aa2a56a3cde6"},"schema_version":"1.0"},"receipt":{"kind":"pith_receipt","key_id":"pith-v1-2026-05","algorithm":"ed25519","signed_at":"2026-07-05T08:02:04.972609Z","signature_b64":"naM8Rky/N1IvVHFTBG+Hycp4LQxehj/i+1pIZz55zm/xx0GiJ5mGb1OG3AT8jkGeykMeAhuHEAdTsmYvFNK1Ag==","signed_message":"canonical_sha256_bytes","builder_version":"pith-number-builder-2026-05-17-v1","receipt_version":"0.3","canonical_sha256":"9b0c0c029445d9f3c3c595bb248ff08b8d98c3d35ac511d64c3f99a7a3f52176","last_reissued_at":"2026-07-05T08:02:04.972064Z","signature_status":"signed_v1","first_computed_at":"2026-07-05T08:02:04.972064Z","public_key_fingerprint":"8d4b5ee74e4693bcd1df2446408b0d54"},"graph_snapshot":{"paper":{"title":"Uncertainty Quantification for In-Context Learning of Large Language Models","license":"http://creativecommons.org/licenses/by/4.0/","headline":"","cross_cats":["cs.LG"],"primary_cat":"cs.CL","authors_text":"Chen Ling, Guangji Bai, Haifeng Chen, Jie Ji, Katsushi Matsuda, Liang Zhao, Mika Oishi, Takao Osaki, Wei Cheng, Xuchao Zhang, Xujiang Zhao, Yanchi Liu, Yiyou Sun","submitted_at":"2024-02-15T18:46:24Z","abstract_excerpt":"In-context learning has emerged as a groundbreaking ability of Large Language Models (LLMs) and revolutionized various fields by providing a few task-relevant demonstrations in the prompt. However, trustworthy issues with LLM's response, such as hallucination, have also been actively discussed. Existing works have been devoted to quantifying the uncertainty in LLM's response, but they often overlook the complex nature of LLMs and the uniqueness of in-context learning. In this work, we delve into the predictive uncertainty of LLMs associated with in-context learning, highlighting that such unce"},"claims":{"count":0,"items":[],"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"source":{"id":"2402.10189","kind":"arxiv","version":2},"verdict":{"id":null,"model_set":{},"created_at":null,"strongest_claim":"","one_line_summary":"","pipeline_version":null,"weakest_assumption":"","pith_extraction_headline":""},"integrity":{"clean":true,"summary":{"advisory":0,"critical":0,"by_detector":{},"informational":0},"endpoint":"/pith/2402.10189/integrity.json","findings":[],"available":true,"detectors_run":[],"snapshot_sha256":"c28c3603d3b5d939e8dc4c7e95fa8dfce3d595e45f758748cecf8e644a296938"},"references":{"count":0,"sample":[],"resolved_work":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57","internal_anchors":0},"formal_canon":{"evidence_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"},"aliases":[{"alias_kind":"arxiv","alias_value":"2402.10189","created_at":"2026-07-05T08:02:04.972123+00:00"},{"alias_kind":"arxiv_version","alias_value":"2402.10189v2","created_at":"2026-07-05T08:02:04.972123+00:00"},{"alias_kind":"doi","alias_value":"10.48550/arxiv.2402.10189","created_at":"2026-07-05T08:02:04.972123+00:00"},{"alias_kind":"pith_short_12","alias_value":"TMGAYAUUIXM7","created_at":"2026-07-05T08:02:04.972123+00:00"},{"alias_kind":"pith_short_16","alias_value":"TMGAYAUUIXM7HQ6F","created_at":"2026-07-05T08:02:04.972123+00:00"},{"alias_kind":"pith_short_8","alias_value":"TMGAYAUU","created_at":"2026-07-05T08:02:04.972123+00:00"}],"events":[],"event_summary":{},"paper_claims":[],"inbound_citations":{"count":3,"internal_anchor_count":0,"sample":[{"citing_arxiv_id":"2606.00206","citing_title":"Quantized Reasoning Models Think They Need to Think Longer, but They Do Not","ref_index":24,"is_internal_anchor":false},{"citing_arxiv_id":"2505.11737","citing_title":"TokUR: Token-Level Uncertainty Estimation for Large Language Model Reasoning","ref_index":24,"is_internal_anchor":false},{"citing_arxiv_id":"2506.10060","citing_title":"Textual Bayes: Quantifying Prompt Uncertainty in LLM-Based Systems","ref_index":34,"is_internal_anchor":false}]},"formal_canon":{"evidence_count":0,"sample":[],"anchors":[]},"links":{"html":"https://pith.science/pith/TMGAYAUUIXM7HQ6FSW5SJD7QRO","json":"https://pith.science/pith/TMGAYAUUIXM7HQ6FSW5SJD7QRO.json","graph_json":"https://pith.science/api/pith-number/TMGAYAUUIXM7HQ6FSW5SJD7QRO/graph.json","events_json":"https://pith.science/api/pith-number/TMGAYAUUIXM7HQ6FSW5SJD7QRO/events.json","paper":"https://pith.science/paper/TMGAYAUU"},"agent_actions":{"view_html":"https://pith.science/pith/TMGAYAUUIXM7HQ6FSW5SJD7QRO","download_json":"https://pith.science/pith/TMGAYAUUIXM7HQ6FSW5SJD7QRO.json","view_paper":"https://pith.science/paper/TMGAYAUU","resolve_alias":"https://pith.science/api/pith-number/resolve?arxiv=2402.10189&json=true","fetch_graph":"https://pith.science/api/pith-number/TMGAYAUUIXM7HQ6FSW5SJD7QRO/graph.json","fetch_events":"https://pith.science/api/pith-number/TMGAYAUUIXM7HQ6FSW5SJD7QRO/events.json","actions":{"anchor_timestamp":"https://pith.science/pith/TMGAYAUUIXM7HQ6FSW5SJD7QRO/action/timestamp_anchor","attest_storage":"https://pith.science/pith/TMGAYAUUIXM7HQ6FSW5SJD7QRO/action/storage_attestation","attest_author":"https://pith.science/pith/TMGAYAUUIXM7HQ6FSW5SJD7QRO/action/author_attestation","sign_citation":"https://pith.science/pith/TMGAYAUUIXM7HQ6FSW5SJD7QRO/action/citation_signature","submit_replication":"https://pith.science/pith/TMGAYAUUIXM7HQ6FSW5SJD7QRO/action/replication_record"}},"created_at":"2026-07-05T08:02:04.972123+00:00","updated_at":"2026-07-05T08:02:04.972123+00:00"}