{"record_type":"pith_number_record","schema_url":"https://pith.science/schemas/pith-number/v1.json","pith_number":"pith:2025:EX3ZIJAHORKVVYWTOMSWECGDY5","short_pith_number":"pith:EX3ZIJAH","schema_version":"1.0","canonical_sha256":"25f794240774555ae2d373256208c3c75cc53a2af1acd5e6708ea564236c6122","source":{"kind":"arxiv","id":"2508.18124","version":3},"attestation_state":"computed","paper":{"title":"CMPhysBench: A Benchmark for Evaluating Large Language Models in Condensed Matter Physics","license":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/","headline":"","cross_cats":["cs.AI"],"primary_cat":"cs.LG","authors_text":"Benteng Chen, Binzhao Luo, Changyong He, Di Zhang, Dongchen Huang, Dongfei Cui, Dong Han, Dongzhan Zhou, Hongming Weng, Jiaming Su, Jiatong Li, Jinguang Cheng, Jin Zeng, Kunling Liu, Lei Bai, Mao Su, Qianjia Cheng, Shiqi Geng, Shuchen Pu, Shufei Zhang, Tengchao Yang, Wanli Ouyang, Weida Wang, Wei Ma, Xi Dai, Xin Li, Yuhan Shui, Yunqi Cai, Yuqiang Li, Zeke Xie, Zhihao Dou, Zhiyuan Gao, Zhiyu Liu, Zhong Fang, Ziyang Zheng","submitted_at":"2025-08-25T15:32:22Z","abstract_excerpt":"We introduce CMPhysBench, designed to assess the proficiency of Large Language Models (LLMs) in Condensed Matter Physics, as a novel Benchmark. CMPhysBench is composed of more than 520 graduate-level meticulously curated questions covering both representative subfields and foundational theoretical frameworks of condensed matter physics, such as magnetism, superconductivity, strongly correlated systems, etc. To ensure a deep understanding of the problem-solving process,we focus exclusively on calculation problems, requiring LLMs to independently generate comprehensive solutions. Meanwhile, leve"},"verification_status":{"content_addressed":true,"pith_receipt":true,"author_attested":false,"weak_author_claims":0,"strong_author_claims":0,"externally_anchored":false,"storage_verified":false,"citation_signatures":0,"replication_records":0,"graph_snapshot":true,"references_resolved":false,"formal_links_present":false},"canonical_record":{"source":{"id":"2508.18124","kind":"arxiv","version":3},"metadata":{"license":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/","primary_cat":"cs.LG","submitted_at":"2025-08-25T15:32:22Z","cross_cats_sorted":["cs.AI"],"title_canon_sha256":"dcc5feaab19862233dd7d0c2a22fb37be4ee3450f462d834f22f446337792ef2","abstract_canon_sha256":"a4effa474a48cbfeaf5038bc1fa74c4b3d026f71ce2eb0d7296d1afae2e02f7c"},"schema_version":"1.0"},"receipt":{"kind":"pith_receipt","key_id":"pith-v1-2026-05","algorithm":"ed25519","signed_at":"2026-07-05T12:01:46.621729Z","signature_b64":"0rdCC4t8IsAZCM9Ljfek3LUrfbHCM7oPwNZ36CGUEOEnwKGRFp37M45NDXmcqTFK8qNLWqlKzn8WAUSt7HngBw==","signed_message":"canonical_sha256_bytes","builder_version":"pith-number-builder-2026-05-17-v1","receipt_version":"0.3","canonical_sha256":"25f794240774555ae2d373256208c3c75cc53a2af1acd5e6708ea564236c6122","last_reissued_at":"2026-07-05T12:01:46.621162Z","signature_status":"signed_v1","first_computed_at":"2026-07-05T12:01:46.621162Z","public_key_fingerprint":"8d4b5ee74e4693bcd1df2446408b0d54"},"graph_snapshot":{"paper":{"title":"CMPhysBench: A Benchmark for Evaluating Large Language Models in Condensed Matter Physics","license":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/","headline":"","cross_cats":["cs.AI"],"primary_cat":"cs.LG","authors_text":"Benteng Chen, Binzhao Luo, Changyong He, Di Zhang, Dongchen Huang, Dongfei Cui, Dong Han, Dongzhan Zhou, Hongming Weng, Jiaming Su, Jiatong Li, Jinguang Cheng, Jin Zeng, Kunling Liu, Lei Bai, Mao Su, Qianjia Cheng, Shiqi Geng, Shuchen Pu, Shufei Zhang, Tengchao Yang, Wanli Ouyang, Weida Wang, Wei Ma, Xi Dai, Xin Li, Yuhan Shui, Yunqi Cai, Yuqiang Li, Zeke Xie, Zhihao Dou, Zhiyuan Gao, Zhiyu Liu, Zhong Fang, Ziyang Zheng","submitted_at":"2025-08-25T15:32:22Z","abstract_excerpt":"We introduce CMPhysBench, designed to assess the proficiency of Large Language Models (LLMs) in Condensed Matter Physics, as a novel Benchmark. CMPhysBench is composed of more than 520 graduate-level meticulously curated questions covering both representative subfields and foundational theoretical frameworks of condensed matter physics, such as magnetism, superconductivity, strongly correlated systems, etc. To ensure a deep understanding of the problem-solving process,we focus exclusively on calculation problems, requiring LLMs to independently generate comprehensive solutions. Meanwhile, leve"},"claims":{"count":0,"items":[],"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"source":{"id":"2508.18124","kind":"arxiv","version":3},"verdict":{"id":null,"model_set":{},"created_at":null,"strongest_claim":"","one_line_summary":"","pipeline_version":null,"weakest_assumption":"","pith_extraction_headline":""},"integrity":{"clean":true,"summary":{"advisory":0,"critical":0,"by_detector":{},"informational":0},"endpoint":"/pith/2508.18124/integrity.json","findings":[],"available":true,"detectors_run":[],"snapshot_sha256":"c28c3603d3b5d939e8dc4c7e95fa8dfce3d595e45f758748cecf8e644a296938"},"references":{"count":0,"sample":[],"resolved_work":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57","internal_anchors":0},"formal_canon":{"evidence_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"},"aliases":[{"alias_kind":"arxiv","alias_value":"2508.18124","created_at":"2026-07-05T12:01:46.621241+00:00"},{"alias_kind":"arxiv_version","alias_value":"2508.18124v3","created_at":"2026-07-05T12:01:46.621241+00:00"},{"alias_kind":"doi","alias_value":"10.48550/arxiv.2508.18124","created_at":"2026-07-05T12:01:46.621241+00:00"},{"alias_kind":"pith_short_12","alias_value":"EX3ZIJAHORKV","created_at":"2026-07-05T12:01:46.621241+00:00"},{"alias_kind":"pith_short_16","alias_value":"EX3ZIJAHORKVVYWT","created_at":"2026-07-05T12:01:46.621241+00:00"},{"alias_kind":"pith_short_8","alias_value":"EX3ZIJAH","created_at":"2026-07-05T12:01:46.621241+00:00"}],"events":[],"event_summary":{},"paper_claims":[],"inbound_citations":{"count":3,"internal_anchor_count":0,"sample":[{"citing_arxiv_id":"2604.02934","citing_title":"PolyReal: A Benchmark for Real-World Polymer Science Workflows","ref_index":49,"is_internal_anchor":false},{"citing_arxiv_id":"2604.14718","citing_title":"The Agentification of Scientific Research: A Physicist's Perspective","ref_index":29,"is_internal_anchor":false},{"citing_arxiv_id":"2605.02351","citing_title":"MolViBench: Evaluating LLMs on Molecular Vibe Coding","ref_index":2,"is_internal_anchor":false}]},"formal_canon":{"evidence_count":0,"sample":[],"anchors":[]},"links":{"html":"https://pith.science/pith/EX3ZIJAHORKVVYWTOMSWECGDY5","json":"https://pith.science/pith/EX3ZIJAHORKVVYWTOMSWECGDY5.json","graph_json":"https://pith.science/api/pith-number/EX3ZIJAHORKVVYWTOMSWECGDY5/graph.json","events_json":"https://pith.science/api/pith-number/EX3ZIJAHORKVVYWTOMSWECGDY5/events.json","paper":"https://pith.science/paper/EX3ZIJAH"},"agent_actions":{"view_html":"https://pith.science/pith/EX3ZIJAHORKVVYWTOMSWECGDY5","download_json":"https://pith.science/pith/EX3ZIJAHORKVVYWTOMSWECGDY5.json","view_paper":"https://pith.science/paper/EX3ZIJAH","resolve_alias":"https://pith.science/api/pith-number/resolve?arxiv=2508.18124&json=true","fetch_graph":"https://pith.science/api/pith-number/EX3ZIJAHORKVVYWTOMSWECGDY5/graph.json","fetch_events":"https://pith.science/api/pith-number/EX3ZIJAHORKVVYWTOMSWECGDY5/events.json","actions":{"anchor_timestamp":"https://pith.science/pith/EX3ZIJAHORKVVYWTOMSWECGDY5/action/timestamp_anchor","attest_storage":"https://pith.science/pith/EX3ZIJAHORKVVYWTOMSWECGDY5/action/storage_attestation","attest_author":"https://pith.science/pith/EX3ZIJAHORKVVYWTOMSWECGDY5/action/author_attestation","sign_citation":"https://pith.science/pith/EX3ZIJAHORKVVYWTOMSWECGDY5/action/citation_signature","submit_replication":"https://pith.science/pith/EX3ZIJAHORKVVYWTOMSWECGDY5/action/replication_record"}},"created_at":"2026-07-05T12:01:46.621241+00:00","updated_at":"2026-07-05T12:01:46.621241+00:00"}