{"paper":{"title":"When AI Gets it Wrong: Reliability and Risk in AI-Assisted Medication Decision Systems","license":"http://creativecommons.org/licenses/by/4.0/","headline":"AI medication systems can cause patient harm through errors like missed interactions when used without human oversight.","cross_cats":["cs.LG"],"primary_cat":"cs.AI","authors_text":"Khalid Adnan Alsayed","submitted_at":"2026-04-01T22:53:17Z","abstract_excerpt":"Artificial intelligence (AI) systems are increasingly integrated into healthcare and pharmacy workflows, supporting tasks such as medication recommendations, dosage determination, and drug interaction detection. While these systems often demonstrate strong performance under standard evaluation metrics, their reliability in real-world decision-making remains insufficiently understood. In high-risk domains such as medication management, even a single incorrect recommendation can result in severe patient harm. This paper examines the reliability of AI-assisted medication systems by focusing on sy"},"claims":{"count":4,"items":[{"kind":"strongest_claim","text":"AI errors in medication-related contexts can lead to adverse drug reactions, ineffective treatment, or delayed care, particularly when systems are used without sufficient human oversight.","source":"verdict.strongest_claim","status":"machine_extracted","claim_id":"C1","attestation":"unclaimed"},{"kind":"weakest_assumption","text":"That the controlled simulated scenarios accurately capture relevant real-world failure modes and that the described errors would translate directly to clinical harm without oversight.","source":"verdict.weakest_assumption","status":"machine_extracted","claim_id":"C2","attestation":"unclaimed"},{"kind":"one_line_summary","text":"AI errors in medication decisions can cause adverse reactions or ineffective care, requiring risk-aware evaluation beyond traditional performance metrics.","source":"verdict.one_line_summary","status":"machine_extracted","claim_id":"C3","attestation":"unclaimed"},{"kind":"headline","text":"AI medication systems can cause patient harm through errors like missed interactions when used without human oversight.","source":"verdict.pith_extraction.headline","status":"machine_extracted","claim_id":"C4","attestation":"unclaimed"}],"snapshot_sha256":"97b474c97589614e047c3461dada2ac6927c8d3cbafdcbe10247ef2256fd08b6"},"source":{"id":"2604.01449","kind":"arxiv","version":3},"verdict":{"id":"e684bc1e-879a-4253-9631-fb6c6f22d6be","model_set":{"reader":"grok-4.3"},"created_at":"2026-05-13T21:55:33.290240Z","strongest_claim":"AI errors in medication-related contexts can lead to adverse drug reactions, ineffective treatment, or delayed care, particularly when systems are used without sufficient human oversight.","one_line_summary":"AI errors in medication decisions can cause adverse reactions or ineffective care, requiring risk-aware evaluation beyond traditional performance metrics.","pipeline_version":"pith-pipeline@v0.9.0","weakest_assumption":"That the controlled simulated scenarios accurately capture relevant real-world failure modes and that the described errors would translate directly to clinical harm without oversight.","pith_extraction_headline":"AI medication systems can cause patient harm through errors like missed interactions when used without human oversight."},"integrity":{"clean":true,"summary":{"advisory":0,"critical":0,"by_detector":{},"informational":0},"endpoint":"/pith/2604.01449/integrity.json","findings":[],"available":true,"detectors_run":[],"snapshot_sha256":"c28c3603d3b5d939e8dc4c7e95fa8dfce3d595e45f758748cecf8e644a296938"},"references":{"count":0,"sample":[],"resolved_work":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57","internal_anchors":0},"formal_canon":{"evidence_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"}