The paper introduces DFIR-Metric, a three-part benchmark for evaluating LLMs in digital forensics, and finds that leading models master certification-style knowledge but fail practical forensic task completion.
In: Advances in Neural Information Processing Systems 37 (NeurIPS 2024), Datasets and Benchmarks Track (2024)
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
dataset 1
citation-polarity summary
fields
cs.CR 1years
2025 1verdicts
CONDITIONAL 1roles
dataset 1polarities
unclear 1representative citing papers
citing papers explorer
-
DFIR-Metric: A Benchmark Dataset for Evaluating Large Language Models in Digital Forensics and Incident Response
The paper introduces DFIR-Metric, a three-part benchmark for evaluating LLMs in digital forensics, and finds that leading models master certification-style knowledge but fail practical forensic task completion.