REVIEW 4 cited by
o3-mini vs DeepSeek-R1: Which One is Safer?
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The irruption of DeepSeek-R1 constitutes a turning point for the AI industry in general and the LLMs in particular. Its capabilities have demonstrated outstanding performance in several tasks, including creative thinking, code generation, maths and automated program repair, at apparently lower execution cost. However, LLMs must adhere to an important qualitative property, i.e., their alignment with safety and human values. A clear competitor of DeepSeek-R1 is its American counterpart, OpenAI's o3-mini model, which is expected to set high standards in terms of performance, safety and cost. In this technical report, we systematically assess the safety level of both DeepSeek-R1 (70b version) and OpenAI's o3-mini (beta version). To this end, we make use of our recently released automated safety testing tool, named ASTRAL. By leveraging this tool, we automatically and systematically generated and executed 1,260 test inputs on both models. After conducting a semi-automated assessment of the outcomes provided by both LLMs, the results indicate that DeepSeek-R1 produces significantly more unsafe responses (12%) than OpenAI's o3-mini (1.2%).
Forward citations
Cited by 4 Pith papers
-
Is Reasoning All You Need? Probing Bias in the Age of Reasoning Language Models
Using the CLEAR-Bias benchmark, the authors find that base language models are generally more robust to bias elicitation than CoT-prompted or reasoning-enabled models.
-
Reasoner for Real-World Event Detection: Scaling Reinforcement Learning via Adaptive Perplexity-Aware Sampling Strategy
APARL combines a pass-rate-based adaptive sampler with KL-regularized DAPO reinforcement learning and reports F1 improvements of 17.19% in-domain and 9.59% out-of-domain for customer service anomaly detection.
-
Efficient Strategy for Improving Large Language Model (LLM) Capabilities
Proposes a combined data-selection, training-strategy, and architecture-adjustment approach to improve LLM capability under resource constraints.
-
DeepSeek in Healthcare: A Survey of Capabilities, Risks, and Clinical Applications of Open-Source Large Language Models
A narrative review of DeepSeek-R1's healthcare capabilities, risks, and applications, without new experiments.
Discussion (0). Sign in to comment.