pith. sign in

arxiv: 2402.17834 · v1 · pith:SOX4KS5Vnew · submitted 2024-02-27 · 💻 cs.CL · stat.ML

Stable LM 2 1.6B Technical Report

Marco Bellagente , Jonathan Tow , Dakota Mahan , Duy Phung , Maksym Zhuravinskyi , Reshinth Adithyan , James Baicoianu , Ben Brooks
show 11 more authors
Nathan Cooper Ashish Datta Meng Lee Emad Mostaque Michael Pieler Nikhil Pinnaparju Paulo Rocha Harry Saini Hannah Teufel Niccolo Zanichelli Carlos Riquelme
This is my paper
classification 💻 cs.CL stat.ML
keywords reportmodelstablelmbenchmarksmodelsopentechnicaladdition
0
0 comments X
read the original abstract

We introduce StableLM 2 1.6B, the first in a new generation of our language model series. In this technical report, we present in detail the data and training procedure leading to the base and instruction-tuned versions of StableLM 2 1.6B. The weights for both models are available via Hugging Face for anyone to download and use. The report contains thorough evaluations of these models, including zero- and few-shot benchmarks, multilingual benchmarks, and the MT benchmark focusing on multi-turn dialogues. At the time of publishing this report, StableLM 2 1.6B was the state-of-the-art open model under 2B parameters by a significant margin. Given its appealing small size, we also provide throughput measurements on a number of edge devices. In addition, we open source several quantized checkpoints and provide their performance metrics compared to the original model.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Unconditional Truthfulness: Learning Unconditional Uncertainty of Large Language Models

    cs.CL 2024-08 unverdicted novelty 6.0

    A regression model using attention features and recurrent uncertainty scores improves selective generation in LLMs over unsupervised and supervised baselines on ten datasets and three models.

  2. HalluScan: A Systematic Benchmark for Detecting and Mitigating Hallucinations in Instruction-Following LLMs

    cs.CL 2026-05 unverdicted novelty 5.0

    HalluScan benchmark tests hallucination detectors on LLMs, identifies NLI Verification as top performer with 0.88 AUROC, and introduces HalluScore (r=0.41 with humans) plus a routing method for 2x cost savings.

  3. HalluScan: A Systematic Benchmark for Detecting and Mitigating Hallucinations in Instruction-Following LLMs

    cs.CL 2026-05 unverdicted novelty 4.0

    HalluScan benchmark evaluates hallucination detection in LLMs, reporting NLI Verification at AUROC 0.88 and introducing HalluScore (r=0.41 with humans) plus Adaptive Detection Routing for 2x cost savings.

  4. Skywork-Reward: Bag of Tricks for Reward Modeling in LLMs

    cs.AI 2024-10 unverdicted novelty 4.0

    Data-centric filtering yields an 80K preference dataset and reward models that lead RewardBench while boosting other top entries.