Presents Ishigaki-IDS-Bench, the first benchmark for LLM-based IDS generation from BIM requirements, with baseline results showing max 65.6% Facet F1 and 33.1% content pass rate across 10 models.
Lawbench: Benchmarking legal knowledge of large language models
5 Pith papers cite this work. Polarity classification is still indexing.
citation-role summary
citation-polarity summary
verdicts
UNVERDICTED 5roles
background 2polarities
background 2representative citing papers
Authority-style prefixes increase refusal rates 2-20x in small on-prem LLMs on criminal legal prompts while a jailbreak prefix shows mixed effects.
MinT is a system for managing million-scale LoRA adapter catalogs on shared 1T-parameter base models, with reported efficiency gains in adapter movement, multi-policy training, and catalog addressability.
TrustLLM defines eight trustworthiness principles, creates a six-dimension benchmark, and evaluates 16 LLMs showing proprietary models generally lead but some open-source ones are close while over-calibration can hurt utility.
The paper reviews the background, technology, applications, limitations, and future directions of OpenAI's Sora text-to-video generative model based on public information.
citing papers explorer
-
Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
Presents Ishigaki-IDS-Bench, the first benchmark for LLM-based IDS generation from BIM requirements, with baseline results showing max 65.6% Facet F1 and 33.1% content pass rate across 10 models.
-
LLMs Prompted for Legal Context Object More: Overrefusal from Small On-Premises LLMs in Criminal Legal Context
Authority-style prefixes increase refusal rates 2-20x in small on-prem LLMs on criminal legal prompts while a jailbreak prefix shows mixed effects.
-
MinT: Managed Infrastructure for Training and Serving Millions of LLMs
MinT is a system for managing million-scale LoRA adapter catalogs on shared 1T-parameter base models, with reported efficiency gains in adapter movement, multi-policy training, and catalog addressability.
-
TrustLLM: Trustworthiness in Large Language Models
TrustLLM defines eight trustworthiness principles, creates a six-dimension benchmark, and evaluates 16 LLMs showing proprietary models generally lead but some open-source ones are close while over-calibration can hurt utility.
-
Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models
The paper reviews the background, technology, applications, limitations, and future directions of OpenAI's Sora text-to-video generative model based on public information.