REVIEW 8 cited by
Risks and Opportunities of Open-Source Generative AI
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Applications of Generative AI (Gen AI) are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for these seismic changes has triggered a lively debate about the potential risks of the technology, and resulted in calls for tighter regulation, in particular from some of the major tech companies who are leading in AI development. This regulation is likely to put at risk the budding field of open-source generative AI. Using a three-stage framework for Gen AI development (near, mid and long-term), we analyze the risks and opportunities of open-source generative AI models with similar capabilities to the ones currently available (near to mid-term) and with greater capabilities (long-term). We argue that, overall, the benefits of open-source Gen AI outweigh its risks. As such, we encourage the open sourcing of models, training and evaluation data, and provide a set of recommendations and best practices for managing risks associated with open-source generative AI.
Forward citations
Cited by 8 Pith papers
-
Opening the Scope of Openness in AI
A taxonomy of 98 openness concepts from across disciplines reveals that AI openness discussions overemphasize access, inspection, reuse, and organic behavior while underrepresenting fairness, diversity, autonomy, and ...
-
MusGO: A Community-Driven Framework For Assessing Openness in Music-Generative AI
MusGO is a community-refined framework with 13 openness categories, applied to 16 music-generative models to produce a public openness leaderboard.
-
Heterogeneous Image GNN: Graph-Conditioned Diffusion for Image Synthesis
A graph-conditioned diffusion method (HIG) couples image nodes with conditioning nodes via a magnitude-preserving GNN, reporting FID 8.79 on Visual Genome layout-to-image and 11.42 on COCO-stuff mask-to-image at 512x512.
-
AlignGuard: Scalable Safety Alignment for Text-to-Image Generation
AlignGuard aligns text-to-image models by training category-specific LoRA safety experts with DPO on synthetic safe/unsafe pairs and merging them via activation-frequency selection.
-
Red Teaming AI Policy: A Taxonomy of Avoision and the EU AI Act
A taxonomy of avoision under the EU AI Act, with strategies to escape scope, exploit exemptions, and manipulate risk or operator categories.
-
Bare Minimum Mitigations for Autonomous AI Development
A position paper proposing two thresholds and four minimum safeguards for frontier AI labs before AI agents automate AI R&D.
-
Framing Instability in LLM Ethical Stance: Auditing Negation Sensitivity in Moral Dilemmas
Small open-weight LLMs endorse prohibited actions 24% of the time under affirmative framing but 77-100% under negated framings, a polarity swing that threatens high-stakes AI deployment.
-
AI Governance through Markets
Market governance mechanisms, supported by standardized AI disclosures, can create financial incentives for responsible AI development, according to this policy paper.
Discussion (0). Continue with ORCID to comment.