REVIEW 18 cited by
Generative AI for Synthetic Data Generation: Methods, Challenges and the Future
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The recent surge in research focused on generating synthetic data from large language models (LLMs), especially for scenarios with limited data availability, marks a notable shift in Generative Artificial Intelligence (AI). Their ability to perform comparably to real-world data positions this approach as a compelling solution to low-resource challenges. This paper delves into advanced technologies that leverage these gigantic LLMs for the generation of task-specific training data. We outline methodologies, evaluation techniques, and practical applications, discuss the current limitations, and suggest potential pathways for future research.
Forward citations
Cited by 18 Pith papers
-
HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants
A new benchmark finds low to moderate human agency support in 20 LLM assistants across six dimensions.
-
Less is Enough: Synthesizing Diverse Data in LLM Feature Space with Sparse Autoencoders
Coverage of sparse-autoencoder-identified task features predicts post-training performance and can guide synthesis of small, high-impact datasets (2,000 vs. 300,000 samples).
-
Understanding and Improving Data Repurposing
A conceptual framework that defines data repurposing as schema augmentation and outlines use-agnostic data properties (accessibility, transparency, elasticity) and repurposing activities.
-
Is Your Model Fairly Certain? Uncertainty-Aware Fairness Evaluation for LLMs
UCerF scores LLM fairness by both correctness and confidence, and SynthBias provides 31,756 gender-occupation coreference samples for benchmark testing.
-
JARVIS: A Multi-Agent Code Assistant for High-Quality EDA Script Generation
A multi-agent LLM framework with rule enforcement, compiler feedback, and retrieval achieves 92/93/81% pass@1 on three self-built EDA benchmarks, up from 67/62/43% for the best single model.
-
LLMs can be easily Confused by Instructional Distractions
A new benchmark, DIM-Bench, shows that LLMs frequently follow instructions hidden inside the target input rather than the user's actual instruction, even when explicitly told to ignore them.
-
Synthetic Artifact Auditing: Tracing LLM-Generated Synthetic Data Usage in Downstream Applications
A three-method auditing framework detects with roughly 87 to 97 percent accuracy whether classifiers, generators, and t-SNE plots were trained on or derived from LLM-generated synthetic data.
-
Mind the Gap: Towards Generalizable Autonomous Penetration Testing via Domain Randomization and Meta-Reinforcement Learning
GAP combines domain randomization via LLM-generated environments with meta-RL to improve generalization of autonomous pentesting agents across unseen host configurations and vulnerabilities.
-
MIMDE: Exploring the Use of Synthetic vs Human Data for Evaluating Multi-Insight Multi-Document Extraction Tasks
LLMs rank similarly on human and synthetic data for extracting insights, but synthetic data does not predict how well models map insights back to source documents.
-
CorrSynth -- A Correlated Sampling Method for Diverse Dataset Generation from LLMs
By sampling multiple LLM continuations in parallel with mutual contrast, CorrSynth yields more diverse synthetic classification datasets and higher student accuracy than few-shot generation.
-
Hate Speech Detection in Turkish and Arabic: A Comprehensive Study
Introduces Turkish and Arabic hate speech datasets with multi-topic coverage and develops BERT models for hate category classification, intensity prediction, target identification, and span detection.
-
Privacy-Preserving Synthetic Review Generation with Diverse Writing Styles Using LLMs
LLM-generated synthetic reviews are less diverse and sometimes more privacy-relevant than real reviews; an adaptive prompt method raises diversity metrics but does not clearly reduce privacy risk.
-
Large language model as user daily behavior data generator: balancing population diversity and individual personality
LLM-generated synthetic behavior data improves mobility and smartphone-use prediction models by up to 18.9% and captures roughly 60 to 88% of the gains from real-data fine-tuning.
-
LLMs to Support a Domain Specific Knowledge Assistant
A synthetic QA dataset for IFRS sustainability reporting is created with LLMs and used to build and evaluate two QA pipelines, with the fully LLM-based pipeline scoring highest.
-
FASTGEN: Fast and Cost-Effective Synthetic Tabular Data Generation with LLMs
FASTGEN uses an LLM to infer per-field distributions and generate reusable Python sampling scripts, cutting token cost by 60x at 10,000 records while approximately matching direct-generation quality on several metrics.
-
Synthetic Human Action Video Data Generation with Pose Transfer
Synthetic action videos generated by pose-transferring real clips onto novel 3D avatars improve action recognition accuracy when added to real training data.
-
Powering LLM Regulation through Data: Bridging the Gap from Compute Thresholds to Customer Experiences
LLM products should be certified on curated, domain-specific datasets rather than regulated through compute thresholds or general benchmarks.
-
Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models
This survey organizes LLM synthetic data research around quality, diversity, and complexity, claiming quality mainly helps in-distribution generalization, diversity mainly helps out-of-distribution generalization, and...
Discussion (0). Continue with ORCID to comment.