A hybrid fine-tuning objective using KL divergence for token calibration and Kahneman-Tversky optimization for semantic binding enables LLMs to produce outputs that match desired attribute distributions across repeated prompts.
Prompt-and-rerank: A method for zero-shot and few-shot arbitrary textual style transfer with small language models
3 Pith papers cite this work. Polarity classification is still indexing.
3
Pith papers citing it
abstract
We propose a method for arbitrary textual style transfer (TST)--the task of transforming a text into any given style--utilizing general-purpose pre-trained language models. Our method, Prompt-and-Rerank, is based on a mathematical formulation of the TST task, decomposing it into three constituent components: textual similarity, target style strength, and fluency. Specifically, our method first uses zero-shot or few-shot prompting to obtain a set of candidate generations in the target style, and then re-ranks these candidates according to a combination of the three components above. Empirically, our method enables small pre-trained language models to perform on par with state-of-the-art large-scale models while consuming two orders of magnitude less compute and memory. Finally, we conduct a systematic investigation of the effect of model size and prompt design (e.g., prompt paraphrasing and delimiter-pair choice) on style transfer quality across seven diverse textual style transfer datasets.
citation-role summary
background 1
baseline 1
citation-polarity summary
fields
cs.CL 3representative citing papers
Chain-of-thought prompting enables large language models to surpass average human performance on 17 of 23 challenging BIG-Bench tasks.
An abduction-guided LLM method shifts stories between 'we' and 'me' framings better than zero-shot prompting, according to the paper's own LLM-based diagnostic survey.
citing papers explorer
-
Controlling Distributional Bias in Multi-Round LLM Generation via KL-Optimized Fine-Tuning
A hybrid fine-tuning objective using KL divergence for token calibration and Kahneman-Tversky optimization for semantic binding enables LLMs to produce outputs that match desired attribute distributions across repeated prompts.
-
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
Chain-of-thought prompting enables large language models to surpass average human performance on 17 of 23 challenging BIG-Bench tasks.
-
From We to Me: Theory Informed Narrative Shift with Abductive Reasoning
An abduction-guided LLM method shifts stories between 'we' and 'me' framings better than zero-shot prompting, according to the paper's own LLM-based diagnostic survey.