REVIEW 2 cited by
TimeLMs: Diachronic Language Models from Twitter
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Despite its importance, the time variable has been largely neglected in the NLP and language model literature. In this paper, we present TimeLMs, a set of language models specialized on diachronic Twitter data. We show that a continual learning strategy contributes to enhancing Twitter-based language models' capacity to deal with future and out-of-distribution tweets, while making them competitive with standardized and more monolithic benchmarks. We also perform a number of qualitative analyses showing how they cope with trends and peaks in activity involving specific named entities or concept drift.
Forward citations
Cited by 2 Pith papers
-
Concept Incongruence: An Exploration of Time and Death in Role Playing
LLMs asked to role-play dead historical figures rarely abstain from answering post-death questions, and their factual accuracy drops due to poorly encoded death states and role-playing-induced shifts in temporal repre...
-
'A Little Bubble of Friends': An Analysis of LGBTQ+ Pandemic Experiences Using Reddit Data
LGBTQ+ subreddits moved from personal coming-out and relationship topics to pandemic-era political discussions, with a small increase in positive sentiment that the authors interpret as a virtual 'bubble of friends' d...
Discussion (0). Continue with ORCID to comment.