REVIEW 1 cited by
Previously on the Stories: Recap Snippet Identification for Story Reading
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Similar to the "previously-on" scenes in TV shows, recaps can help book reading by recalling the readers' memory about the important elements in previous texts to better understand the ongoing plot. Despite its usefulness, this application has not been well studied in the NLP community. We propose the first benchmark on this useful task called Recap Snippet Identification with a hand-crafted evaluation dataset. Our experiments show that the proposed task is challenging to PLMs, LLMs, and proposed methods as the task requires a deep understanding of the plot correlation between snippets.
Forward citations
Cited by 1 Pith paper
-
The Stochastic Parrot on LLM's Shoulder: A Summative Assessment of Physical Concept Understanding
A new grid-based benchmark, PhysiCo, shows LLMs can recall and describe physical concepts in text yet lag humans by about 40% when the same concepts are presented as abstract grid transformations.
Discussion (0). Continue with ORCID to comment.