Pith. sign in

REVIEW 1 cited by

Crowdsourcing Question-Answer Meaning Representations

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1711.05885 v1 pith:6KKIRTST submitted 2017-11-16 cs.CL

classification cs.CL
keywords question-answercrowdsourcingincludingmeaningpairspredicate-argumentqamrsrepresentations
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We introduce Question-Answer Meaning Representations (QAMRs), which represent the predicate-argument structure of a sentence as a set of question-answer pairs. We also develop a crowdsourcing scheme to show that QAMRs can be labeled with very little training, and gather a dataset with over 5,000 sentences and 100,000 questions. A detailed qualitative analysis demonstrates that the crowd-generated question-answer pairs cover the vast majority of predicate-argument relationships in existing datasets (including PropBank, NomBank, QA-SRL, and AMR) along with many previously under-resourced ones, including implicit arguments and relations. The QAMR data and annotation code is made publicly available to enable future work on how best to model these complex phenomena.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Quality Control in Open-Ended Crowdsourcing: A Survey

    cs.HC 2024-12 conditional novelty 4.0 of 10

    The paper maps quality control techniques for crowdsourcing tasks with large or infinite answer spaces into a two-tiered framework.

Pith tools