{"id":"5564a34b-851a-4a4b-b342-c401cd3a5fe0","arxiv_id":"2508.18288","paper_version":1,"verdict":"UNVERDICTED","confidence":"LOW","novelty_score":4.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":0,"one_line_summary":"A scoping review argues that ASR fairness research overlooks governance-centered approaches that center community agency, and proposes a governance-centered ASR lifecycle.","lead":"This paper reviews 44 published studies on how speech recognition systems treat African American English, and argues that current fairness fixes ignore community governance. It proposes a governance-centered framework for building fairer speech AI.","discovery_kind":"review","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The 'critical gap' claim depends entirely on the unverifiable search/inclusion protocol; without the methodology, the central negative finding may be an artifact of corpus selection.","rationale":"The reader's verdict is UNVERDICTED, based only on the abstract, and the weakest assumption correctly identified is corpus representativeness. My stress-test agrees: the central claim—that a critical gap in governance-centered work exists—is a negative empirical claim that can only be evaluated if the search and inclusion methodology is transparent and complete. Since the methodology is not visible, the claim is not currently assessable. That does not mean the paper is wrong; it means the verification is pending. I therefore recommend keeping the reader's UNVERDICTED status (no change). I give the paper credit for a plausible and socially important framing, but the abstract alone cannot support the gap claim. The concrete test—re-running the search with governance-specific terms—would directly resolve whether the gap is real or a selection artifact.","tokens_in":580,"tokens_out":2497,"duration_ms":32183,"concrete_test":"Request or reconstruct the full scoping-review protocol (PRISMA-style: databases, search strings, screening criteria, date range). Independently re-run the searches in ACM DL, IEEE Xplore, ACL Anthology, and Scopus, adding governance-related terms ('speech governance,' 'participatory design,' 'data sovereignty,' 'community accountability,' 'algorithmic impact assessment,' 'co-design') combined with ASR and African American English, for the same date range. Count how many peer-reviewed items meeting the original inclusion criteria are returned. If more than a handful (e.g., >5) of relevant governance-centered papers exist and were excluded by the original search, the 'critical gap' is largely a corpus artifact; if the added searches return no additional qualifying papers, the claim is supported.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper's central claim is a negative one: after reviewing 44 peer-reviewed publications, the authors find a 'critical gap in governance-centered approaches' to ASR for AAE speakers. That claim is only meaningful if those 44 papers are a fair sample of the relevant literature. The abstract does not state the databases searched, the search strings used, the inclusion/exclusion criteria, the screening process, or the date range. Because the full text is not available in the submitted version, none of this is verifiable. If the searches omitted terms such as 'participatory design,' 'data governance,' 'community accountability,'' 'co-design,' or 'algorithmic impact assessment,' or if the venues were predominantly ML/NLP venues that publish few governance papers, then the 'critical gap' would be an artifact of the search boundary rather than a genuine property of the field. Additionally, category (4) of the review already includes 'emerging practices and design recommendations for more equitable systems,' so governance-oriented work may have been classified elsewhere; without a codebook, the gap may be a labeling choice rather than an empirical absence. This is not a challenge to the goal of the paper, which is worthwhile, but a specific methodological requirement for the central negative claim to hold.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"This paper reports a scoping review of 44 peer-reviewed publications on fairness, bias, and equity in automatic speech recognition (ASR) and related speech and language technologies for African American English (AAE) speakers. The authors identify four thematic areas of inquiry, claim that there is a critical gap in governance-centered approaches that foreground community agency, linguistic justice, and participatory accountability, and propose a governance-centered ASR lifecycle as a new framework.","tokens_in":890,"tokens_out":3710,"duration_ms":41250,"significance":"If the reviewed corpus is representative, the paper makes a timely interdisciplinary contribution by synthesizing literature across HCI, ML/NLP, and sociolinguistics and by centering community agency and linguistic justice. The proposed governance-centered lifecycle could be a useful conceptual tool. However, the central negative claim—that a critical governance gap exists—depends entirely on the transparency and completeness of the literature search and coding process, which are not reported in the available text. This makes the significance conditional on missing methodological evidence.","major_comments":[{"comment":"The central claim of a 'critical gap in governance-centered approaches' is an absence claim. The abstract does not report the databases searched, search strings, date range, inclusion/exclusion criteria, screening process, or coding procedure. Without this information, there is no basis for judging whether the 44 selected papers are representative of the broader ASR fairness literature. If relevant governance-focused work exists but was excluded by search boundaries or venue selection, the gap is an artifact of corpus construction. Please provide a PRISMA-ScR-style flow diagram, full search strategies for each database, a complete list of included studies, and a detailed codebook.","section":"Abstract / Methods (missing)"},{"comment":"The abstract states that category (4) already includes 'emerging practices and design recommendations for more equitable systems.' This means governance-related work may have been classified into category (4) rather than being treated as governance-centered. Without a codebook that defines category boundaries and reports coding decisions, the claimed 'critical gap' may reflect a labeling choice rather than an empirical absence. Please report how borderline papers were categorized, provide exemplars for each category, and include inter-coder agreement if applicable.","section":"Category (4) and coding scheme"},{"comment":"The proposed 'governance-centered ASR lifecycle' is not operationalized in the abstract. Terms such as governance, community agency, and participatory accountability need explicit definitions and criteria so that a reader can independently verify whether the literature indeed lacks such approaches. Without a clear operational definition, the central negative claim is unfalsifiable. Please specify what counts as governance-centered (e.g., data governance, community oversight, algorithmic impact assessments, participatory design) and how the proposed lifecycle differs from existing frameworks in HCI or fairness research.","section":"Governance-centered ASR lifecycle"}],"minor_comments":[{"comment":"The abstract reports that 44 peer-reviewed publications were reviewed but provides no reference list or supplementary material. A final version should include the full list of included studies and, ideally, a table mapping each study to the four thematic categories.","section":"Abstract / References"},{"comment":"The paper uses 'scoping literature review' in the abstract. If the authors intend a systematic review, they should either register a protocol and follow standard reporting guidelines or consistently use 'scoping review' to avoid ambiguity.","section":"Terminology"},{"comment":"The abstract mentions 'AAE speakers and other linguistically diverse communities.' It would be helpful to clarify whether the 44 papers focus specifically on AAE or include broader language-marginalization contexts, since this affects the generalizability of the governance-gap claim.","section":"Clarity of scope"}],"recommendation":"major_revision","confidential_remarks":"The paper's topic is important and the proposed direction is promising, but the submitted version—at least as available to me—contains only the abstract and omits the entire methodological apparatus on which the central claim rests. The missing methods are not an inherent flaw in the research question; they are fixable with a full methods section, search documentation, and a more careful operationalization of 'governance-centered.' I recommend major revision rather than rejection, because the deficiencies are addressable and the review could make a valuable contribution if the evidence is made verifiable."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"The one thing you should know: this is a plausible and well-organized scoping review that does something genuinely useful—it pulls 44 papers from HCI, ML/NLP, and sociolinguistics into four thematic buckets and proposes a governance-centered ASR lifecycle. That framing is a real contribution to a subfield that mostly talks about technical fairness fixes. The synthesis of existing work is the main value, not a new result, and the authors don't oversell it as more than a review.\n\nWhat the paper does well: it names four areas of inquiry that match what I see in the literature (harms, data practice, methods for inclusion, design recommendations), and it positions community agency and participatory accountability as a governance question rather than a model-tuning question. That is the right instinct and worth building on.\n\nWhere I'd be careful: the abstract gives no search strategy, inclusion criteria, date range, or coding details. The stress-test note is fair—the claim that there is a 'critical gap in governance-centered approaches' is only meaningful if the 44 papers are a fair sample. If the searches missed terms like participatory design, data governance, or community accountability, the gap is an artifact of the boundary. Also, category 4 already includes design recommendations for equitable systems, so the gap may partly be a labeling choice rather than an absence. These are standard methodological concerns for a scoping review, not fatal flaws. A referee needs to see the methods section to decide whether the negative claim holds.\n\nI can't fully judge the paper because I only have the abstract; the full text is not in the package. But given the topic's importance and the original framing, this deserves a serious referee, not a desk reject. If the methods hold up, this is a citable reference for anyone working on ASR bias or language marginalization. I'd send it to peer review and ask the reviewers to check the search protocol and the gap-claim reasoning. That's the whole ballgame.\n\nFor your reading group: maybe, once the full text is available. It's a worthwhile conversation starter about governance in speech technology. I wouldn't cite it in my own work until the methodology is visible, but I'd keep it on my radar.","headline":"A useful governance-framed scoping review, but the central negative claim lives or dies on a search protocol the abstract does not report.","tokens_in":1243,"tokens_out":1484,"would_cite":false,"duration_ms":19262,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"A scoping review argues that ASR bias toward African American English persists because governance, not just technical fairness, is missing from the system lifecycle.","keywords":["automatic speech recognition","African American English","AI fairness","bias in speech technology","responsible AI","scoping review","governance","linguistic justice"],"falsifier":"A systematic search of the same databases using governance-related keywords (e.g., 'participatory,' 'community accountability,' 'linguistic justice,' 'governance' in ASR) that surfaces a substantial existing body of peer-reviewed work on governance-centered ASR would directly contradict the review's central claim of a critical gap.","tokens_in":581,"feed_emoji":"🎙️","tokens_out":1421,"duration_ms":18458,"temperature":0.7,"pith_summary":"This paper reviews 44 peer-reviewed studies on fairness, bias, and equity in automatic speech recognition (ASR) for African American English (AAE) speakers. It finds that technical fairness efforts are growing but remain fragmented, and identifies a critical gap: almost no work treats governance, community agency, linguistic justice, and participatory accountability as core design concerns. The authors propose a governance-centered ASR lifecycle as a framework to fill that gap. If they are right, improving ASR for marginalized language varieties requires shifting attention from model fixes to who controls data, who defines harm, and who holds systems accountable.","feed_headline":"Missing governance, not just algorithms, explains ASR bias","feed_subtitle":"A review of 44 studies finds little work giving African American English speakers agency over speech systems.","key_machinery":"The central object is the proposed governance-centered ASR lifecycle—a framework that treats governance as a continuous, participatory process across the entire speech technology pipeline. It is defined in the paper as an emergent interdisciplinary framework that foregrounds community agency, linguistic justice, and participatory accountability. The review uses this framework to organize the identified literature and to expose the gap: existing work tends to address isolated stages of the pipeline without a governance layer that ties them together and empowers affected communities.","core_discovery":"The paper's central claim is that current ASR fairness research for AAE speakers concentrates on technical interventions—data collection, annotation, model training, and evaluation—while leaving governance-centered approaches almost entirely absent. The authors synthesize the literature into four areas of inquiry and argue that the fourth, emerging practices and design recommendations, still lacks mechanisms for community agency, linguistic justice, and participatory accountability. They propose a governance-centered ASR lifecycle that spans design, development, deployment, and maintenance, making accountability to AAE-speaking communities an explicit structural component rather than an afte","pith_inferences":["A testable extension would be to audit ASR vendor documentation and model cards for mentions of community governance or participatory accountability, quantifying how rare such mechanisms actually are in deployed systems.","The governance-centered lifecycle may connect to neighboring work on data sovereignty and algorithmic impact assessments, suggesting that speech technology regulation could borrow governance tools already used in other AI domains.","If the gap is confirmed, a plausible consequence the authors do not state is that current ASR fairness benchmarks may overstate progress because they measure technical performance without measuring who benefits and who is harmed.","The framework implies that equitable ASR is not a property of a model alone but of a sociotechnical system, which would require changes to how research is funded, evaluated, and published."],"forward_implications":["If the governance-centered lifecycle is adopted, ASR development for AAE speakers would include community-defined success metrics alongside benchmark accuracy.","Data practices would shift from one-time collection and annotation to ongoing consent, ownership, and audit mechanisms led by AAE-speaking stakeholders.","Technical fairness interventions such as accent-robust training would be evaluated within a broader accountability structure, not as standalone fixes.","Policymakers would gain a concrete target: requiring participatory governance in speech AI systems that serve linguistically marginalized communities.","The framework could be extended to other language varieties and marginalized speaker groups beyond African American English."],"supporting_citations":[],"fun_headline_variants":["Governance, not algorithms, key to fair ASR for AAE","ASR fairness review: community agency missing","Speech tech for AAE: technical fixes fall short without governance","44 studies: ASR bias fix requires AAE community governance"],"cache_read_input_tokens":2688,"weakest_assumption_plain":"The 44 selected peer-reviewed publications are representative of the broader ASR fairness literature, so the identified 'critical gap' genuinely exists rather than being an artifact of the search strategy or inclusion criteria.","fun_headline_variants_meta":{"raw":{"variants":["Governance, not algorithms, key to fair ASR for AAE","ASR fairness review: community agency missing","Speech tech for AAE: technical fixes fall short without governance","44 studies: ASR bias fix requires AAE community governance"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000262,"raw_usage":{"total_tokens":1405,"prompt_tokens":689,"completion_tokens":716,"prompt_tokens_details":{"cached_tokens":256},"prompt_cache_hit_tokens":256,"prompt_cache_miss_tokens":433,"completion_tokens_details":{"reasoning_tokens":656}},"tokens_in":433,"tokens_out":716,"duration_ms":7700,"temperature":1.0,"reasoning_tokens":656,"cache_read_input_tokens":256,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-05T18:07:58.728739+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"A systematic search of the same databases using governance-related keywords (e.g., 'participatory,' 'community accountability,' 'linguistic justice,' 'governance' in ASR) that surfaces a substantial existing body of peer-reviewed work on governance-centered ASR would directly contradict the review's central claim of a critical gap.","supporting_citations":[],"review_version":1}