Pith. sign in

Researcher Evidence Record

Mark Harman

This bounded record lists 39 Pith paper rows and 0 imported work rows attributed to this corpus identity. The enumerated, non-disputed paper rows include cs.SE, cs.LG, cs.AI work dated 2018 to 2026. The record describes sources and coverage; it makes no judgment about the person.

Compiled coverage vector

Measured lane counts only. Not a trust score or person verdict.

Enumerated paper scope: 4 fields (cs.SE, cs.LG, cs.AI, +1 more) · 2018-2026 sources: authors, author_identifiers · paper_authors · author_works · current_verdicts · cited_works

A sourced case file for attributed work. It is neither a profile score nor a verdict about this researcher.

Attributed works

A bounded ledger from the Pith paper and imported-work queries. Counts and source confidence stay with each work.

  1. 2026 Pith paper

    Prompt Coverage Adequacy

    cs.SE provisional current review present

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    5
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: a current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  2. 2026 Pith paper

    TerminalWorld: Benchmarking Agents on Real-World Terminal Tasks

    cs.AI provisional current review present

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    9
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: a current Pith review exists.
    Citation counts
    • 3 pith inbound references from cited_work_pith_inbound_counts
  3. 2026 Pith paper

    Reducing Hallucination in Enterprise AI Workflows via Hybrid Utility Minimum Bayes Risk (HUMBR)

    cs.LG provisional current review present

    Sources and evidence
    Authorship source
    backfill
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: a current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  4. 2026 Pith paper

    EET: Experience-Driven Early Termination for Cost-Efficient Software Engineering Agents

    cs.SE provisional current review present

    Sources and evidence
    Authorship source
    backfill
    Printed name
    Mark Harman
    Author position
    4
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: a current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  5. 2025 Pith paper

    Library Hallucinations in LLM-Generated Code: A Risk Analysis Grounded in Developer Queries

    cs.SE provisional current review present

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: a current Pith review exists.
    Citation counts
    • 2 pith inbound references from cited_work_pith_inbound_counts
  6. 2025 Pith paper

    Generative AI for Testing of Autonomous Driving Systems: A Survey

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 2 pith inbound references from cited_work_pith_inbound_counts
  7. 2025 Pith paper

    Benchmarking LLMs for Unit Test Generation from Real-World Functions

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 1 pith inbound references from cited_work_pith_inbound_counts
  8. 2025 Pith paper

    YATE: The Role of Test Repair in LLM-Based Unit Test Generation

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    4
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 2 pith inbound references from cited_work_pith_inbound_counts
  9. 2025 Pith paper

    Harden and Catch for Just-in-Time Assured LLM-Based Software Testing: Open Research Challenges

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    1
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  10. 2025 Pith paper

    A Study of LLMs' Preferences for Libraries and Programming Languages

    cs.SE provisional current review present

    Sources and evidence
    Authorship source
    backfill
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: a current Pith review exists.
    Citation counts
    • 10 pith inbound references from cited_work_pith_inbound_counts
  11. 2025 Pith paper

    Mutation-Guided LLM-based Test Generation at Meta

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 4 pith inbound references from cited_work_pith_inbound_counts
  12. 2024 Pith paper

    Measuring the Influence of Incorrect Code on Test Generation

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 1 pith inbound references from cited_work_pith_inbound_counts
  13. 2024 Pith paper

    LLM-Powered Test Case Generation for Detecting Bugs in Plausible Programs

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    5
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 3 pith inbound references from cited_work_pith_inbound_counts
  14. 2024 Pith paper

    Enhancing Testing at Meta with Rich-State Simulated Populations

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    6
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  15. 2024 Pith paper

    Automated Unit Test Improvement using Large Language Models at Meta

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    5
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 3 pith inbound references from cited_work_pith_inbound_counts
  16. 2024 Pith paper

    Observation-based unit test generation at Meta

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    2
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  17. 2024 Pith paper

    Assured LLM-Based Software Engineering

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    2
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  18. 2023 Pith paper

    Large Language Models for Software Engineering: Survey and Open Problems

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 15 pith inbound references from cited_work_pith_inbound_counts
  19. 2023 Pith paper

    Large Language Models in Fault Localisation

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    5
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 7 pith inbound references from cited_work_pith_inbound_counts
  20. 2023 Pith paper

    COCO: Testing Code Generation Systems via Concretized Instructions

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    6
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 1 pith inbound references from cited_work_pith_inbound_counts
  21. 2023 Pith paper

    An Empirical Study of the Non-determinism of ChatGPT in Code Generation

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 4 pith inbound references from cited_work_pith_inbound_counts
  22. 2023 Pith paper

    Fairness Improvement with Multiple Protected Attributes: How Far Are We?

    cs.LG provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    4
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  23. 2023 Pith paper

    Simulation-Driven Automated End-to-End Test and Oracle Inference

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    4
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  24. 2022 Pith paper

    Keeping Mutation Test Suites Consistent and Relevant with Long-Standing Mutants

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  25. 2022 Pith paper

    Fairness Testing: A Comprehensive Survey and Analysis of Trends

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    4
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  26. 2022 Pith paper

    Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey

    cs.LG provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    4
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 4 pith inbound references from cited_work_pith_inbound_counts
  27. 2022 Pith paper

    A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    4
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  28. 2021 Pith paper

    Leveraging Automated Unit Tests for Unsupervised Code Translation

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    4
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 7 pith inbound references from cited_work_pith_inbound_counts
  29. 2020 Pith paper

    An Empirical Study on Failed Error Propagation in Java Programs with Real Faults

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  30. 2020 Pith paper

    FrUITeR: A Framework for Evaluating UI Test Reuse

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    7
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  31. 2020 Pith paper

    Ownership at Large -- Open Problems and Challenges in Ownership Management

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    8
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  32. 2020 Pith paper

    WES: Agent-based User Interaction Simulation on Real Infrastructure

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    8
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 1 pith inbound references from cited_work_pith_inbound_counts
  33. 2019 Pith paper

    FlakiMe: Laboratory-Controlled Test Flakiness Impact Assessment. A Case Study on Mutation Testing and Program Repair

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    4
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  34. 2019 Pith paper

    Automatic Testing and Improvement of Machine Translation

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  35. 2019 Pith paper

    A Survey of Constrained Combinatorial Testing

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    5
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  36. 2019 Pith paper

    Sub-Turing Islands in the Wild

    cs.PL provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  37. 2019 Pith paper

    Model Validation Using Mutated Training Labels: An Exploratory Study

    cs.LG provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    2
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.
  38. 2018 Pith paper

    Indexing Operators to Extend the Reach of Symbolic Execution

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    3
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    • 1 pith inbound references from cited_work_pith_inbound_counts
  39. 2018 Pith paper

    A Study of Bug Resolution Characteristics in Popular Programming Languages

    cs.SE provisional measured, no current review

    Sources and evidence
    Authorship source
    arxiv_oai
    Printed name
    Mark Harman
    Author position
    7
    Identity state
    provisional
    Source confidence
    0.7
    Review coverage
    Measured: no current Pith review exists.
    Citation counts
    No source count is attached to this work row.

Evidence apparatus

The machinery behind this record. Every lane states whether Pith measured it, did not query it, could not reach it, or withheld it.

LaneStateObservedBoundary and source
identity Measured 2 Canonical identity row plus public typed identifiers.
source=authors, author_identifiers
papers Measured 39 of 39 bounded rows Rows attributed to this author UUID in the Pith corpus.
source=paper_authors
works Measured zero 0 of 0 bounded rows Imported works not duplicated by the paper ledger.
source=author_works
reviews Measured 6 of 39 bounded rows Coverage count only. No review outcome is projected onto the person.
source=current_verdicts
citations Measured 18 of 39 bounded rows Counts remain itemized by work and source.
source=cited_works
coauthors Measured 50 of 39 bounded rows Shared-work edges from admitted paper rows.
source=paper_authors
account Unavailable No public count of 1 bounded rows Account metadata is separate from corpus evidence.
source=users.author_id
Public identity sources
  • name variant
    Mark Harman
    backfill
    confidence 0.6
Enumerated research scope

Fields and dates come only from enumerated, non-disputed Pith paper rows. They do not claim career completeness.

  • cs.SE33 rows
  • cs.LG4 rows
  • cs.AI1 rows
  • cs.PL1 rows
  • 20182 rows
  • 20195 rows
  • 20204 rows
  • 20211 rows
  • 20224 rows
  • 20236 rows
  • 20246 rows
  • 20257 rows
  • 20264 rows
Shared-work index
Record scope

The work queries are bounded. Missing rows may mean measured zero, an unavailable source, a query that did not run, or private data that Pith withheld. The lane table keeps those cases separate.

Paper findings remain attached to papers. They do not become findings about this researcher.