Pith. sign in

REVIEW 3 major objections 5 minor 29 references

Navigating the New Landscape: A Conceptual Model for Project-Based Assessment (PBA) in the Age of GenAI

T0 review · 3 major / 5 minor · reviewed 2026-08-05 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read A five-part design keeps project-based assessment authentic when students use generative AI.

desk verdict A useful practitioner framework for GenAI-era project assessment, but the 'ensures' claim and the trust-in-process-artifacts gap need work before you rely on it. read the letter →

arxiv 2508.11709 v1 pith:2XAOV7KN submitted 2025-08-14 cs.CY cs.AI

Rajan Kadel , Samar Shailendra , Urvashi Rahul Saxena This is my paper · ORCID
classification cs.CYcs.AI
keywords generativeAIproject-basedassessmentacademicintegrityprocess-orientedevaluationliteracyhigher-orderthinkingpersonalisedfeedbackcapstoneprojects
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper argues that project-based assessment breaks down in the GenAI era because final artifacts can be produced or heavily shaped by AI tools, so it proposes a conceptual model that shifts evaluation to the learning process itself. The model is built on five redesign principles—multi-modal and multi-faceted assessment, AI literacy and responsible use, higher-order thinking, process-oriented evaluation, and personalised feedback—and views each project element through two lenses: traditional assessment and 'GenAI insight'. The claim is that this dual-lens, process-focused design keeps assessments valid and authentic, protects academic integrity, and develops future-ready graduate skills. A worked example of a 12-week capstone subject shows how the principles map onto concrete assessment tasks.

What carries the argument

The load-bearing mechanism is the paired evaluation viewpoint: each of the six PBA elements is assessed once in a 'Traditional Focus' mode (familiar criteria such as clarity, feasibility, quality, and communication) and once in a 'GenAI Insight' mode (prompt formulation, critical evaluation of GenAI output, transparency of use, ownership of process, and reflection on ethical implications). This dual reading, together with the five redesign principles, is what the paper uses to convert GenAI from a threat to authenticity into assessed, documented learning activity.

What would settle it

Have a cohort complete the proposed capstone design while a separate group is asked to produce all process artifacts (logs, reflections, GenAI interaction documentation) with GenAI assistance after the fact. If trained assessors cannot distinguish the fabricated artifacts from genuine ones and give equivalent grades, the model's claim to protect authenticity and integrity is falsified.

Watch

Extended reading notes

Core claim

The paper's central proposal is a conceptual model in which a 'Project Lifecycle & Assessment Hub' connects five redesign principles to six elements of project-based assessment—project definition, knowledge acquisition, process management, artifact creation, communication, and reflection. Every element is evaluated from both a Traditional Focus and a GenAI Insight viewpoint: the former uses familiar criteria with minor adjustments, while the latter assesses how effectively, critically, and ethically the student engaged with GenAI, what unique human skills they demonstrated alongside it, and whether they acknowledged its use. The paper asserts that this structure ensures assessments remain va

Load-bearing premise

The model's integrity guarantees depend on students truthfully producing the process artifacts—research and planning logs, reflections, and documented GenAI interactions—that are used as evidence of learning; if those can be fabricated or outsourced, the assessment validates fiction rather than learning.

Editorial extensions

If this is right

  • Educators can directly apply the five principles and the two evaluation viewpoints to existing capstone subjects, using the mapping tables as a checklist.
  • If the model is adopted, assessment evidence shifts from the final report to a portfolio of logs, reflections, supervisor evaluations, and viva presentations.
  • The worked example demonstrates that a 12-week capstone can distribute assessment across weekly checkpoints, making last-minute outsourcing harder.
  • The model aligns with regulatory expectations that assessment design account for both opportunities and risks of GenAI, and supports threshold-standard compliance.
  • Adoption would require explicit teaching of AI literacy and GenAI interaction documentation, turning responsible use into a graded outcome.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A testable extension is to audit whether process artifacts can be fabricated: the model's integrity claim stands or falls on the truthfulness of logs and reflections, which GenAI could itself generate.
  • The GenAI Insight lens could be sharpened into a structured rubric for prompt engineering and output critique, making the 'critical evaluation' criterion more objective.
  • The model's process documentation assumes privacy-compatible collection of student–GenAI interactions; operationalising that at scale will require technical and consent infrastructure the paper does not detail.
  • The two-lens evaluation could be extended to program-level assessment, using the same principles to check whether a whole curriculum develops AI literacy progressively.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper proposes a conceptual model for redesigning project-based assessment (PBA) in higher education in response to generative AI (GenAI). It identifies five redesign principles—multi-modal/multi-faceted assessment, AI literacy and responsible use, higher-order thinking, process-oriented evaluation, and personalised feedback—and embeds them in a 'Project Lifecycle & Assessment Hub' that is evaluated through two viewpoints: a Traditional Focus and a GenAI Insight lens. The model is instantiated in a twelve-week capstone design with nine assessment components, and the paper provides mapping tables linking these components to the redesign principles and to six PBA elements (E1–E6). The central claim, stated in Section VII, is that following the model 'ensures that assessments not only remain valid and authentic but also support the development of essential skills for future-ready graduates.'

Significance. The paper addresses a timely and practically important problem: how to preserve authenticity, integrity, and learning validation in project-based assessment now that GenAI can produce substantial portions of student work. The strength of the paper is its synthesis of current literature and institutional guidance (TEQSA, UNESCO, EDUCAUSE) into a structured, visually communicated model. The mapping tables (Tables III and IV) offer a concrete, ready-to-adapt template for curriculum designers, and the proposed capstone design in Table II is immediately usable. A further strength is that the claims are actionable and falsifiable: the authors explicitly state as future work the implementation and systematic evaluation of the model, which creates a clear path for empirical testing. The conceptual nature and lack of empirical validation are expected for a model-proposal paper, but the strength of the final claims goes beyond what the evidence in the manuscript can support.

major comments (3)
  1. [Section VII and Section VI-B] The conclusion's central claim that the model 'ensures that assessments not only remain valid and authentic' is unsupported by the evidence presented. Section VI-B asserts that formative logs, supervisor evaluations, and viva 'verify the student's ownership of their work.' However, the verification mechanisms described verify the existence and presentation of process artifacts—Research & Planning Logs, reflection reports, documented GenAI interactions (Table II; Section IV-D)—but not their truthfulness. These artifacts can themselves be fabricated or wholly generated by GenAI, and a viva that probes the final product does not authenticate each log entry. The anti-contract-cheating logic therefore rests on an unverified premise: that students honestly document their process. The authors should either moderate the 'ensures' language to 'supports' or 'is designed to facilitate,' or, prefera
  2. [Section VII, final paragraph] The authors state that the model 'ensures student learning and assessment security' and recommend its adoption, but the only stated validation is 'future work' — implementation and systematic evaluation of the model. The mapping tables (Tables III and IV) demonstrate alignment by construction; they are conceptual mappings, not empirical evidence that the assessments achieve the desired outcomes. For a conceptual paper, such evidence is not required, but the conclusion overreaches. A revised version should explicitly frame the model as a theoretically grounded proposal whose effectiveness requires empirical testing, and it should articulate what form that testing would take (e.g., comparative cohorts, analysis of student artifacts, instructor and student surveys).
  3. [Section V-C and Table I] The 'GenAI Insight' evaluation viewpoint is not operationalized sufficiently to support the model's claim to assess AI literacy and higher-order thinking. Table I lists criteria such as 'effective prompt formulation,' 'critical evaluation of GenAI outputs,' and 'authenticity of voice,' but no rubric, rating scale, or decision rule is provided to distinguish genuine student contribution from GenAI-generated content in practice. Without such operational definitions, two supervisors could rate the same artifact very differently, undermining the model's reliability and validity—precisely the properties the paper claims to ensure. The authors should add a sample rubric or at least an annotated example showing how a GenAI Insight evaluation is conducted, including how evidence of 'guidance, curation, and significant refinement' (E4, Table I) is elicited and scored.
minor comments (5)
  1. [Table II] The 'Weight (%)' column for 'Research & Planning Log – Formative' reads '5 and Hurdle,' which is ambiguous. The text clarifies that the weight is 5% and the assessment is a hurdle, but the table format should separate weight from hurdle status (e.g., a separate 'Hurdle' column or a note under the table).
  2. [Section III, references] There is an inconsistency in author names: the text mentions 'Pelleti et al.' for the EDUCAUSE GenAI Readiness Assessment, but reference [11] is authored by EDUCAUSE itself; later in the same paragraph 'William et al.' appears for reference [23], which is 'Williams et al.' in the bibliography. Standardize the in-text citations to match the reference list.
  3. [Section I, last paragraph] The phrase 'The proposed PBA Accepted in 2025 World Engineering Education Forum - Global Engineering Deans Council (WEEF-GEDC)' appears to be a stray line from the publication venue, not part of the paper's outline. It should be removed or placed in a footnote.
  4. [Section VI-A, paragraph 2] In the bullet list, 'The timeline distributes tasks across the semester (weeks three to 12), supporting progressive development and continuous engagement and continuous delivery' has a repetition ('continuous engagement and continuous delivery'). Reword to avoid the duplication.
  5. [Section IV, global] The five redesign principles are presented as bullet lists of 'key points,' but the relationship between these key points and the later PBA elements (E1–E6) is not explicit. For instance, 'Focus on Higher-Order Thinking' in Section IV-C could be more directly linked to the criteria in Table I for E4 and E5. Consider adding a short mapping sentence before Table III to connect the principles to the elements, making the structure easier for readers to follow.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the paper is a conceptual proposal whose conclusions are normative recommendations, not derived predictions.

full rationale

The manuscript is a conceptual design paper: it proposes redesign principles (Section IV), an assessment model (Section V), and a sample capstone design (Table II), then maps the sample to the principles (Tables III and IV). There is no formal derivation, no equation, no fitted parameter, and no quantity that is defined in terms of another and then predicted from it. The authors' self-citations ([9], [10], [12], [27]) are used as background or supporting context; none of them is invoked as a uniqueness theorem or as the sole justification for a load-bearing claim. The central conclusion in Section VII—that the model 'ensures that assessments not only remain valid and authentic'—is an unvalidated advocacy claim, not a result forced by definition or by the authors' prior work. Section VII also explicitly states 'we plan to implement this PBA model... and systematically evaluate', which is a self-acknowledged limitation confirming that no empirical prediction is being made or retrofitted. The reviewer-identified weakness that process artifacts such as Research & Planning Logs and reflection reports can themselves be fabricated is a substantive correctness threat, but it is an external validity problem, not a circularity: the model's claims do not reduce to that assumption by construction. Therefore no circularity step can be exhibited, and the honest finding is score 0.

Assumptions & free parameters 0 free parameters · 6 assumptions · 2 invented entities

The model rests on domain assumptions from educational research about assessment and AI literacy; there are no fitted parameters or empirical calibration.

assumptions (6)
  • domain assumption Students can use GenAI to create or significantly influence final project products, threatening authenticity.
    Stated in abstract and Section II; motivates the whole paper.
  • domain assumption Process-oriented evaluation better validates learning than product-only assessment.
    Assumed throughout Section IV-D and conclusion; based on literature [6], [26], [27].
  • domain assumption Multi-modal and multi-faceted assessment improves authenticity and integrity.
    Section IV-A; asserted but not empirically demonstrated.
  • domain assumption AI literacy is a desirable learning outcome for graduates.
    Section IV-B; based on regulatory guidance and literature.
  • domain assumption Higher-order thinking can be fostered by checking tasks against GenAI capabilities and assessing creativity.
    Section IV-C; assumes that task-design checks with GenAI tools meaningfully ensure student effort.
  • domain assumption Personalised feedback improves project learning and validation.
    Section IV-E and conclusion.
invented entities (2)
  • GenAI Insight evaluation viewpoint
    purpose: A second lens for evaluating each PBA element, focusing on effective, critical, and ethical engagement with GenAI and the human skills demonstrated on top of AI output.
    Conceptual construct introduced by the paper; no independent empirical validation is provided.
  • Project Lifecycle & Assessment Hub
    purpose: Central organizing component of the model representing the student's project journey and linking redesign principles to the six PBA elements.
    Abstract conceptual element of the proposed framework; not directly observable or measured.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Navigating the New Landscape: A Conceptual Model for Project-Based Assessment (PBA) in the Age of GenAI." pith.science (2026). https://pith.science/paper/2XAOV7KN

@misc{pith2026250811709,
  author       = {Pith},
  title        = {Pith review of: Navigating the New Landscape: A Conceptual Model for Project-Based Assessment (PBA) in the Age of GenAI},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/2XAOV7KN}},
  note         = {Machine review of arXiv:2508.11709}
}
read the original abstract

The rapid integration of Generative Artificial Intelligence (GenAI) into higher education presents both opportunities and challenges for assessment design, particularly within Project-Based Assessment (PBA) contexts. Traditional assessment methods often emphasise the final product in the PBA, which can now be significantly influenced or created by GenAI tools, raising concerns regarding product authenticity, academic integrity, and learning validation. This paper advocates for a reimagined assessment model for Project-Based Learning (PBL) or a capstone project that prioritises process-oriented evaluation, multi-modal and multifaceted assessment design, and ethical engagement with GenAI to enable higher-order thinking. The model also emphasises the use of (GenAI-assisted) personalised feedback by a supervisor as an observance of the learning process during the project lifecycle. A use case scenario is provided to illustrate the application of the model in a capstone project setting. The paper concludes with recommendations for educators and curriculum designers to ensure that assessment practices remain robust, learner-centric, and integrity-driven in the evolving landscape of GenAI.

Figures

Figures reproduced from arXiv: 2508.11709 by the authors.

Figure 1
Figure 1. Assessment redesign principles for Project-Based Assessment (PBA). [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Conceptual model for PBA in the era of GenAI. [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

29 extracted references · 29 canonical work pages

  1. [1]

    Assessment reform for the age of artificial intelligence,

    S. H. Jason M Lodge and M. Bearman, “Assessment reform for the age of artificial intelligence,” https://www.teqsa.gov.au/sites/default/files/ 2023-09/assessment-reform-age-artificial-intelligence-discussion-paper. pdf, 2023, accessed: (03-06-2025)

    work page 2023

  2. [2]

    A scoping review on how generative artificial intelligence transforms assessment in higher education,

    Q. Xia, X. Weng, F. Ouyang, T. J. Lin, and T. K. Chiu, “A scoping review on how generative artificial intelligence transforms assessment in higher education,” International Journal of Educational Technology in Higher Education , vol. 21, no. 1, p. 40, 2024

    work page 2024

  3. [3]

    Project based assessment in the era of generative ai-challenges and opportunities,

    N. Boughattas, W. Neji, and F. Ziadi, “Project based assessment in the era of generative ai-challenges and opportunities,” Tsvetkova, Anastasia; Morariu, Andrei-Raoul; Hellstr ¨om, Magnus; Bolbot, Victor; Virtanen, Seppo Investigation of student perspectives on curriculum needs for autonomous shipping, p. 347, 2024

    work page 2024

  4. [4]

    Student self-reflection as a tool for managing genai use in large class assessment,

    C. Combrinck and N. Loubser, “Student self-reflection as a tool for managing genai use in large class assessment,” Discover Education , vol. 4, no. 1, p. 72, 2025

    work page 2025

  5. [5]

    PBL Meets AI: Innovating Assessment in Higher Education,

    B. Divjak, B. Svetec, and K. Pa ˇzur Ani ˇci´c, “PBL Meets AI: Innovating Assessment in Higher Education,” in CSEDU 2025 17th International Conference on Computer Supported Education Proceedings (Volume 2) . Set´ubal: SCITEPRESS, 2025, pp. 120–130

    work page 2025

  6. [6]

    Process not product in the written assessment,

    D. Smith and N. Francis, “Process not product in the written assessment,” in Using generative AI effectively in higher education . Routledge, 2024, pp. 115–126

    work page 2024

  7. [7]

    Contextual Assessment Design in the Age of Generative AI

    C. Gonsalves, “Contextual Assessment Design in the Age of Generative AI.” Journal of Learning Development in Higher Education , 2025

    work page 2025

  8. [8]

    Implementing generative AI (GenAI) in higher education: A systematic review of case studies,

    M. Belkina, S. Daniel, S. Nikolic, R. Haque, S. Lyden, P. Neal, S. Grundy, and G. M. Hassan, “Implementing generative AI (GenAI) in higher education: A systematic review of case studies,” Computers and Education: Artificial Intelligence , p. 100407, 2025

    work page 2025

Show all 29 references
  1. [9]

    Crafting tomorrow’s evaluations: assessment design strategies in the era of generative AI,

    R. Kadel, B. K. Mishra, S. Shailendra, S. Abid, M. Rani, and S. P. Mahato, “Crafting tomorrow’s evaluations: assessment design strategies in the era of generative AI,” in 2024 International Symposium on Educational Technology (ISET). IEEE, 2024, pp. 13–17

    2024

  2. [10]

    Experiences with Content Development and Assessment Design in the Era of GenAI,

    A. Sharma, S. Shailendra, and R. Kadel, “Experiences with Content Development and Assessment Design in the Era of GenAI,” in 2025 6th International Conference on Computer Science, Engineering, and Education (CSEE), 2025, pp. 1–5

    2025

  3. [11]

    Higher Education Generative AI Readiness Assessment,

    EDUCAUSE, “Higher Education Generative AI Readiness Assessment,” Apr. 2024, accessed: 2025-06-02. [Online]. Available: https://library.educause.edu/resources/2024/4/ higher-education-generative-ai-readiness-assessment

    2024

  4. [12]

    Framework for adoption of generative artificial intelligence (GenAI) in education,

    S. Shailendra, R. Kadel, and A. Sharma, “Framework for adoption of generative artificial intelligence (GenAI) in education,” IEEE Transactions on Education , 2024

    2024

  5. [13]

    Is your curriculum GenAI-proof? A method for GenAI impact assessment and a case study,

    R. Jongkind, E. Elings, E. Joukes, T. Broens, H. Leopold, F. Wiesman, and J. Meinema, “Is your curriculum GenAI-proof? A method for GenAI impact assessment and a case study,” MedEdPublish, vol. 15, no. 11, p. 11, 2025

    2025

  6. [14]

    A multinational assessment of AI literacy among university students in Germany, the UK, and the US,

    M. Hornberger, A. Bewersdorff, D. S. Schiff, and C. Nerdel, “A multinational assessment of AI literacy among university students in Germany, the UK, and the US,” Computers in Human Behavior: Artificial Humans, vol. 4, p. 100132, 2025

    2025

  7. [15]

    AI Literacy in K-12 and Higher Education in the Wake of Generative AI: An Integrative Review,

    X. Gu and B. J. Ericson, “AI Literacy in K-12 and Higher Education in the Wake of Generative AI: An Integrative Review,” arXiv preprint arXiv:2503.00079, 2025

    2025 arXiv

  8. [16]

    Scaffolding AI literacy: An instructional model for academic librarianship,

    K. A. LaFlamme, “Scaffolding AI literacy: An instructional model for academic librarianship,” The Journal of Academic Librarianship, vol. 51, no. 3, p. 103041, 2025

    2025

  9. [17]

    K. Sol, S. Sok, and K. Heng, Rethinking Assessment in Higher Education in the Age of Generative AI . Singapore: Springer Nature Singapore, 2025, pp. 1–5. [Online]. Available: https://doi.org/10.1007/ 978-981-13-2262-4 327-1

    2025

  10. [18]

    What’s worth measuring? The future of assessment in the AI age,

    H. Desai, “What’s worth measuring? The future of assessment in the AI age,” UNESCO, May 2025, accessed: 2025-06-02. [Online]. Available: https://www.unesco.org/en/articles/ whats-worth-measuring-future-assessment-ai-age

    2025

  11. [19]

    Defining AI Literacy for Higher Education,

    M. Kassorla, M. Georgieva, and A. Papini, “Defining AI Literacy for Higher Education,” https://www.educause. edu/content/2024/ai-literacy-in-teaching-and-learning/ defining-ai-literacy-for-higher-education, October 2024, accessed: 2025-06-02

    2024

  12. [20]

    What Faculty Want: Key Results from the Global AI Faculty Survey 2025,

    Digital Education Council, “What Faculty Want: Key Results from the Global AI Faculty Survey 2025,” Jan. 2025, accessed: 2025-06-02. [Online]. Available: https://www.digitaleducationcouncil.com/post/ what-faculty-want-key-results-from-the-global-ai-faculty-survey-2025

    2025

  13. [21]

    (2025, January) Ai in education: ensuring teacher agency in a technology-empowered world

    Australian Council for Educational Research. (2025, January) Ai in education: ensuring teacher agency in a technology-empowered world. Accessed: 2025-06-05. [Online]. Available: https://www.acer.org/au/discover/article/ ai-in-education-ensuring-teacher-agency-in-a-technology-e...

    2025

  14. [22]

    Embracing project-based assessments in the age of ai in open distance e-learning,

    E. du Plessis, “Embracing project-based assessments in the age of ai in open distance e-learning,” International Journal of Information and Education Technology , vol. 15, no. 2, pp. 372–381, February 2025. [Online]. Available: https://www.ijiet.org/vol15/IJIET-V15N2-2249.pdf

    2025

  15. [23]

    Ai+ ethics curricula for middle school youth: Lessons learned from three project-based curricula,

    R. Williams, S. Ali, N. Devasia, D. DiPaola, J. Hong, S. P. Kaputsos, B. Jordan, and C. Breazeal, “Ai+ ethics curricula for middle school youth: Lessons learned from three project-based curricula,” International Journal of Artificial Intelligence in Education , vol. 33, no. 2,...

    2023

  16. [24]

    Technological frontiers in education: Exploring the impact of ai and immersive learning,

    P. Mueller-Csernetzky, E. Malakhatka, L. Thuvander, D. Kragic, and J. Kabo, “Technological frontiers in education: Exploring the impact of ai and immersive learning,” in Human-Technology Interaction: Interdisciplinary Approaches and Perspectives . Springer, 2025, pp. 291–328

    2025

  17. [25]

    Machine vs machine: Using ai to tackle generative ai threats in assessment,

    M. S. Torkestani and T. Mansouri, “Machine vs machine: Using ai to tackle generative ai threats in assessment,” in Proceedings of The Chartered Association of Business Schools (CABS) , 2025, author accepted manuscript, University of Exeter Institutional Repository, handle 1087...

    2025

  18. [26]

    Innovation of instructional design and assessment in the age of generative artificial intelligence,

    C. B. Hodges and P. A. Kirschner, “Innovation of instructional design and assessment in the age of generative artificial intelligence,” TechTrends, vol. 68, no. 1, pp. 195–199, 2024

    2024

  19. [27]

    Towards an Holistic Framework to Mitigate and Detect Contract Cheating within an Academic Institute—A Proposal,

    D. B. Guruge and R. Kadel, “Towards an Holistic Framework to Mitigate and Detect Contract Cheating within an Academic Institute—A Proposal,” Education Sciences, vol. 13, no. 2, p. 148, 2023

    2023

  20. [28]

    Assessment is learning: developing a student-centred approach for assessment in higher education,

    S. Rutherford, C. Pritchard, and N. Francis, “Assessment is learning: developing a student-centred approach for assessment in higher education,” FEBS Open Bio , vol. 15, no. 1, pp. 21–34, 2025

    2025

  21. [29]

    Higher Education Standards Framework (Threshold Standards) 2021,

    Australian Government, “Higher Education Standards Framework (Threshold Standards) 2021,” Apr. 2021, registered on 27 April 2021. Accessed: 2025-06-02. [Online]. Available: https://www.legislation.gov. au/F2021L00488/latest/text

    2021

Pith tools

Reviewed August 5, 2026 · model on record in the stance chip above.