pith. sign in

arxiv: 2307.04492 · v1 · pith:RK4MOICBnew · submitted 2023-07-10 · 💻 cs.SE

Calculating Originality of LLM Assisted Source Code

classification 💻 cs.SE
keywords codesourcestudentsllm-basedtoolanswerapplicationsassist
0
0 comments X
read the original abstract

The ease of using a Large Language Model (LLM) to answer a wide variety of queries and their high availability has resulted in LLMs getting integrated into various applications. LLM-based recommenders are now routinely used by students as well as professional software programmers for code generation and testing. Though LLM-based technology has proven useful, its unethical and unattributed use by students and professionals is a growing cause of concern. As such, there is a need for tools and technologies which may assist teachers and other evaluators in identifying whether any portion of a source code is LLM generated. In this paper, we propose a neural network-based tool that instructors can use to determine the original effort (and LLM's contribution) put by students in writing source codes. Our tool is motivated by minimum description length measures like Kolmogorov complexity. Our initial experiments with moderate sized (up to 500 lines of code) have shown promising results that we report in this paper.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Reinforcement Learning for Computer-Use Agents with Autonomous Evaluation

    cs.AI 2026-06 unverdicted novelty 6.0

    A noise-corrected VLM evaluator reward for PPO improves GUI agent success rates by 12.6 percentage points over zero-shot and 5.1 points over raw evaluator rewards across desktop benchmarks.