Pith. sign in

REVIEW

Search-based Optimisation of LLM Learning Shots for Story Point Estimation

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2403.08430 v1 pith:OOYIZMJT submitted 2024-03-13 cs.SE cs.AI

classification cs.SEcs.AI
keywords estimationlearningexamplesperformancesearch-basedstorytasksthem
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

One of the ways Large Language Models (LLMs) are used to perform machine learning tasks is to provide them with a few examples before asking them to produce a prediction. This is a meta-learning process known as few-shot learning. In this paper, we use available Search-Based methods to optimise the number and combination of examples that can improve an LLM's estimation performance, when it is used to estimate story points for new agile tasks. Our preliminary results show that our SBSE technique improves the estimation performance of the LLM by 59.34% on average (in terms of mean absolute error of the estimation) over three datasets against a zero-shot setting.

Discussion (0). Continue with ORCID to comment.

Pith tools