Pith. sign in

REVIEW 4 major objections 7 minor 21 references

Motivando el uso y aprendizaje de Bash a trav\'es de concursos de programaci\'on

T0 review · 4 major / 7 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Bash contests held over SSH, with progressive problem unlocks, hidden-test grading, and a live leaderboard, are an effective way to teach the command line, the paper claims, with 85% of surveyed students rating the activity useful.

desk verdict A well-specified Bash contest system worth imitating, wrapped in an effectiveness claim its own data cannot support. read the letter →

arxiv 2506.00105 v1 pith:XMTZ53LW submitted 2025-05-30 cs.CY

Luis Costero , Jorge Villarrubia , Francisco D. Igual This is my paper
classification cs.CY
keywords Bashgamificationprogrammingcontestsautomaticgradingcommand-lineskillscomputerscienceeducationSSHstudentmotivation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper sets out to show that a programming contest built around Bash can motivate students to learn a skill that, it argues, degree programs largely leave out. The authors built a competition in which students connect to a real GNU/Linux server over SSH and solve Bash scripting problems that unlock one by one, graded automatically on hidden test cases, with a hint system and a live ranking. Of the 36 participants across the two editions, 26 answered the questionnaires; 85% said the activity was useful for improving their Bash knowledge and 71% said they need deeper Bash training for their academic and professional future. The paper concludes that gamification through contests is an effective didactic strategy for fostering Bash learning, and that this format complements formal coursework that does not teach shell scripting. The authors also report that the most-cited stated reason for entering was academic recognition, ahead of curiosity about Bash itself.

What carries the argument

The load-bearing mechanism is the contest system itself: a Debian GNU/Linux server that contestants reach through SSH, forcing every exercise to be done with the system's own tools and no abstraction layer. Around that environment the paper wraps four game elements — problems that appear only after the previous one passes a set of hidden tests, automatic evaluation of each submitted script, a hint service that deducts points, and a public real-time leaderboard ordered by problems solved and then by time, penalized for failed attempts and hints. The interplay of those elements is what is supposed to do the teaching: sequential unlocking routes novices through the basics, immediate grading gives feedback, and the ranking converts studying into competition.

What would settle it

A controlled edition of the contest that measures Bash skill before and after — for instance, asking every entrant to write a script that filters a login log and aggregates failed attempts, as in the paper's own sample problem, and comparing gains against a group given only the reference sheet — would settle the effectiveness claim; if contest participants show no measurable improvement over the comparison group, the conclusion fails.

Watch

Extended reading notes

Core claim

The central claim is that competition is a workable vehicle for Bash education: with the right scaffolding, command-line practice becomes something students do persistently and report enjoying. The authors describe a system consisting of a Debian server reachable only over SSH, where each correct solution to a hidden-tested Bash script automatically unlocks the next, harder problem, and they point to a roughly bell-shaped distribution of solved problems as evidence of a balanced difficulty curve. Their survey data show 85% of 26 respondents judging the activity useful and 71% asking for deeper Bash training, and their contest logs show little difference in performance between students with one Linux course and students with two, which they read as confirming that advanced Bash sits outside the formal syllabus. On these grounds the authors assert that gamification through contests is an effective didactic strategy for learning Bash in academic settings, while naming pre-contest documentation as the main area to improve.

Load-bearing premise

The paper's conclusion rests on students' self-reported survey answers as a proxy for actual learning and motivation: there is no control group, no pre/post test of Bash skill, and the most-cited reason for entering was the grade bonus, so favorable ratings could reflect reward-seeking rather than real command-line proficiency.

Editorial extensions

If this is right

  • Because problems and grading are stored as files and automated checks, the authors state the system can absorb new challenges in later editions without rebuilding the infrastructure, so the format is reusable across courses and years.
  • If the central claim is right, faculty can add Bash practice to operating-systems and systems-administration courses as a self-graded contest component rather than new lecture hours; the paper shows one anchor by linking performance to a grade bonus worth up to 0.8 final points.
  • The similar performance of third-, fourth-, and fifth-year students implies that the contest covers advanced Bash not present in the degree plan, making it a complement to, rather than a duplicate of, formal teaching.
  • The approximately normal distribution of solved problems, with one problem marking a clear difficulty barrier, suggests the progressive-unlock design keeps the contest challenging for experts while letting novices consolidate basics before advancing.
  • The absence of first- and second-year students — tied by the authors to Bash first appearing at third year and to grade incentives applying only to later years — indicates that participation depends on prior curricular exposure as much as on the contest design itself.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same SSH-based, progressive-unlock format could be transplanted to other under-taught command-line competencies, such as text processing with awk and sed, version control with git, or remote server administration, since the design choice that distinguishes this contest is its refusal to abstract away the real environment.
  • The paper leaves it open whether the gamification or the grade bonus drives participation; running a future edition without any grade incentive, with the same surveys, would separate intrinsic motivation from extrinsic reward.
  • A testable extension: add a standardized pre/post Bash task — for example, scripting a filtered log summary of the kind shown in the paper's sample problem — so later editions can measure learning gains directly instead of relying on self-reported usefulness.
  • The fact that academic recognition was the most common stated motive suggests that the contest's pull may be its link to graded coursework rather than the game elements, in which case the leaderboard and hints matter less than official recognition.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 7 minor

Summary. This paper presents an interactive Bash programming contest for university students, implemented on a Debian server accessed by SSH, with hidden-test automatic grading, progressive unlocking of problems, a hint system with score penalties, and a real-time leaderboard. The authors report two editions (2023-2024: 9 participants; 2024-2025: 27 participants; 36 total, with 26 responding to surveys). Survey results are reported: 85% of respondents found the activity useful and 71% expressed a need for deeper Bash training. The paper concludes that gamification through contests constitutes an effective didactic strategy for fostering Bash learning. The manuscript describes the system design, problem set, and presents an analysis of contest logs and student surveys.

Significance. The system itself is a concrete and lightweight infrastructure: a real Linux environment over SSH, automated hidden-test evaluation, progressive difficulty, hints, and a leaderboard. These design choices are sensible and documented in enough detail to be reproducible, and the contest logs provide objective traces of attempts, hints, and solved problems. This part of the contribution is valuable as a teaching experience report. However, the effectiveness claim is much weaker than the evidence: small self-selected samples, post-only attitude surveys, and grade incentives preclude a causal interpretation. The paper should be reframed as a descriptive case study of a teaching intervention, not as a controlled evaluation of learning outcomes. Credit is due for the clearly described system design and for making the contest logs an explicit part of the analysis.

major comments (4)
  1. [Section VI] The concluding sentence, "la gamificación mediante concursos constituye una estrategia didáctica eficaz para fomentar el aprendizaje de Bash," is not supported by the evidence presented. Section V-C relies on post-contest self-reports (questions B1, B3) and on contest logs from Section V-A. There is no pre/post measure of Bash proficiency, no control group, and no comparison with non-gamified instruction. Contest performance (problems solved, attempts, hints) measures task performance under contest conditions, not skill acquisition; a participant may already know Bash and solve problems without learning, or may struggle and learn a great deal while solving few problems. The conclusion must be weakened to state that students perceived the activity as useful, or that the contest is a promising tool whose learning effects remain to be measured.
  2. [Sections IV and V-B] The grade-incentive confound is acknowledged but not reflected in the conclusions. Section IV states that participants in SO/ASOR could receive up to 0.8 extra final-grade points, and Section V-B reports that 10 of 26 respondents chose "Obtener reconocimiento académico" as their main motivation, with only 5 choosing "Aprender más sobre Bash." Under this design, positive survey responses and high participation are equally consistent with the contest fostering genuine interest and skill as with grade incentives and self-selection generating favorable responses. The paper needs an explicit limitations paragraph that names this confound and explains why the effectiveness conclusion cannot be inferred from the current data.
  3. [Section V-A] The claim that the number of participants remaining per problem "siguen una distribución normal" is asserted without statistical support. No normality test is reported, and with 9 or 27 participants per edition, visual inspection of Figure 2a is insufficient to establish a normal distribution. Moreover, even a normal-shaped drop-off would not "confirma un equilibrio adecuado en la dificultad," because no criterion links the shape of the curve to appropriate difficulty. This inference is used to validate the difficulty calibration, so it should either be supported with an appropriate item-analysis (e.g., difficulty and discrimination indices) or removed.
  4. [Section V-A] The comparison between third-year and fourth/fifth-year students overinterprets a null difference: "No se observa una gran diferencia... Esto sugiere que usos avanzados de Bash... no están incluidos en el plan docente, lo que corrobora la utilidad del concurso." In a small, self-selected sample, equal performance could also arise from ceiling effects or from the fact that all participants are equally motivated by the same grade incentives. This claim should be rephrased as a tentative hypothesis rather than corroboration of the contest's utility.
minor comments (7)
  1. [Abstract and Section VI] The phrases "estrategia efectiva" and "estrategia didáctica eficaz" are unhedged; please qualify them as "según la percepción de los participantes" or use "potencialmente eficaz" given the self-report nature of the evidence.
  2. [Section IV] The text reports that 26 of 36 participants responded to the surveys, but it does not clarify how many answered the pre- and post-questionnaires separately; please provide response counts per questionnaire to make the analysis transparent.
  3. [Section V-A] The captions of Figure 2 do not fully explain the bars; please state explicitly what each bar represents (e.g., number of participants who solved each problem, total attempts, total hints) and include the number of participants per edition.
  4. [Listing 1] The formatting of the example problem statement is garbled, with run-together hyphens and missing line breaks; using a verbatim or code environment would improve readability.
  5. [Throughout] There are several typos: "ejecuci´on descriptso" in Section I should be "de scripts," "recogia" should be "recogida," and "automzatizaci´on" in reference [18] should be "automatización."
  6. [References] Reference [5] is to an arXiv preprint but lacks a version number or year in the citation text; reference [12] also lacks a year. Please complete these entries.
  7. [Section IV] The sentence "Un total de 34 alumnos participantes se encontraban matriculado en alguna de estas asignaturas" uses "matriculado" instead of "matriculados"; a grammar check throughout the manuscript would be helpful.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity; the educational-claims chain is empirical, not derived from its own inputs.

full rationale

The paper is an experience report describing a Bash contest and its evaluation; it contains no equations, fitted parameters, or derived quantities whose outputs are predefined by inputs. The central conclusion (Section VI) that gamified contests are an effective didactic strategy is supported by contest logs (attempts, correct submissions, hints) in Section V-A and by pre- and post-contest surveys in Sections V-B and V-C. These are external observations about participants, not quantities constructed from the conclusion itself. The main weakness, namely that learning effectiveness is inferred from post-only self-reports and from participation that is partly grade-incentive-confounded, is an evidence-quality and internal-validity concern rather than a circularity: the survey answers are not defined in terms of the paper's effectiveness claim, nor does the paper fit a parameter and then rename it as a prediction. The external citations (e.g., [3]-[5]) are used as background motivation and are not load-bearing in the derivation of the present results, and no self-citation chain appears. Because no step reduces by definition, by fitted-input renaming, or by a load-bearing self-citation, no circular step can be exhibited and the appropriate score is 0.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

No fitted parameters or invented entities. The central claim rests on participant self-reports and the implicit assumptions listed, especially that survey answers reflect learning and that grade incentives did not bias outcomes.

assumptions (3)
  • domain assumption Survey self-reports are a valid proxy for learning and motivation.
    The central effectiveness claim is based on Likert responses (A2, B1) rather than a measured skill change.
  • domain assumption Grade incentives and self-selection did not materially bias reported outcomes.
    Section V-B shows the most common motivation was academic recognition, which directly threatens this assumption.
  • domain assumption The sample of 26 respondents is representative of the target population.
    No comparison with non-respondents, no power analysis, and only two small editions are available.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Motivando el uso y aprendizaje de Bash a trav\'es de concursos de programaci\'on." pith.science (2026). https://pith.science/paper/XMTZ53LW

@misc{pith2026250600105,
  author       = {Pith},
  title        = {Pith review of: Motivando el uso y aprendizaje de Bash a trav\'es de concursos de programaci\'on},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/XMTZ53LW}},
  note         = {Machine review of arXiv:2506.00105}
}
read the original abstract

Command line learning and Bash usage are fundamental skills in systems administration, software development, and data science environments. However, their teaching has been neglected in many curricula, despite its relevance in the professional field. To address this gap, we developed an interactive competition that encourages students to improve their Bash skills through practical and competitive challenges. This gamified approach seeks to motivate autonomous learning and reinforce command line proficiency in a dynamic context. The results have been promising: of the 26 participating students, 85% considered the activity useful to improve their knowledge, and 71% expressed the need to delve deeper into Bash for their academic and professional future. These findings suggest that such initiatives may be an effective strategy to foster Bash learning in academic settings.

Figures

Figures reproduced from arXiv: 2506.00105 by the authors.

Figure 1
Figure 1. Esquema general del sistema propuesto [PITH_FULL_IMAGE:figures/full_fig_p005_1.png] view at source ↗
Figure 2
Figure 2. Resultados anal´ıticos del concurso e informaci´on detallada por curso matriculado. [PITH_FULL_IMAGE:figures/full_fig_p007_2.png] view at source ↗

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

21 extracted references · 21 canonical work pages

  1. [1]

    What! No GUI?–Teaching a Text Ba- sed Command Line Oriented Introduction to Computer Science Course,

    Ira Goldstein, “What! No GUI?–Teaching a Text Ba- sed Command Line Oriented Introduction to Computer Science Course,”Information Systems Education Jour- nal, vol. 17, no. 1, pp. 40–48, 2019

    work page 2019

  2. [2]

    Teaching advanced Bash scripting using semi-automated assessment environment,

    Victoria Plemakova, “Teaching advanced Bash scripting using semi-automated assessment environment,” M.S. thesis, University of Tartu. Institute of Computer Scien- ce, 2016

    work page 2016

  3. [3]

    Gamifying Computer Science Education for Z Generation,

    Hadeel Mohammed Jawad and Samir Tout, “Gamifying Computer Science Education for Z Generation,”Infor- mation, vol. 12, no. 11, 2021

    work page 2021

  4. [4]

    The use of programming contests + positive feedback to inspi- re computer science students to improve their problem- solving skills,

    L.H. Gonz´ alez Guerra and V.M. de la Cueva, “The use of programming contests + positive feedback to inspi- re computer science students to improve their problem- solving skills,” inICERI2023 Proceedings, 2023, pp. 3393–3400

    work page 2023

  5. [5]

    Students Programming Competitions as an Educational Tool and a Motivational Incentive to Students

    Youry Khmelevsky and Ken Chidlow, “Students Pro- gramming Competitions as an Educational Tool and a Motivational Incentive to Students” 2021,https: //arxiv.org/abs/2105.15136

    work page Pith review arXiv 2021

  6. [6]

    From game design elements to gamefulness: defining

    Sebastian Deterding, Dan Dixon, Rilla Khaled, and Len- nart Nacke, “From game design elements to gamefulness: defining”gamification”,” inProceedings of the 15th in- ternational academic MindTrek conference: Envisioning future media environments, 2011, pp. 9–15

    work page 2011

  7. [7]

    Gamifi- cation in mobile-assisted language learning: a systematic review of Duolingo literature from public release of 2012 to early 2020,

    Mitchell Shortt, Shantanu Tilak, Irina Kuznetcova, Bethany Martens, and Babatunde Akinkuolie, “Gamifi- cation in mobile-assisted language learning: a systematic review of Duolingo literature from public release of 2012 to early 2020,”Computer Assisted Language Learning, vol. 36, no. 3, pp. 517–554, 2023

    work page 2012

  8. [8]

    The effect of using Kahoot! for learning–A literature review,

    Alf Inge Wang and Rabail Tahir, “The effect of using Kahoot! for learning–A literature review,”Computers & Education, vol. 149, pp. 103818, 2020

    work page 2020

Show all 21 references
  1. [9]

    Competitive learning in informatics: The UVa online judge experience,

    Miguel A Revilla, Shahriar Manzoor, and Rujia Liu, “Competitive learning in informatics: The UVa online judge experience,”Olympiads in informatics, vol. 2, no. 10, pp. 131–148, 2008

    2008

  2. [10]

    Codeforces as an educatio- nal platform for learning programming in digitalization,

    Mike Mirzayanov, Oksana Pavlova, Pavel MA VRIN, Ro- man Melnikov, Andrew Plotnikov, Vladimir Parfenov, and Andrew Stankevich, “Codeforces as an educatio- nal platform for learning programming in digitalization,” Olympiads in Informatics, vol. 14, no. 133-142, pp. 14, 2020

    2020

  3. [11]

    Five years with kattis — Using an automated assessment system in teaching,

    Emma Enstr¨ om, Gunnar Kreitz, Fredrik Niemel¨ a, Pehr S¨ oderman, and Viggo Kann, “Five years with kattis — Using an automated assessment system in teaching,” in 2011 Frontiers in Education Conference (FIE), 2011, pp. T3J–1–T3J–6

    2011

  4. [12]

    ¡Acepta el reto!: juez online para docencia en espa˜ nol,

    Pedro Pablo G´ omez-Mart ´ ın and Marco Antonio G´ omez- Mart ´ ın, “¡Acepta el reto!: juez online para docencia en espa˜ nol,” 2017,https://aceptaelreto.com

    2017

  5. [13]

    ICPC Southwestern Europe Regional Contest (SWERC)

    “ICPC Southwestern Europe Regional Contest (SWERC)”https://swerc.eu/2025/

    2025

  6. [14]

    Concurso Universitario de Programaci´ on AdaByron

    “Concurso Universitario de Programaci´ on AdaByron” https://ada-byron.es/2025/

    2025

  7. [15]

    Concurso de programaci´ on para Ciclos Formativos: Pro- gramaMe

    “Concurso de programaci´ on para Ciclos Formativos: Pro- gramaMe”https://programame.com/2025/reg/

    2025

  8. [16]

    Olimpiada Inform´ atica Espa˜ nola (OIE)

    “Olimpiada Inform´ atica Espa˜ nola (OIE)”https:// olimpiada-informatica.org/

  9. [17]

    Mooshak: a Web- based multi-site programming contest system,

    Jos´ e Paulo Leal and Fernando Silva, “Mooshak: a Web- based multi-site programming contest system,”Software: Practice and Experience, vol. 33, no. 6, pp. 567–581, 2003

    2003

  10. [18]

    Sistema de automzatizaci´ on para concursos de progra- maci´ on DOMjudge

    “Sistema de automzatizaci´ on para concursos de progra- maci´ on DOMjudge”https://www.domjudge.org/

  11. [19]

    Concurso de programaci´ on paralela de la Sociedad de Arquitectura y Tecnolog ´ ıa de Computadores (SARTE- CO)

    “Concurso de programaci´ on paralela de la Sociedad de Arquitectura y Tecnolog ´ ıa de Computadores (SARTE- CO)”http://luna.inf.um.es/2018/

    2018

  12. [20]

    Web de retos en Bash CMD Challenge

    “Web de retos en Bash CMD Challenge”https:// cmdchallenge.com/

  13. [21]

    Itinerio de aprendizaje Bash de la web Exercism

    “Itinerio de aprendizaje Bash de la web Exercism”https: //exercism.org/tracks/bash

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.