pith. sign in

arxiv: 2604.17638 · v1 · submitted 2026-04-19 · 💻 cs.HC · cs.CY

Replay, Revise, and Refresh: Smartphone-based Refresher Training for Community Healthcare Workers in India

Arka Majhi , Aparajita Mondal , Satish B. Agnihotri This is my paper

Pith reviewed 2026-05-10 04:56 UTC · model grok-4.3

classification 💻 cs.HC cs.CY
keywords community health workersrefresher trainingsmartphone gamesknowledge gainknowledge retentionimmunizationdigital healthIndia
0
0 comments X

The pith

Smartphone games produce larger immediate knowledge gains than physical cards for Indian community health workers, though six-month retention is similar.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper tests smartphone games as a scalable refresher tool for community healthcare workers who provide frontline care to mothers and children in India. It compares three equal groups of 90 workers each: standard classroom training, physical card games, and smartphone games, using repeated 45-question tests on immunization knowledge. All three methods raised scores significantly, but the smartphone version produced a larger pre-to-post gain than the physical cards. Retention after six months did not differ significantly between the two game formats.

Core claim

The study shows that pre-post knowledge increments were significantly higher in the smartphone game group than in the physical card game group, while knowledge retained after six months was statistically similar between the digital and physical game versions, and all groups improved over the classroom baseline.

What carries the argument

A three-arm comparison of classroom instruction, physical card games, and smartphone games as refresher interventions on immunization topics, measured by shuffled 45-question questionnaires at pre, post, and six-month points.

If this is right

  • Smartphone games deliver stronger short-term learning gains than physical cards for the same content.
  • Both game formats produce comparable retention after six months, outperforming one-time classroom sessions in sustaining knowledge.
  • Digital versions support scaling to large numbers of workers without printing or distributing physical materials.
  • Short, repeatable game sessions can address the poor retention typical of traditional training methods.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The format could be extended to other health topics such as nutrition or maternal care with similar gains.
  • Pairing games with periodic mobile reminders might further improve long-term retention beyond six months.
  • Integration into existing government health apps could personalize training based on individual performance data.

Load-bearing premise

The three groups began with equivalent baseline knowledge and motivation, the interventions were delivered without contamination, and the questionnaire accurately captured real knowledge changes without bias or ceiling effects.

What would settle it

A follow-up study that finds no significant difference in pre-to-post score gains between the smartphone and physical card groups after controlling for baselines.

Figures

Figures reproduced from arXiv: 2604.17638 by Aparajita Mondal, Arka Majhi, Satish B. Agnihotri.

Figure 1
Figure 1. Figure 1: Physical card Decks 2.2 Participants The sample size was calculated using G-Power [5]. T-test with independent means was chosen as the statistical test (d=0.5, 1-β=0.95, and α=0.05). The re￾quired sample or number of participants for each group was calculated to be 88. Considering attrition, 95 were recruited for each group. However, post-attrition, 90 participants from each group were retained till the en… view at source ↗
Figure 2
Figure 2. Figure 2: Left: Photo of CHW holding her smartphone during gameplay session; [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Line chart showing trends of change of mean value in the pre-test, post [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
read the original abstract

In India, community healthcare workers are the primary touchpoints between the state and the beneficiaries, such as pregnant mothers and children. Their healthcare knowledge directly impacts the quality of care they provide through home visits and community activities. Classroom in-person or traditional ways of training are found ineffective in imparting knowledge and render poor knowledge retention, which needs reinforcements through short, frequent revisions. Smartphone games on healthcare topics could be a promising solution as a refresher, as they can be scaled and tailored as per players' requirements. This study aims to check the differences in knowledge gain, pre and post-intervention, and, secondly, to check knowledge retention after six months. 270 CHWs or participants were recruited to evaluate different modes of refresher training and assigned into three equal groups of 90 each. The control group (CG) (n=90) was trained using the standard classroom method, which is usually followed. Intervention Group-1 (IG1)(n=90) was trained in a physical card game format, and Intervention Group-2 (IG2)(n=90) was trained in a smartphone game format. 4 sets of questionnaires were made by shuffling 45 questions based on immunization of equal weightage. The questionnaires were filled out by CHWs by hand and collected, evaluated, and analyzed. Paired t-tests were conducted to compare pre-post knowledge increments and repeated measure ANOVA to check for differences in knowledge retention. Results suggest a significant difference in scores in all three groups. A significant difference was observed between the physical and digital gameplay modes. Pre-post knowledge increment was higher in the digital mode (p<0.05), but knowledge retained was not significantly different (p=.4) in digital and physical card versions.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

3 major / 2 minor

Summary. The manuscript describes an intervention study with 270 community healthcare workers (CHWs) in India assigned to three equal-sized groups (n=90 each): standard classroom training (control), physical card-game refresher, and smartphone-game refresher. Using four shuffled versions of a 45-question immunization knowledge test, the authors report significant pre-post score increases in all groups via paired t-tests, a statistically larger gain in the digital arm versus the physical-card arm (p<0.05), and no significant difference in 6-month retention via repeated-measures ANOVA (p=0.4).

Significance. If the methodological gaps are closed, the work could provide useful evidence on scalable digital refresher formats for CHW training in low-resource settings, where frequent short interventions are needed to maintain immunization knowledge. The inclusion of a retention arm and the large sample are positive features; however, the absence of baseline data, instrument validation, and analytic details currently prevents confident attribution of the reported p<0.05 gain difference to the digital mode.

major comments (3)
  1. [Abstract] Abstract: no pre-intervention means, SDs, or baseline-equivalence tests are reported despite the central claim that digital mode produced a larger knowledge increment. Without these, gain-score differences cannot be interpreted as intervention effects rather than pre-existing group differences.
  2. [Abstract] Abstract and Methods: the 45-question immunization instrument is described only as “shuffled” into four sets of equal weight; no information is supplied on item development, pilot testing, reliability (e.g., internal consistency), validity, or checks for ceiling effects or response bias. These psychometric properties are load-bearing for any claim that score changes reflect true knowledge change.
  3. [Abstract] Abstract: the assignment procedure, randomization method, allocation concealment, sample-size justification, and handling of missing data are not described. The reported p-values from paired t-tests and repeated-measures ANOVA therefore rest on unverified assumptions about group comparability and data integrity.
minor comments (2)
  1. [Abstract] Clarify the exact timing of the pre-test relative to the intervention and whether the same questionnaire version was used for pre- and post-testing within participants.
  2. [Abstract] Provide effect sizes (e.g., Cohen’s d) alongside the p-values to allow assessment of practical significance of the digital versus physical gain difference.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for the constructive comments identifying areas where additional reporting will strengthen the manuscript. We will revise to provide the requested details on baseline statistics, instrument characteristics, and study procedures while remaining faithful to the data collected.

read point-by-point responses

  1. Referee: [Abstract] Abstract: no pre-intervention means, SDs, or baseline-equivalence tests are reported despite the central claim that digital mode produced a larger knowledge increment. Without these, gain-score differences cannot be interpreted as intervention effects rather than pre-existing group differences.

    Authors: We agree that pre-intervention means, SDs, and baseline-equivalence tests are required to support interpretation of the gain scores. Pre-test data were collected for all 270 participants. In the revision we will add these descriptive statistics to the abstract and results, together with the outcome of a one-way ANOVA confirming no significant baseline differences across groups. revision: yes

  2. Referee: [Abstract] Abstract and Methods: the 45-question immunization instrument is described only as “shuffled” into four sets of equal weight; no information is supplied on item development, pilot testing, reliability (e.g., internal consistency), validity, or checks for ceiling effects or response bias. These psychometric properties are load-bearing for any claim that score changes reflect true knowledge change.

    Authors: The 45 items were drawn directly from the standard National Immunization Schedule training materials used by the Indian Ministry of Health. We did not perform formal pilot testing or compute reliability coefficients for this study. We will expand the methods section to state the source of the items, note the absence of dedicated validation, and report any post-hoc checks (e.g., item difficulty, ceiling effects) that can be derived from the collected responses. We will also list the lack of formal psychometric validation as a limitation. revision: partial

  3. Referee: [Abstract] Abstract: the assignment procedure, randomization method, allocation concealment, sample-size justification, and handling of missing data are not described. The reported p-values from paired t-tests and repeated-measures ANOVA therefore rest on unverified assumptions about group comparability and data integrity.

    Authors: Participants were assigned to the three arms by simple randomization using a computer-generated sequence; allocation was concealed until the day of the intervention. The target of 90 participants per arm was based on prior CHW training studies to detect a moderate effect size with 80 % power. Follow-up data were missing for fewer than 5 % of participants and were handled by complete-case analysis. We will insert a dedicated paragraph in the methods section describing these procedures. revision: yes

Circularity Check

0 steps flagged

No circularity: purely empirical study with direct measurements and standard statistics

full rationale

The paper describes a field intervention with three groups of CHWs, pre/post questionnaires, and retention follow-up. It applies paired t-tests for pre-post increments and repeated-measures ANOVA for retention, reporting p-values directly from the data. No equations, fitted parameters, ansatzes, or derivations appear. No self-citations are invoked to justify uniqueness, uniqueness theorems, or rescalings. The central claims rest on observed score differences rather than any reduction to inputs by construction. This is the expected non-circular outcome for an empirical evaluation study.

Axiom & Free-Parameter Ledger

0 free parameters · 2 axioms · 0 invented entities

The central claim rests on the validity of the knowledge questionnaire, proper randomization and group equivalence, and the assumptions underlying the chosen statistical tests rather than new theoretical constructs or invented entities.

axioms (2)
  • domain assumption Paired t-test and repeated-measures ANOVA assumptions (normality, independence, sphericity) hold for the score data
    Invoked implicitly by the choice of statistical tests to compare pre-post increments and retention across groups.
  • domain assumption The 45-question immunization questionnaire accurately measures relevant CHW knowledge without substantial measurement error or bias
    Required for interpreting score changes as true knowledge gain and retention.

pith-pipeline@v0.9.0 · 5633 in / 1462 out tokens · 48143 ms · 2026-05-10T04:56:57.248338+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

30 extracted references · 30 canonical work pages

  1. [1]

    International Journal Of Community Medicine And Public Health4(7), 2604 (2017).https://doi.org/10.18203/2394-6040

    Bag, S., Datta, M.: Evaluation of mother and child protection card entries in a rural area of West Bengal. International Journal Of Community Medicine And Public Health4(7), 2604 (2017).https://doi.org/10.18203/2394-6040. ijcmph20172867

    work page doi:10.18203/2394-6040 2017

  2. [2]

    Bashingwa, J.J.H., et.al.: Examining the reach and exposure of a mobile phone- based training programme for frontline health workers (ASHAs) in 13 states across India (8 2021).https://doi.org/10.1136/bmjgh-2021-005299

    work page doi:10.1136/bmjgh-2021-005299 2021

  3. [3]

    PLOS Global Public Health2(8), e0000756 (8 2022)

    Burger, O., et.al.: Facilitating behavioral change: A comparative assessment of ASHA efficacy in rural Bihar. PLOS Global Public Health2(8), e0000756 (8 2022). https://doi.org/10.1371/journal.pgph.0000756

    work page doi:10.1371/journal.pgph.0000756 2022

  4. [4]

    J Health Popul Nutr (2015)

    Farah, N.F., Mohan, R., Kiruba, S.V., Aditi, K., S, R.A., Prem, K.M.: Assessment of ‘Accredited Social Health Activists’—A National Community Health Volunteer Scheme in Karnataka State, India. J Health Popul Nutr (2015)

    work page 2015

  5. [5]

    In: Be- havior Research Methods

    Faul, F., Erdfelder, E., Lang, A.G., Buchner, A.: G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. In: Be- havior Research Methods. vol. 39 (2007).https://doi.org/10.3758/BF03193146

    work page doi:10.3758/bf03193146 2007

  6. [6]

    Gopalan, S.S., Varatharajan, D.: Addressing maternal healthcare through demand side financial incentives: experience of Janani Suraksha Yojana program in India. Tech. rep., The World Bank, Washington, DC 20433, USA (2012),http://www. biomedcentral.com/1472-6963/12/319

    work page 2012

  7. [7]

    Harris and et.al

    Harris, A.D., et.al.: The use and interpretation of quasi-experimental studies in medical informatics. Journal of the American Medical Informatics Association 13(1), 16–23 (1 2006).https://doi.org/10.1197/jamia.M1749

    work page doi:10.1197/jamia.m1749 2006

  8. [8]

    Haynie, W.J.: Effects of Multiple-Choice and Short-Answer Tests on Delayed Re- tention Learning. Tech. Rep. 1, Department of Occupational Education, North Carolina State University, Raleigh, NC (1994)

    work page 1994

  9. [9]

    IIT Bombay: Institutional Review Board, IIT Bombay, India (5 2020),https: //rnd.iitb.ac.in/institute_review_board

    work page 2020

  10. [10]

    Indian Institute Population Sciences and Ministry of Health and Family Welfare (2016),http://rchiips

    Indian Institute Population Sciences and Ministry of Health and Family Welfare: National Family Health Survey-4 India Fact Sheet. Indian Institute Population Sciences and Ministry of Health and Family Welfare (2016),http://rchiips. org/NFHS/NFHS-4Reports/India.pdf

    work page 2016

  11. [11]

    Indian Institute Population Sciences and Ministry of Health and Family Welfare (2021),http://rchiips

    Indian Institute Population Sciences and Ministry of Health and Family Welfare: National Family Health Survey-5 India Fact Sheet. Indian Institute Population Sciences and Ministry of Health and Family Welfare (2021),http://rchiips. org/nfhs/factsheet_NFHS-5.shtml

    work page 2021

  12. [12]

    In: ACM International Conference Proceed- ing Series

    Javaid, M., Fatima, B., Batool, A.: Bridging the knowledge gaps in lady health visi- tors through video based learning tool. In: ACM International Conference Proceed- ing Series. vol. Part F1320 (2017).https://doi.org/10.1145/3136560.3136603

    work page doi:10.1145/3136560.3136603 2017

  13. [13]

    and Shivananda, S

    Kasi, S.G., et.al.: Indian Academy of Pediatrics (IAP) Advisory Committee on Vac- cines and Immunization Practices (ACVIP): Recommended Immunization Sched- ule (2020–21) and Update on Immunization for Children Aged 0 Through 18 Years. Indian Pediatrics58(1) (2021).https://doi.org/10.1007/s13312-021-2096-7

    work page doi:10.1007/s13312-021-2096-7 2020

  14. [14]

    International Journal Of Commu- nity Medicine And Public Health6(8), 3594 (2019).https://doi.org/10.18203/ 2394-6040.ijcmph20193494

    Kizhatil, A., ., R., Hariharan, H.C., John, A., Thomas, A.M., Padmanabhan, G.: Assessment of immunization coverage and associated factors among children in Paravur Taluk of Ernakulam district, Kerala. International Journal Of Commu- nity Medicine And Public Health6(8), 3594 (2019).https://doi.org/10.18203/ 2394-6040.ijcmph20193494

    work page 2019

  15. [15]

    Kumar,N.,Anderson,R.:MobilephonesformaternalhealthinruralIndia.Confer- ence on Human Factors in Computing Systems - Proceedings2015-April, 427–436 (2015).https://doi.org/10.1145/2702123.2702258

    work page doi:10.1145/2702123.2702258 2015

  16. [16]

    In: ACM International Conference Proceeding Series

    Kumar, N., et.al.: Projecting Health: Community-Led Video Education for Mater- nal Health. In: ACM International Conference Proceeding Series. vol. 15 (2015). https://doi.org/10.1145/2737856.2738023

    work page doi:10.1145/2737856.2738023 2015

  17. [17]

    2013 , booktitle =

    Kumar, N., Rangaswamy, N.: The mobile media actor-network in urban India. In: Conference on Human Factors in Computing Systems - Proceedings. pp. 1989–1998 (2013).https://doi.org/10.1145/2470654.2466263

    work page doi:10.1145/2470654.2466263 1989

  18. [18]

    In: Con- ference on Human Factors in Computing Systems - Proceedings (2022).https: //doi.org/10.1145/3516492.3558788

    Majhi, A., Agnihotri, S., Mondal, A.: Physical and Augmented Reality based Playful Activities for Refresher Training of ASHA Workers in India. In: Con- ference on Human Factors in Computing Systems - Proceedings (2022).https: //doi.org/10.1145/3516492.3558788

    work page doi:10.1145/3516492.3558788 2022

  19. [19]

    Agnihotri, and Aparajita Mondal

    Majhi, A., Joshi, A., Agnihotri, S.B., Mondal, A.: Refresher Training through Quiz App for capacity building of Community Healthcare Workers or Anganwadi Workers in India. In: 5th Asian CHI Symposium 2021 (2021).https://doi.org/ 10.1145/3429360.3468186

    work page doi:10.1145/3429360.3468186 2021

  20. [20]

    Nungester, R.J., Duchastel, P.C.: Testing Versus Review: Effects on Retention. Tech. Rep. 1, The American College (1982)

    work page 1982

  21. [21]

    and Singh, S

    Ramachandran, D., Canny, J., Das, P.D., Cutrell, E.: Mobile-izing health workers in rural India. Conference on Human Factors in Computing Systems - Proceedings 3, 1889–1898 (2010).https://doi.org/10.1145/1753326.1753610

    work page doi:10.1145/1753326.1753610 2010

  22. [22]

    Shah, Pawan A

    Shah, M.P., Kamble, P.A., Agnihotri, S.B.: Tackling child malnutrition: An inno- vative approach for training health workers using ICT: A pilot study. In: IEEE Region 10 Humanitarian Technology Conference 2016, R10-HTC 2016 - Proceed- ings (2017).https://doi.org/10.1109/R10-HTC.2016.7906811

    work page doi:10.1109/r10-htc.2016.7906811 2016

  23. [23]

    Telecom Regulatory Authority of India: TRAI Press Release No.03/2024. Tech. rep., TRAI (2024),https://www.trai.gov.in/sites/default/files/PR_ No.03of2024_0.pdf

    work page 2024

  24. [24]

    2020 , journal =

    Tulaskar, R.: Study of Instructional Illustrations on ICTs: Considering persona of low-literate users from India. ACM International Conference Proceeding Series pp. 53–56 (2020).https://doi.org/10.1145/3391203.3391217

    work page doi:10.1145/3391203.3391217 2020

  25. [25]

    Proceedings of the ACM on Human-Computer Interaction 5(CSCW1) (4 2021).https://doi.org/10.1145/3449165

    Verdezoto, N., Bagalkot, N., Akbar, S.Z., Sharma, S., MacKintosh, N., Harrington, D., Griffiths, P.: The Invisible Work of Maintenance in Community Health: Chal- lenges and Opportunities for Digital Health to Support Frontline Health Workers in Karnataka, South India. Proceedings of the ACM on Human-Computer Interaction 5(CSCW1) (4 2021).https://doi.org/1...

    work page doi:10.1145/3449165 2021

  26. [26]

    Ward and et.al

    Ward, V.C., et.al.: Impact Of Mhealth Interventions for Reproductive, Maternal, Newborn and Child Health and Nutrition at Scale: Bbc Media Action and The Ananya Program in Bihar, India. Journal of Global Health10(2) (2020).https: //doi.org/10.7189/jogh.10.021005

    work page doi:10.7189/jogh.10.021005 2020

  27. [27]

    WMA: World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects (2013).https://doi.org/10.1001/ jama.2013.281053

    work page arXiv 2013

  28. [28]

    Proceedings of the ACM on Human-Computer Interaction3(CSCW) (2019).https://doi.org/10.1145/3359271

    Yadav, D., Bhandari, A., Singh, P.: LEAP: Scaffolding collaborative learning of community health workers in India. Proceedings of the ACM on Human-Computer Interaction3(CSCW) (2019).https://doi.org/10.1145/3359271

    work page doi:10.1145/3359271 2019

  29. [29]

    In: 26th International World Wide Web Conference, WWW 2017 (2017).https://doi.org/10.1145/3038912.3052624

    Yadav, D., et.al.: Sangoshthi: Empowering community health workers through peer learning in rural India. In: 26th International World Wide Web Conference, WWW 2017 (2017).https://doi.org/10.1145/3038912.3052624

    work page doi:10.1145/3038912.3052624 2017

  30. [30]

    I mainly ask my mom. . . I will only trust the information if she says it’s correct

    Yadav, D., et.al.: FeedPal: Understanding opportunities for chatbots in breastfeed- ing education of women in India. Proceedings of the ACM on Human-Computer Interaction3(CSCW) (2019).https://doi.org/10.1145/3359272

    work page doi:10.1145/3359272 2019