Pith. sign in

REVIEW 3 major objections 6 minor 32 references

The Adoption of Robotics by Government Agencies: Evidence from Crime Labs

T0 review · 3 major / 6 minor · reviewed 2026-08-14 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This paper claims that American crime laboratories adopt robotics for the same traditional reasons any public agency expands capacity: larger budgets, heavier caseloads, and stronger professional accreditation, with outsourcing mattering…

desk verdict Useful descriptive benchmark for an understudied topic, but the main associations probably just reflect that DNA labs are the ones using robotics. read the letter →

arxiv 1908.06164 v1 pith:QSR6FEGE submitted 2019-08-08 cs.CY

Andrew B. Whitford , Jeff Yates , Adam Burchfield , L. Jason Anastasopoulos , Derrick M. Anderson This is my paper · ORCID
classification cs.CY
keywords roboticsadoptiongovernmentagenciescrimelaboratoriestechnologypublicadministrationforensicscienceprobitmodelorganizationalcapacity
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper asks why some government agencies adopt advanced technologies like robotics while others lag, using American crime laboratories as the test case. It argues that adoption is not driven by exotic or futuristic motives but by the same conventional forces that shape agency behavior: budget capacity, the pressure of external demand, and professionalism. Analyzing two census snapshots of publicly funded crime labs, the authors find that labs with larger budgets, more forensic requests, and more accreditations are significantly more likely to use robotics in both 2009 and 2014. The finding matters because it suggests public agencies can be early adopters when they have the resources and need, and that robotics in government is already an established rather than novel technology.

What carries the argument

The analysis rests on probit regression models with robust standard errors clustered by state, estimated separately on the 2009 and 2014 censuses of publicly funded forensic crime laboratories. The dependent variable is a binary indicator of whether a lab reports using robotics for any purpose; the key predictors are Box-Cox transformed Budget and Requests Received, an Accreditation index built from four accreditation items, a Proficiency index built from four testing items, and dummies for multiple-lab membership and outsourcing. These models translate the hypotheses H1, H2, H3a, and H4 into estimated marginal effects on adoption probability.

What would settle it

If a re-analysis of the same census microdata using a more specific robotics indicator, such as whether robotics are used for DNA extraction versus evidence handling, found no positive association with budgets, requests, or accreditation once lab size and jurisdiction type were controlled, the central claim would be undermined.

Watch

Extended reading notes

Core claim

The central discovery is that the probability a publicly funded crime lab uses robotics increases with its operating budget, the number of forensic service requests it receives, and the extent of its professional accreditation, with these effects statistically significant in both the 2009 and 2014 census cross-sections. Outsourcing is also positively associated with adoption in 2014, while proficiency testing and membership in a multi-lab system show no consistent relationship. The authors interpret the changing marginal effects over time as evidence that budget matters more for early adoption, while task pressure matters more for later adoption.

Load-bearing premise

The analysis assumes that a lab's yes-or-no answer to whether it uses robotics for any purpose is a valid and comparable measure of adoption across all labs in both census years, even though those answers may cover very different kinds of robotics or inconsistent reporting standards.

Editorial extensions

If this is right

  • If the central claim is correct, forecasts about government technology adoption should focus on observable capacity and demand indicators, not on agency culture alone.
  • The finding that over half of crime labs already used robotics by 2014 suggests that 'smart technology' in government is more commonplace than the laggard narrative implies.
  • The shifting marginal effects between 2009 and 2014 imply that the drivers of adoption change across the diffusion curve, with budget mattering early and task environment mattering later.
  • For public managers, the results indicate that resource constraints and professional certification are levers that can predict or encourage adoption of automation.
  • The significant outsourcing effect in 2014 suggests that external vendor relationships become a channel for technology diffusion once early adoption is underway.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The binary survey measure likely conflates different kinds of robotics, from DNA extraction automation to evidence-handling robots; a finer-grained dependent variable could reveal whether the same budget, caseload, and accreditation drivers hold for each type.
  • The two cross-sections are not a panel, so the 'early vs late adoption' interpretation is suggestive rather than causal; linking labs across censuses would permit a direct test of whether the same lab changed adoption status.
  • If the capacity-and-demand logic generalizes, other low-visibility public agencies with professional staff and rising caseloads, such as public health laboratories or environmental testing facilities, should show similar robotics adoption patterns, a claim testable with survey data from those sectors.
  • The paper's framing implies that geographic inequities in robotics adoption follow from uneven budgets and caseloads; a spatial analysis of lab locations and adoption status could test whether regional disparities track these resource gradients.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. The paper examines the adoption of robotics by publicly funded crime laboratories in the United States, using data from the 2009 and 2014 Censuses of Publicly Funded Forensic Crime Laboratories. It proposes five hypotheses linking adoption to budget, task environment (requests received), professionalism (accreditation and proficiency), outsourcing, and multi-lab status. Probit models estimated separately for each year show that budget, task environment, and accreditation are positively and significantly associated with robotics adoption in both years, while outsourcing is significant only in 2014. The paper interprets these findings as evidence that traditional drivers of agency capacity and demand shape the adoption of smart technologies, and it discusses early versus late adoption. The authors are transparent that the evidence is 'indicative at best.'

Significance. If the associations are robust, the paper offers one of the first systematic empirical accounts of robotics adoption in public agencies, using a census of actual public organizations rather than surveys of intentions. It connects a contemporary technology to a well-established literature on technology adoption in government. The analysis is straightforward and reproducible, and the authors test hypotheses derived from prior work without cherry-picking significant results. However, the contribution is limited by the coarse self-reported outcome and the cross-sectional design, and the main inference is threatened by an omitted service-mix confound.

major comments (3)
  1. [Data Description, Table 2] The probit models omit controls for the forensic functions performed by each laboratory, which is a central concern because the manuscript itself notes that forensic service mix varies sharply by jurisdiction (footnote 7) and that labs performing more functions are more likely to be accredited (p. 21). In this era, 'robotics' in crime labs likely refers primarily to automated liquid handling and DNA extraction, which are used mainly by labs performing forensic biology casework. If so, the positive coefficients on Budget, Task Environment, and Accreditation may simply proxy for 'performs DNA casework,' since DNA labs are larger, receive more requests, and are more likely to be accredited. The paper should add controls for the number or types of forensic functions, or restrict the analysis to labs that perform DNA casework, before the evidence can support H1-H3a as drivers of adoption.
  2. [Estimation and Results, Conclusion] The comparison of the 2009 and 2014 coefficients is described as evidence about 'early' versus 'late' adoption, but these are repeated cross-sections, not a panel: the set of labs is not identical across waves, and there is no within-lab tracking. Differences in coefficients between years could reflect changes in sample composition, survey administration, or measurement rather than changes in the adoption process. For example, the Proficiency variable changes markedly in range and mean between 2009 and 2014 (Table 1), suggesting possible coding differences across waves. The language in the Abstract ('early adopters') and in Section 6 ('that effect is less important over time') overstates what can be concluded from two cross-sections. Please temper these claims or, if lab identifiers permit, restrict the analysis to labs present in both waves.
  3. [Data Description] The dependent variable, Robotics, is a binary self-report of whether the lab 'uses robotics for any purpose.' This is a very coarse measure that may include heterogeneous technologies, from fully automated DNA extraction systems to smaller laboratory robots. The paper acknowledges this coarseness but does not assess what kinds of robotics are actually being captured or how this affects the interpretation of the coefficients. At minimum, the authors should discuss the likely composition of 'robotics' in this setting and the directional impact of measurement error. In addition, the Proficiency index shows a dramatic shift in distribution between waves (mean 1.476 vs. 0.454; maximum 4 vs. 3), which should be explained, since it bears directly on hypothesis H3b.
minor comments (6)
  1. [Table 2] The Wald test statistics are reported but not their p-values or the associated degrees of freedom; please add these or provide confidence intervals for the coefficients.
  2. [Data Description] The Box-Cox transformation is described as a 'zero-skew transformation' but the estimated lambda parameter is not reported for either Budget or Requests Received; please provide these values or explain the procedure.
  3. [Data Description, Estimation and Results] The sample sizes drop from 397 (2009) and 351 (2014) to 269 and 271 in the models; please describe the missing-data pattern and justify the exclusions beyond the removal of federal labs.
  4. [Figures 1a-3b] The figures are referenced but not included in the manuscript text provided; please ensure the final submission includes legible figures with confidence bands as described.
  5. [Works Cited] Several citations in the text are incomplete or inconsistent: 'Ebrahim and Irani 2005' and 'Li and Steveson 2002' do not appear in the Works Cited; 'Jun and Weare 2009' should be 'Jun and Weare 2010'; and 'Monoharan 2012' should be 'Manoharan 2012'.
  6. [Constraints on Innovation in Agencies] The abbreviation 'ST' for 'smart technologies' is introduced but used inconsistently later in the same section; please define and use it uniformly.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the paper tests literature-derived hypotheses against independent census data.

full rationale

This is a standard empirical study rather than a derivation. The hypotheses H1-H5 are drawn from the public-administration and technology-adoption literature, while the dependent variable (Robotics) and the independent variables (Budget, Requests Received, Accreditation, Proficiency, Multiple Labs, Outsourcing) are separate survey items or indices from the CPFFCL. No coefficient is fitted to one subset and then used to predict a closely related quantity; the probit models simply estimate associations and report marginal effects. There is no self-citation chain that supplies the load-bearing argument: the only self-citations are to BJS census reports co-authored by one of the present authors, and those are used as data documentation, not as theoretical support or as an identification assumption. The paper's own caveat that the results are 'indicative at best' is a validity limitation, not a circularity. Possible omitted-variable confounding through forensic service mix is a substantive correctness threat, but it is not a case of a result being equivalent to its inputs by construction.

Assumptions & free parameters 1 free parameters · 4 assumptions · 0 invented entities

The analysis depends on standard statistical assumptions and the validity of the census questionnaire. No new theoretical entities are introduced. The main free parameter is the Box-Cox lambda, which is not reported, and the key domain assumption is the validity and comparability of the self-reported robotics measure.

free parameters (1)
  • Box-Cox transformation lambda = Not reported
    Budget and Requests Received are transformed to zero skew using Box-Cox, but the lambda values are not stated in the paper. These parameters affect the scaling of the independent variables and thus the coefficient estimates.
assumptions (4)
  • standard math Probit error distribution
    The regression model assumes a normal (probit) link function, a standard statistical assumption.
  • domain assumption Clustered standard errors are valid
    The models use robust standard errors clustered by state, which assumes within-state correlation of errors is correctly specified.
  • domain assumption Crime labs in the census are representative of all publicly funded crime labs
    The 2014 census had an 88 percent response rate (360 of 409 labs), and the paper uses only those with complete data (N=271 after exclusions, including dropping federal labs). The analysis assumes these labs are representative.
  • domain assumption The survey item 'uses robotics for any purpose' is a consistent measure across both waves
    The wording may not have been identical across 2009 and 2014, and no definition of 'robotics' was provided to respondents. This affects the comparability of the dependent variable.

how reviews work

0 comments
Cite this review

Pith. "Pith review of The Adoption of Robotics by Government Agencies: Evidence from Crime Labs." pith.science (2026). https://pith.science/paper/QSR6FEGE

@misc{pith2026190806164,
  author       = {Pith},
  title        = {Pith review of: The Adoption of Robotics by Government Agencies: Evidence from Crime Labs},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/QSR6FEGE}},
  note         = {Machine review of arXiv:1908.06164}
}
read the original abstract

While firms and factories often adopt technologies like robotics and advanced manufacturing techniques at a fast rate, government agencies are often seen as lagging in their adoption of such tools. We offer evidence about the adoption of robotics from the case of American crime laboratories.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

32 extracted references · 32 canonical work pages

  1. [1]

    second machine age

    1 THE ADOPTION OF ROBOTICS BY GOVERNMENT AGENCIES: EVIDENCE FROM CRIME LABS Andrew B. Whitford* University of Georgia Jeff Yates Binghamton University Adam Burchfield University of Georgia L. Jason Anastasopoulos University of Georgia Derrick M. Anderson Arizona State University Abstract The adoption and use of emerging and smart technologies like robotic...

    work page 2015

  2. [2]

    Probit models. 2009 Dataset 2014 Dataset Variable Coefficient Robust SE Coefficient Robust SE Budget 0.121 0.032 *** 0.016 0.007 ** Task Environment 0.073 0.034 ** 0.201 0.032 *** Accreditation 0.341 0.186 * 0.541 0.196 *** Proficiency -0.067 0.114 0.120 0.131 Multiple Labs -0.009 0.213 -0.105 0.181 Outsourcing 0.094 0.162 0.515 0.156 *** Constant -4.980 ...

    work page 2009

  3. [3]

    2016, 2)

    Sixty-one percent analyzed forensic biology collected during criminal casework from crime scenes, victims, or suspects, and 16 percent analyzed biological samples collected from convicted offenders and arrestees for inclusion in a local, state, or national DNA database (Durose, et al. 2016, 2). 15 The consequence of these two aspects is that the laborator...

    work page 2016

  4. [6]

    The combined operating budgets for the 409 crime labs in 2014 was $1.7 billion. Labs serving state jurisdictions accounted for nearly half of the overall budget in 2014, and labs with 25 or more employees accounted for more than 80 percent of the total combined budget nationwide. (Durose, et al. 2016, 5). 10 In 2010, BJS conducted a third census on the wo...

    work page 2014

  5. [7]

    The date(s) of collection were: November 2010 - May

    A total of 397 of the 411 eligible labs responded to the 2009 census, including at least one from every state. The date(s) of collection were: November 2010 - May

    work page 2009

  6. [8]

    Follow-up emails and phone calls were made to nonrespondents and labs that submitted incomplete questionnaires

    In April 2015, the Urban Institute initiated the data collection on behalf of BJS through a web-based data collection interface and mailed questionnaire. Follow-up emails and phone calls were made to nonrespondents and labs that submitted incomplete questionnaires. Of the 409 eligible crime labs that received the questionnaire, 360 (88 percent) provided r...

    work page 2015

  7. [9]

    21 In 2014, 88 percent of the nation’s crime labs were accredited by a professional organization, up from 70 percent in

    work page 2014

  8. [10]

    2016, 1)

    Eighty-three percent of crime labs held an international accreditation standard in 2014 (Burch, et al. 2016, 1). In 2014, 98 percent of crime labs conducted proficiency testing. Nearly all crime labs evaluated the technical competence of employees through declared examinations. The proportion of crime labs conducting blind examinations and random case rea...

    work page 2014

Show all 32 references
  1. [11]

    2016, 4)

    In 2014, federal crime labs were more likely than county, state, and municipal labs to test the proficiency of employees through blind examinations to conduct random case reanalysis than labs operated by other jurisdictions (Burch, et al. 2016, 4). In 2014, three-quarters of c...

    2014

  2. [12]

    The overwhelming majority of crime labs maintain a written code of ethics. Ethical codes guide behaviors to ensure analysts work within the confines of their expertise, provide objective findings and testimony, avoid conflicts of interest, and avoid susceptibility to outside i...

    2016

  3. [13]

    The larger the number of personnel employed by a crime 22 lab, the likelier that at least one externally certified analyst is on staff

    Municipal crime labs were most likely to employ at least one externally certified analyst, while federal crime labs were least likely to do so. The larger the number of personnel employed by a crime 22 lab, the likelier that at least one externally certified analyst is on staf...

    2016

  4. [14]

    Federal crime labs are far more likely than any other jurisdiction to engage in forensic science research. This research includes experimentation aimed at the discovery and interpretation of facts, revision of accepted methods, or practical application of new or revised method...

    2016

  5. [15]

    As the descriptives show, the proportion using robotics increased from 0.41 in 2009 to 0.54 in

    The variable Robotics is a dichotomous dependent variable that is a response to the question of whether the lab uses robotics for any purpose. As the descriptives show, the proportion using robotics increased from 0.41 in 2009 to 0.54 in

    2009

  6. [16]

    The six independent variables fall into three groupings

    While this is a coarse measure, it represents the best publicly-available data for these organizations. The six independent variables fall into three groupings. The first two - Budget and Requests Received - measure the resources and task environment concepts discussed above. ...

    2009

  7. [17]

    An interpretation is that the effect is less important over time - perhaps suggesting that budget is important for early adoption but less important for later adoption

    While both coefficients are positive and significant, perhaps the most notable differences across time are that the slope is attenuated in 2014, and uncertainty about that effect increases (the width of the confidence interval is greater is 2014). An interpretation is that the...

    2014

  8. [18]

    [Insert Figures 2a and 2b about here.] The other primary finding in both models is that accreditation of crime labs is positively associated with probability of adoption

    This finding suggests that task environment is perhaps less important for early adoption than for later adoption of an emerging technology like robotics. [Insert Figures 2a and 2b about here.] The other primary finding in both models is that accreditation of crime labs is posi...

    2009

  9. [19]

    smart technology

    The estimated marginal effects shown in Figures 3a and 3b also suggest that the impact of accreditation is more attenuated than that for task environment in 2014 or budget in 2009 (the estimated slopes are flatter). [Insert Figures 3a and 3b about here.] Of the other variables...

    2014

  10. [20]

    SpeedFactory

    lets us see how the incidence of robotics changes and also how the variables contribute differently to those likelihoods over time. As we noted previously, it is important to take such evidence as indicative at best and follow up with more in-depth analyses (either through cau...

    2008

  11. [25]

    The Rights and Wrongs of Robotics: Ethics and Robots in Public Organizations

    “The Rights and Wrongs of Robotics: Ethics and Robots in Public Organizations.” Canadian Public Administration 57: 485–506. Kliksberg, B. (2000). Rebuilding the state for social development: towards ‘smart government’. International Review of Administrative Sciences, 66(2), 24...

    2000

  12. [30]

    BCG Perspectives

    The Rise of Robotics. BCG Perspectives. https://www.bcgperspectives.com/content/articles/business_unit_strategy_innovation_rise_of_robotics/ . Savoldelli, A., Codagnone, C., & Misuraca, G. (2014). Understanding the e-government paradox: Learning from literature and practice on...

    2014

  13. [31]

    Descriptive statistics. For 2009: Variable Mean SD Minimum Maximum Robotics 0.413 0.493 0 1 Budget 27.358 4.854 11.241 38.536 Requests Received 15.355 4.177 4.095 31.427 Accreditation 0.892 0.546 0 3 Proficiency 1.476 0.766 0 4 Multiple labs 0.394 0.490 0 1 Outsourced 0.297 0....

    2009

  14. [339]

    found in their survey of local government units, one of the foremost cited barriers to technological adoption or 17 augmentation of technology is financial resources. Technological adoptions (such as robotics) can be costly, therefore we may reasonably expect that laboratories...

    1995

  15. [979]

    bureaucratic personality

    Bertot, J. C., Jaeger, P. T., & Grimes, J. M. (2010). Using ICTs to create a culture of transparency: E-government and social media as openness and anti-corruption tools for societies. Government information quarterly, 27(3), 264-271. Bozeman, B., & Bretschneider, S. (1986). P...

    2010

  16. [1990]

    In Advances in Neural Information Processing Systems (pp

    Handwritten digit recognition with a back-propagation network. In Advances in Neural Information Processing Systems (pp. 396-404). Li, F. (2003). Implementing E-Government strategy in Scotland: current situation and emerging issues. Journal of Electronic Commerce in Organizati...

    2003

  17. [1996]

    Public Administration Review 56: 554–67

    Human Factors in Adoption of Geographic Information System. Public Administration Review 56: 554–67. Norris, D. F., Fletcher, P. D., & Holden, S. H. (2001). Is your local government plugged in? Highlights of the 2000 electronic government survey. Washington, DC: International ...

    2001

  18. [2002]

    Nonprofit and Voluntary Sector Quarterly, 31(1), pp.115-130

    Organizational capacity and organizational effectiveness among street-level food assistance programs. Nonprofit and Voluntary Sector Quarterly, 31(1), pp.115-130. Fletcher, K., & Wright, G. (1995). Organizational, strategic and technical barriers to successful implementation o...

    1995

  19. [2005]

    O’Malley, M

    Advancing E-Government at the Grassroots: Tortoise or Hare? Public Administration Review 65:64–75. O’Malley, M. (2014). Doing what works: Governing in the age of big data. Public Administration Review, 74(5), 555-556. Reddick, C. G., & Turner, M. (2012). Channel choice and pub...

    2014

  20. [2009]

    Conducted by the University of Illinois at Chicago and Sam Houston State University

    ICPSR34340-v2. Conducted by the University of Illinois at Chicago and Sam Houston State University. Ann Arbor, MI: Inter-University Consortium for Political and Social Research. 9 U.S. Department of Justice, Bureau of Justice Statistics. CENSUS OF PUBLICLY FUNDED FORENSIC CRIM...

    2014

  21. [2012]

    The American Review of Public Administration 43: 159-78

    A Study of the Determinants of E-Government in the United States. The American Review of Public Administration 43: 159-78. Mascaro, C. M., & Goggins, S. P. (2011, June). Brewing up citizen engagement: the coffee party on facebook. In Proceedings of the 5th International Confer...

    2011

  22. [2014]

    fourth industrial revolution

    or 11 the “fourth industrial revolution” (Schwab 2017). This paper centers on the adoption of robotics by government agencies. As is often the case with fast moving fields like emerging technologies, defining terms can be difficult. The field of robotics is “the science or the...

    2017

  23. [2017]

    R., Helbig, N., & Ojo, A

    https://www.forensicmag.com/news/new-utah-crime-lab-tackles-rape-kit-testing-robotics Gil-Garcia, J. R., Helbig, N., & Ojo, A. (2014). Being smart: Emerging technologies and innovation in the public sector. Government Information Quarterly, 31, I1-I8. Heeks, R. (Ed.). (2001). ...

    2014

  24. [2019]

    Journal of Economic Perspectives 33:71–88

    The Rise of Robots in China. Journal of Economic Perspectives 33:71–88. Dawes, S. S., & Nelson, M. R. (1995, January). Pool the risks, share the benefits: Partnerships in IT innovation. In Technology trendlines (pp. 125-135). Van Nostrand Reinhold Co.. Dawson, G. S., & Denford...

    2015

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.