Faculty Orientations Shape Adoption of AI in Research and Teaching
Pith reviewed 2026-05-20 00:01 UTC · model grok-4.3
The pith
Faculty orientations toward AI's role in disciplinary thinking strongly predict their adoption of AI tools in research and teaching.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Exploratory factor analysis identified a coherent construct, AI pedagogical orientation, that strongly predicted self-reported AI use across research, teaching, and other professional activities. Qualitative analysis indicated that this construct reflected differing views about the role AI should play in disciplinary thinking, learning, and expertise development, rather than simply positive or negative attitudes toward AI. Institutional initiatives, demographic variables, and information sources showed comparatively weak associations with AI use.
What carries the argument
The AI pedagogical orientation construct, identified via exploratory factor analysis, which captures faculty beliefs about how AI should integrate into disciplinary thinking, learning, and expertise development.
If this is right
- AI adoption depends more on specific beliefs about its place in disciplinary reasoning than on general attitudes or external incentives.
- Standard technology-adoption frameworks may require updates for tools that directly shape knowledge production.
- Promotion of AI use should target alignment with faculty views on expertise development rather than broad institutional mandates.
- Differences in AI integration mirror underlying differences in how faculty conceptualize learning and thinking in their fields.
Where Pith is reading between the lines
- The same orientation construct could be tested for presence and predictive power among faculty in non-STEM disciplines.
- Professional development might usefully include explicit discussion of AI's appropriate role in disciplinary expertise.
- Longitudinal tracking could reveal whether these orientations shift over time with increased AI exposure or training.
- The result raises questions about whether AI tools will ultimately alter the core practices that define expertise in various fields.
Load-bearing premise
The factor structure derived from this sample of 90 faculty in one professional community reflects a stable, generalizable orientation rather than sample-specific response patterns or self-report bias.
What would settle it
A larger replication survey across diverse faculty populations that fails to recover the same coherent factor or finds no strong predictive link to AI use would undermine the central claim.
Figures
read the original abstract
Despite the widespread availability of large language models (LLMs) in higher education, instructors vary substantially in their adoption and use of these tools, and the reasons for this variation remain poorly understood. A mixed-methods survey of 90 STEM faculty in the Research Corporation for Science Advancement (RCSA) Cottrell community examined relationships between AI use, attitudes, institutional context, and instructional practice. Exploratory factor analysis identified a coherent construct, \textit{AI pedagogical orientation}, that strongly predicted self-reported AI use across research, teaching, and other professional activities. Qualitative analysis indicated that this construct reflected differing views about the role AI should play in disciplinary thinking, learning, and expertise development, rather than simply positive or negative attitudes toward AI. Institutional initiatives, demographic variables, and information sources showed comparatively weak associations with AI use. The results suggest that existing technology-adoption models may not fully explain adoption in contexts where technologies interact directly with disciplinary reasoning and knowledge production.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript reports on a mixed-methods survey of 90 STEM faculty in the RCSA Cottrell community examining relationships between AI use, attitudes, institutional context, and instructional practice. Exploratory factor analysis identified a coherent construct termed AI pedagogical orientation that strongly predicted self-reported AI use across research, teaching, and other professional activities. Qualitative analysis indicated this construct reflects differing views about the role of AI in disciplinary thinking, learning, and expertise development rather than general positive or negative attitudes. Institutional initiatives, demographic variables, and information sources showed comparatively weak associations.
Significance. If the central result holds, the work contributes empirical insight into variation in faculty AI adoption by identifying a discipline-linked orientation construct that extends beyond standard technology-adoption models. The mixed-methods design and focus on an original sample from a professional community provide concrete data on how orientations tied to disciplinary reasoning shape AI integration in research and teaching.
major comments (3)
- [Exploratory factor analysis subsection] Exploratory factor analysis subsection: with n=90 the analysis requires explicit reporting of KMO/Bartlett statistics, eigenvalue thresholds or scree criteria, factor loadings, variance explained, and any stability or cross-validation checks. These are absent from the described results, leaving the coherence and generalizability of the AI pedagogical orientation construct unverified and risking sample-specific response patterns.
- [Results on predictive relationships] Results on predictive relationships: the claim that the identified construct strongly predicted self-reported AI use lacks reported quantitative support such as correlation coefficients, regression betas, R^{2} values, or effect sizes. Without these metrics the strength of the central association cannot be assessed.
- [Measures and data collection] Measures and data collection: both the orientation construct and AI use are measured via self-report with no objective validation, behavioral logs, or discussion of social-desirability bias. This shared-method variance is load-bearing for the reported predictive relationship.
minor comments (2)
- [Abstract] Abstract: include the sample size (n=90) and at least one key quantitative detail (e.g., variance explained or a prediction metric) to allow readers to evaluate the strength of the reported findings.
- [Discussion] Discussion: provide a more explicit comparison of the AI pedagogical orientation construct to existing technology-adoption frameworks (e.g., TAM or UTAUT) to clarify the claimed extension.
Simulated Author's Rebuttal
We are grateful to the referee for their constructive and detailed feedback, which identifies key areas where the reporting and discussion in our manuscript can be strengthened. We address each major comment below and note the corresponding revisions.
read point-by-point responses
-
Referee: [Exploratory factor analysis subsection] Exploratory factor analysis subsection: with n=90 the analysis requires explicit reporting of KMO/Bartlett statistics, eigenvalue thresholds or scree criteria, factor loadings, variance explained, and any stability or cross-validation checks. These are absent from the described results, leaving the coherence and generalizability of the AI pedagogical orientation construct unverified and risking sample-specific response patterns.
Authors: We agree that these diagnostic statistics and details are essential for readers to evaluate the exploratory factor analysis. We will revise the manuscript to include explicit reporting of the KMO measure, Bartlett's test of sphericity, the eigenvalue thresholds and scree plot criteria used for factor retention, all relevant factor loadings, the variance explained, and results from stability or cross-validation procedures such as split-sample checks. These additions will be placed in the Methods and Results sections to substantiate the coherence of the AI pedagogical orientation construct. revision: yes
-
Referee: [Results on predictive relationships] Results on predictive relationships: the claim that the identified construct strongly predicted self-reported AI use lacks reported quantitative support such as correlation coefficients, regression betas, R^{2} values, or effect sizes. Without these metrics the strength of the central association cannot be assessed.
Authors: We acknowledge that the manuscript did not provide sufficient quantitative detail on the predictive models. We will revise the Results section to report the relevant correlation coefficients, regression betas (standardized and unstandardized), R^{2} values, and effect sizes for the associations between AI pedagogical orientation and self-reported AI use across research, teaching, and other activities. These metrics will be added to allow direct assessment of the strength and practical significance of the relationships. revision: yes
-
Referee: [Measures and data collection] Measures and data collection: both the orientation construct and AI use are measured via self-report with no objective validation, behavioral logs, or discussion of social-desirability bias. This shared-method variance is load-bearing for the reported predictive relationship.
Authors: This is a valid methodological limitation inherent to the survey design. As data collection is complete, we cannot add new objective validation measures or behavioral logs. We will partially revise the manuscript by expanding the Limitations and Discussion sections to explicitly address reliance on self-report data, potential social-desirability bias, and the implications of shared-method variance for the observed predictive relationships. We will also suggest avenues for future research incorporating objective or multi-method data. revision: partial
Circularity Check
Empirical survey with EFA on original data exhibits no circularity
full rationale
This is a mixed-methods empirical survey study reporting exploratory factor analysis on original responses from 90 faculty. The identification of the 'AI pedagogical orientation' construct and its reported predictive relationship to self-reported AI use are derived directly from the collected survey items and qualitative coding without any equations, parameter fits, or self-citation chains that reduce the central claim to its own inputs by construction. The derivation chain is self-contained against external benchmarks as it describes observed statistical patterns and thematic analysis in the sample data.
Axiom & Free-Parameter Ledger
free parameters (1)
- Factor structure and loadings
axioms (2)
- domain assumption Self-reported AI use and attitudes accurately reflect actual behavior and beliefs.
- domain assumption Exploratory factor analysis on this sample size produces replicable factors.
invented entities (1)
-
AI pedagogical orientation
no independent evidence
Lean theorems connected to this paper
-
IndisputableMonolith/Foundation/AbsoluteFloorClosure.leanreality_from_one_distinction unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
Exploratory factor analysis identified a coherent construct, AI pedagogical orientation, that strongly predicted self-reported AI use
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
The survey was designed by a core team of five STEM faculty from the CottreLLM collaboration based on a sequence of structured discussions about generative AI usage and adoption in research and teaching. Based on these conversations, and also consultation with educa- tion researchers who already published on AI usage, the survey scope was focused on usage...
-
[2]
S. Küchemann and J. Kuhn, Phys. Rev. Phys. Educ. Res. 22, 010001 (2026)
work page 2026
-
[3]
E. Yuriev, D. J. Wink, and T. A. Holme, J. Chem. Educ.101, 2957 (2024), https://doi.org/10.1021/acs.jchemed.4c00836
-
[4]
P. Wattanakasiwich, K. Kaewkhong, and D. Katwibun, Phys. Rev. Phys. Educ. Res.21, 010155 (2025)
work page 2025
-
[5]
V. Skogvoll and T. Odden, European Journal of Physics 10.1088/1361-6404/ae55e0 (2026)
-
[6]
A. Ghimire, J. Pather, and J. Edwards, in2024 IEEE Frontiers in Education Conference (FIE)(IEEE Com- puter Society, Los Alamitos, CA, USA, 2024) pp. 1–9
work page 2024
-
[7]
A. de Silva, I. H. J. Song, H. Yang, and S. R. Humay- oun, Stem faculty perspectives on generative ai in higher education (2026), arXiv:2603.04001 [cs.CY]
- [8]
-
[9]
P. Tschisgale, H. Maus, F. Kieser, B. Kroehs, S. Petersen, and P. Wulff, Phys. Rev. Phys. Educ. Res.21, 020115 (2025)
work page 2025
-
[10]
G. Polverini, J. Melin, E. Önerud, and B. Gregorcic, Phys. Rev. Phys. Educ. Res.21, 010154 (2025)
work page 2025
-
[11]
J. K. West, J. L. Franz, S. M. Hein, H. R. Leverentz- Culp, J. F. Mauser, E. F. Ruff, and J. M. Zemke, Journal of Chemical Education100, 4351 (2023), https://doi.org/10.1021/acs.jchemed.3c00581
-
[12]
E. A. Alasadi and C. R. Baiz, Journal of Chemical Education101, 2716 (2024), https://doi.org/10.1021/acs.jchemed.4c00138
-
[13]
M. N. Dahlkemper, S. Z. Lahme, and P. Klein, Phys. Rev. Phys. Educ. Res.19, 010142 (2023)
work page 2023
-
[14]
J. Lademann, J. Henze, and S. Becker-Genschow, Phys. Rev. Phys. Educ. Res.21, 010147 (2025)
work page 2025
-
[15]
E. F. Ruff, M. A. Engen, J. L. Franz, J. F. Mauser, J. K. West, and J. M. O. Zemke, Jour- nal of Chemical Education101, 2483 (2024), https://doi.org/10.1021/acs.jchemed.4c00248
-
[16]
S. Kilde-Westberg, A. Johansson, and J. Enger, Phys. Rev. Phys. Educ. Res.21, 020119 (2025)
work page 2025
-
[17]
D. Tong, B. Jin, Y. Tao, H. Ren, A. Y. M. Atiquil Is- lam, and L. Bao, Phys. Rev. Phys. Educ. Res.21, 010149 (2025)
work page 2025
-
[18]
S. A. Gunbatar, G. T. Sirin, O. C. Ilkyaz, and Y. Mutlu, Chem. Educ. Res. Pract.26, 977 (2025)
work page 2025
-
[19]
A. A. Fernández, M. López-Torres, J. J. Fernández, and D. Vázquez-García, Jour- nal of Chemical Education101, 3780 (2024), https://doi.org/10.1021/acs.jchemed.4c00231
-
[20]
P. P. Martin and N. Graulich, Chem. Educ. Res. Pract. 24, 407 (2023)
work page 2023
-
[21]
Y. Jiang, X.-M. Feng, Y. Liu, Y. Wang, L. Xie, and L. Bao, Phys. Rev. Phys. Educ. Res.22, 010116 (2026)
work page 2026
- [22]
-
[23]
E. Brynjolfsson, D. Li, and L. Raymond, The Quarterly Journal of Economics140, 889 (2025)
work page 2025
-
[24]
C. K. Lo, K. F. Hew, and M. S.-y. Jong, Computers & Education219, 105100 (2024)
work page 2024
-
[25]
T.J.Atherton,AmericanJournalofPhysics91,7(2023)
work page 2023
-
[26]
M. D. D. Caballero, ed.,Integrating Computing into the Undergraduate Physics Curriculum, 2053-2563 (IOP Publishing, 2025)
work page 2053
- [27]
- [28]
-
[29]
A. Phillips, E. Gouvea, B. Gravel, P.-H. Beachemin, and T. Atherton, Physical Review Physics Education Re- search19, 010121 (2023)
work page 2023
-
[30]
M. D. Caballero and L. Merner, Physical Review Physics Education Research14, 020129 (2018), 1712.07701
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[31]
N. T. Young, G. Allen, J. M. Aiken, R. Henderson, and M. D. Caballero, Physical Review Physics Education Re- search15, 010114 (2019)
work page 2019
- [32]
-
[33]
M. D. Caballero, N. Chonacky, L. Engelhardt, R. C. Hilborn, M. L. d. Puerto, and K. R. Roos, The Physics Teacher57, 397 (2019)
work page 2019
-
[34]
A. R. McDonald, J. A. Nash, P. S. Nerenberg, K. A. Ball, O. Sode, J. J. Foley IV, T. L. Win- dus, and T. D. Crawford, International Jour- nal of Quantum Chemistry120, e26359 (2020), https://onlinelibrary.wiley.com/doi/pdf/10.1002/qua.26359
-
[35]
G. Yin Stokes, How faculty with minimal program- ming experience implemented jupyter notebooks in phys- ical and general chemistry courses, inTeaching Pro- gramming across the Chemistry Curriculum, Chap. 2, pp. 13–27, https://pubs.acs.org/doi/pdf/10.1021/bk- 2021-1387.ch002. 15 Code Brief Description Coding Including any programming task. Visualization In...
work page doi:10.1021/bk- 2021
-
[36]
C. L. Vizcarra, R. F. Trainor, A. Ringer McDonald, C. T. Richardson, D. Potoyan, J. A. Nash, B. Lundgren, T. Luchko, G. M. Hocky, J. J. Foley, T. J. Atherton, and G. Y. Stokes, Nature Computational Science4, 803 (2024)
work page 2024
-
[37]
D. E. Gardner, G. Y. Stokes, A. Ringer McDonald, C. M. Teague, and E. S. Thrall, eds.,Engaging Students in Physical Chemistry, Volume 2, ACS Symposium Series, Vol. 1515 (American Chemical Society, 2025)
work page 2025
-
[38]
C. J. Burke and T. J. Atherton, American Journal of Physics85, 301 (2017)
work page 2017
- [39]
-
[40]
S. A. Papert,Mindstorms: Children, computers, and powerful ideas(Basic books, 2020)
work page 2020
- [41]
- [42]
- [43]
- [44]
-
[45]
Rogers, Diffusion of innovations 5th (2003)
E. Rogers, Diffusion of innovations 5th (2003)
work page 2003
-
[46]
V. Venkatesh, M. G. Morris, G. B. Davis, and F. D. Davis, MIS quarterly27, 425 (2003)
work page 2003
- [47]
-
[48]
C. Henderson, M. Dancy, and M. Niewiadomska-Bugaj, Physical Review Special Topics - Physics Education Re- search8, 020104 (2012)
work page 2012
- [49]
-
[50]
T. Greenhalgh, G. Robert, F. Macfarlane, P. Bate, and O. Kyriakidou, The milbank quarterly82, 581 (2004)
work page 2004
-
[51]
L. Xue, A. M. Rashid, and S. Ouyang, Sage Open14, 21582440241229570 (2024)
work page 2024
-
[52]
R.Noureddine, D.Boote,andL.O.Campbell,Education and Information Technologies30, 16687 (2025)
work page 2025
-
[53]
R. P. Bagozzi, Journal of the association for information systems8, 3 (2007)
work page 2007
- [54]
- [55]
-
[56]
L. R. Fabrigar and D. T. Wegener,Exploratory factor analysis(Oxford University Press, 2012)
work page 2012
-
[57]
W. Revelle,psych: Procedures for Psychological, Psycho- metric, and Personality Research, Northwestern Univer- sity, Evanston, Illinois (2026), r package version 2.6.1
work page 2026
- [58]
-
[59]
E. M. Smith, M. M. Stein, and N. Holmes, Physical Re- view Physics Education Research16, 010113 (2020)
work page 2020
-
[60]
Hammer, American journal of physics68, S52 (2000)
D. Hammer, American journal of physics68, S52 (2000)
work page 2000
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.