REVIEW 3 major objections 6 minor 2 cited by
The role of large language models in UI/UX design: A systematic literature review
T0 review · 3 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read The first systematic review dedicated to large language models in UI/UX design claims LLMs now act as collaborators across the entire design lifecycle.
desk verdict A transparent, useful first LLM-specific UI/UX review whose frequency counts rest on a shaky sampling shortcut; worth refereeing with a sensitivity check required. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machinery is the systematic review protocol itself: a three-database Boolean search across ACM, IEEE Xplore, and Scopus for 2022 to 2025, a relevance-based cutoff to keep screening tractable, exclusion and inclusion criteria that reduce 2,668 initial hits to 38 studies, and structured data extraction across nine fields. The analytical backbone is a mapping of LLM integration onto the stages of the UI/UX design lifecycle, including research and discovery, ideation, design generation, prototyping and simulation, evaluation and feedback, iterative refinement, and reflection and ethics, which turns scattered case studies into a coherent claim about full-lifecycle adoption.
What would settle it
Re-run the search across ACM, IEEE Xplore, and Scopus without the relevance-based cutoff, or at least screen the pages beyond the cutoffs, and check whether additional UI/UX and LLM studies surface; if new studies change the corpus, the claims about GPT-4 dominance, the 2024 peak, and the best-practice clusters would need revision.
Extended reading notes
Core claim
The authors set out to answer three research questions: which open-source and proprietary LLMs are used in UI/UX work, how they are integrated, and what best practices and limitations the literature reports. Their central finding is that LLM integration is already full-spectrum: GPT-4 appears in 18 of the 38 reviewed studies, with GPT-3.5, PaLM, Gemini, GPT-4V, and others playing supporting or comparison roles, and the models are embedded as plugins inside design tools, driven by prompts as a design language, and applied from research and discovery through evaluation and iterative refinement. The review further claims that the most effective use is human-in-the-loop and modular, that structured prompting, tool integration, and multimodal inputs are the emerging best practices, and that hallucinations, prompt instability, limited explainability, and ethical or privacy concerns are the recurring obstacles. The authors conclude that the integration landscape is still fragmented, lacking shared standards, and call for validation mechanisms, prompt-design support, ethical safeguards, and evaluation benchmarks.
Load-bearing premise
The load-bearing premise is that stopping the database search once a results page drops below five relevant titles out of ten does not miss important studies buried deeper in the rankings; if relevant work sits beyond the cutoff, the count of 38 studies and the trends built on it are artifacts of the sampled subset.
Editorial extensions
If this is right
- If LLMs truly span the full lifecycle, design teams can expect AI support to shift from one-off idea generation to integrated toolchains, with prompt engineering becoming a core design skill.
- The dominance of GPT-4 in the reviewed studies implies that conclusions about LLM-assisted design are largely conclusions about OpenAI's current models, so future reviews will need to track model shifts.
- Best practices such as human-in-the-loop iteration, modular task decomposition, and multimodal grounding offer an actionable starting point for designing new tools even before formal standards exist.
- The recurring challenges of hallucination, prompt instability, and explainability define a concrete research agenda centered on validation layers, structured prompting grammars, and evaluation benchmarks.
- The fragmented tooling landscape suggests that early adoption is driven by individual plugins and bespoke systems, making shared evaluation standards a near-term necessity.
Reading between the lines
- Because the relevance-based cutoff stops screening after a page shows fewer than five relevant titles out of ten, the corpus of 38 studies may undercount relevant work buried deeper in search rankings, so the GPT-4 dominance and the 2024 publication peak should be read as sample-dependent trends until a cutoff-free replication is done.
- With 27 of 38 studies coming from ACM venues, the synthesis likely overrepresents HCI-conference perspectives; industry tooling inside commercial plugins or closed corporate systems is probably underreported.
- A testable extension would be to run the same search on a newer 2025 to 2026 window and check whether Gemini, Claude, or open-weight models displace GPT-4 and whether the lifecycle mapping shifts toward more evaluation-stage use.
- The review's best-practice list could be turned into a rubric for assessing new LLM design tools: check for prompt engineering support, human-in-the-loop editing, multimodal input handling, and explainability features.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper reports a systematic literature review (SLR) of the role of large language models (LLMs) in UI/UX design. The authors define three research questions covering (RQ1) which LLMs are used and how they are integrated, (RQ2) emerging best practices, and (RQ3) limitations and risks. They searched ACM Digital Library, IEEE Xplore, and Scopus with an explicit Boolean query, applied a relevance-based cutoff during screening, and ultimately selected 38 peer-reviewed studies published between 2022 and 2025. The findings are organized around model frequencies (GPT-4 appearing most often, followed by GPT-3.5 and others), integration patterns (embedded tools, prompt-based interaction, lifecycle-wide use, multimodality, modular workflows, human-AI collaboration), best practices (prompt engineering, human-in-the-loop iteration, tool integration, modularity, multimodal grounding, trust and evaluation mechanisms), and challenges (hallucination, prompt instability, context loss, creativity constraints, trust issues, ethical/legal problems, tooling gaps). The paper concludes that LLMs are emerging collaborators across the full UI/UX design lifecycle and proposes directions for validation, prompt support, ethical safeguards, and evaluation standards.
Significance. If the review's sample is representative, the paper provides a useful and timely synthesis of a fast-moving area. Its strengths include a transparent protocol with clearly stated research questions, an explicit Boolean query, a PRISMA-style flow, a data-extraction framework, and a dedicated threats-to-validity section. The authors are also commendably candid about the limitations of their relevance-based cutoff and database choices. These features make the review reproducible in principle and give readers a clear basis for judging the evidence base. The central descriptive claims—that GPT-4 dominates current usage, that LLMs are used across ideation, prototyping, evaluation, and refinement, and that hallucinations and prompt instability are the main reported challenges—are plausible and well-aligned with the included studies. However, these claims rest on a sample that may be materially incomplete, and the paper does not quantify the potential impact of its selection shortcuts. The value of the review as a reference synthesis depends on the extent to which these concerns are resolved or explicitly bounded.
major comments (3)
- [Section 3.2.1; Tables 6 and 7] The relevance-based cutoff strategy assumes that search-result relevance decreases monotonically after the first few pages. For ACM, which returned 2,026 hits, only the first ~10 pages were title-screened; if relevant LLM-in-UI/UX papers appear beyond that horizon (e.g., because the engine ranks by date or by other criteria), then the model-frequency counts in Table 6 and the lifecycle-stage mapping in Table 7 are computed from a biased subset. The authors acknowledge this as a selection-bias threat in Section 3.5.1, but acknowledgment alone does not establish that the bias is negligible. I ask for a sensitivity analysis: for at least one database, screen a random sample of results beyond the cutoff (or compare against a query run without the cutoff on a smaller, targeted subset) and report whether the distribution of relevant studies and the resulting model/lifecycle patterns change materially. Without such a check, the central claim that LLMs—especially GPT-4—are used "throughout the design lifecycle" cannot be fully separated from the sampling rule.
- [Section 3.2.1 and Section 3.3.3] The treatment of Scopus is problematic in two respects. First, the protocol states that Scopus returned relevant results only in the first two pages, yet Figure 3 and the text indicate that no study from Scopus was ultimately included; this makes the Scopus filtering decision consequential. Because Scopus has broader coverage than ACM or IEEE in many areas, its complete exclusion could systematically omit relevant studies (e.g., journal articles from venues not indexed by ACM/IEEE). Second, the same subsection mentions that "Springer results were excluded entirely due to a lack of relevance" even though the search strategy lists only ACM, IEEE Xplore, and Scopus as the databases searched. This is an internal inconsistency: either Springer was searched and should be reported in the protocol and PRISMA flow, or it was not and the sentence should be removed. I request a clarification and, ideally, a documented justification or sensitivity check for the Scopus decision.
- [Section 3.3.1 and Section 3.3.2] The inclusion/exclusion process relies heavily on the authors' judgment of "scientific rigor," "relevance," and "credibility," but no formal quality-appraisal instrument or inter-rater reliability check is reported. The paper states that some studies were excluded for lacking methodological detail or for being domain-specific rather than generalizable, but it does not list the excluded studies or provide examples with enough specificity to allow a reader to verify the consistency of the judgments. For a systematic review, this is not necessarily fatal, but it does weaken the transparency of the selection stage. Please consider adding a short appendix or table that enumerates the full-text screened studies and the primary reason for exclusion, or at least provide a more detailed account of how the criteria were operationalized.
minor comments (6)
- [Section 3.3.1] There is an arithmetic inconsistency: starting from 338 papers, removing 7 duplicates and 1 non-English paper leaves 330, and removing 172 in the initial screening leaves 158, but the text says 159. Please correct this figure.
- [Section 3.2.1] The sentence "Scopus yielded relevant results primarily on the first two pages" is ambiguous because it is unclear whether those pages were fully included or whether the cutoff was applied at that point. Please specify the exact cutoff for each database, including page numbers and the number of titles reviewed.
- [Section 3.2.1] The mention of Springer is inconsistent with the list of searched databases; if Springer was indeed searched, its inclusion and exclusion should be reflected in the PRISMA flow and search strategy; otherwise, the sentence should be removed.
- [Section 4.1.3, Table 7] The lifecycle mapping would benefit from a clearer definition of the stages (e.g., whether "Research & Discovery" and "Ideation" are distinct or overlapping) and from explicit criteria for assigning a study to a stage. As written, the assignments appear reasonable but are not auditable.
- [Section 4.2.6] The text cites "[49, 39, 23]" for explainability and evaluation, but the reference numbering is occasionally used inconsistently (e.g., [23] is cited for both automatic feedback and heuristic evaluation in different places). A careful pass to ensure each citation supports the specific claim would improve accuracy.
- [Highlights and Abstract] The highlights state "GPT-4 and Gemini" while the abstract adds "PaLM"; please align the wording to avoid an apparent discrepancy.
Circularity Check
No circularity: the review synthesizes an external corpus and its only sampling heuristic is disclosed as a validity threat, not a derivation.
full rationale
This paper is a systematic literature review rather than a derivation: it extracts and synthesizes findings from 38 external peer-reviewed studies, and every reported result (LLM frequencies, lifecycle mapping, best practices, challenges) is a summary of what those included studies report, not a quantity computed from the review's own assumptions. The relevance-based cutoff in Section 3.2.1 is a screening heuristic, not a fitted parameter, and the authors explicitly disclose in Section 3.5.1 that it risks excluding relevant studies buried deeper in search rankings; that disclosure frames the cutoff as a threat to completeness and representativeness, not as a mechanism that defines the findings by construction. The 'first systematic literature review' claim is a novelty assertion contextualized against prior surveys, not an analytic premise, and the reference list contains no load-bearing self-citation by the present authors. No uniqueness theorem, ansatz, or normalization is imported from the authors' own prior work. The paper's substantive weakness is potential selection bias affecting external validity, which is a correctness concern rather than circularity. Because no step can be exhibited where a reported result reduces by definition or by self-citation to the review's own inputs, the appropriate circularity score is 0.
Assumptions & free parameters
assumptions (3)
- domain assumption The three databases ACM Digital Library, IEEE Xplore, and Scopus provide sufficient coverage of relevant UI/UX and LLM research.
- ad hoc to paper The relevance-based cutoff strategy (stop after a page with fewer than 5 of 10 relevant titles) does not systematically exclude relevant studies.
- domain assumption Subjective judgments of 'scientific rigor, relevance, and credibility' during full-text screening are consistent and reproducible.
Cite this review
Pith. "Pith review of The role of large language models in UI/UX design: A systematic literature review." pith.science (2026). https://pith.science/paper/NFY3B6ON
@misc{pith2026250704469,
author = {Pith},
title = {Pith review of: The role of large language models in UI/UX design: A systematic literature review},
year = {2026},
howpublished = {\url{https://pith.science/paper/NFY3B6ON}},
note = {Machine review of arXiv:2507.04469}
}
read the original abstract
This systematic literature review examines the role of large language models (LLMs) in UI/UX design, synthesizing findings from 38 peer-reviewed studies published between 2022 and 2025. We identify key LLMs in use, including GPT-4, Gemini, and PaLM, and map their integration across the design lifecycle, from ideation to evaluation. Common practices include prompt engineering, human-in-the-loop workflows, and multimodal input. While LLMs are reshaping design processes, challenges such as hallucination, prompt instability, and limited explainability persist. Our findings highlight LLMs as emerging collaborators in design, and we propose directions for the ethical, inclusive, and effective integration of these technologies.
Figures
Figures from the paper (7 more)
Forward citations
Cited by 2 Pith papers
-
PrivacyMotiv: Vulnerability-Centered Persona Journeys for Empathic Privacy Reviews in UX Design
PrivacyMotiv generates LLM-created speculative personas and traceable journey stories to raise UX designers' empathy and motivation for privacy, yielding 59% more privacy issues found and 70% more redesign ideas in a ...
-
PrivacyMotiv: Vulnerability-Centered Persona Journeys for Empathic Privacy Reviews in UX Design
In a 16-designer within-subjects study, LLM-generated vulnerability personas and journey stories significantly raised empathy, intrinsic motivation, usefulness, and concrete privacy findings compared with designers' u...
Reference graph
Works this paper leans on
-
[1]
The WebAIM million – 2022 update.https://webaim.org/ blog/webaim-million-2022
, 2022. The WebAIM million – 2022 update.https://webaim.org/ blog/webaim-million-2022
2022
-
[2]
Why is UX design important for business?https://tinyurl
, 2025. Why is UX design important for business?https://tinyurl. com/5n7yp4ah
2025
-
[3]
User experience design using machine learning: A systematic review
Abbas, A.M.H., Ghauth, K.I., Ting, C.Y., 2022. User experience design using machine learning: A systematic review. IEEE Ac- cess URL: https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber= 9770797, doi:10.1109/ACCESS.2022.3173289
arXiv 2022
-
[4]
Aljedaani, W., Eler, M.M., Parthasarathy, S.D., 2025. Enhancing accessibility in software engineering projects with large language models (llms), in: Proceedings of the 56th ACM Technical Sym- posium on Computer Science Education V. 1, ACM. pp. 25–31. doi:10.1145/3641554.3701841
arXiv 2025
-
[5]
Importance of UX design in 60+ statistics.https: //tinyurl.com/2achsybv
Alos, J., 2020. Importance of UX design in 60+ statistics.https: //tinyurl.com/2achsybv
2020
-
[6]
Beltramelli, T., 2018. pix2code: Generating code from a graphi- cal user interface screenshot, in: Proceedings of the ACM SIGCHI SymposiumonEngineeringInteractiveComputingSystems,pp.1–6. doi:10.1145/3220134.3220135
-
[7]
Ben Chaaben, M., Ben Sghaier, O., Dhaouadi, M., Elrasheed, N., Darif, I., Jaoua, I., Oakes, B., Syriani, E., Hamdaqa, M., 2024. Toward intelligent generation of tailored graphical concrete syntax, in: Proceedings of the ACM/IEEE 27th International Conference on Model Driven Engineering Languages and Systems, ACM/IEEE. pp. 160–171. doi:10.1145/3640310.3674085
arXiv 2024
-
[8]
Bertão, R.A., Joo, J., 2021. Artificial intelligence in ux/ui design: Asurveyoncurrentadoptionandfuturepractices,in:BlucherDesign Proceedings,14thInternationalConferenceoftheEuropeanAcademy ofDesign,SafeHarboursforDesignResearch,Blucher. doi: 10.5151/ ead2021-123
2021
Show all 97 references
-
[9]
Fromleadertolaggard:Ananalysisofblackberry’sui/ux missteps and the decline of a tech giant
Bharath, P., Damodhar, D.B., Venkatesh, M., Shetty, P.K., Ahmed, S.T.,2023. Fromleadertolaggard:Ananalysisofblackberry’sui/ux missteps and the decline of a tech giant. Transactions on Federated Engineering&Systems1,Article1. URL: https://doi.org/10.5281/ zenodo.8262610, doi:10...
2023 doi
-
[10]
Accelerating innovation with gen- erativeai:Ai-augmenteddigitalprototypingandinnovationmethods
Bilgram, V., Laarmann, F., 2023. Accelerating innovation with gen- erativeai:Ai-augmenteddigitalprototypingandinnovationmethods. IEEE Engineering Management Review 51, 18–25. doi:10.1109/EMR. 2023.3272799
2023
-
[11]
Bunian, S., Li, K., Jemmali, C., Harteveld, C., Fu, Y., El-Nasr, M.S.,
-
[12]
Effects of successful adoption of information technology enabled services in proposed smart cities of india: From user experience perspective
Chatterjee, S., Kar, A.K., 2017. Effects of successful adoption of information technology enabled services in proposed smart cities of india: From user experience perspective. Journal of Science and TechnologyPolicyManagement9,189–209. URL: https://doi.org/ 10.1108/JSTPM-03-20...
2017 doi
-
[13]
Chaudhry, B.M., 2024. Concerns and challenges of ai tools in the ui/ux design process: A cross-sectional survey, in: CHI EA ’24: Extended Abstracts of the CHI Conference on Human Factors in ComputingSystems,ACM.pp.1–6. URL: https://doi.org/10.1145/ 3613905.3650878, doi:10.1145...
2024
-
[14]
From ui designimagetoguiskeleton:Aneuralmachinetranslatortobootstrap mobile gui implementation, in: Proceedings of the 40th International Conference on Software Engineering, pp
Chen, C., Su, T., Meng, G., Xing, Z., Liu, Y., 2018. From ui designimagetoguiskeleton:Aneuralmachinetranslatortobootstrap mobile gui implementation, in: Proceedings of the 40th International Conference on Software Engineering, pp. 665–676. doi: 10.1145/ 3180155.3180240
2018
-
[15]
Dave, H., Sonje, S., Pardeshi, J., Chaudhari, S., Raundale, P., 2021. A survey on artificial intelligence based techniques to convert user interfacedesignmock-upstocode,in:2021InternationalConference on Artificial Intelligence and Smart Systems (ICAIS), pp. 28–33. doi:10.1109/...
2021
-
[16]
Llmr: Real-time prompting ofinteractiveworldsusinglargelanguagemodels,in:Proceedingsof the 2024 CHI Conference on Human Factors in Computing Systems, ACM
De La Torre, F., Fang, C.M., Huang, H., Banburski-Fahey, A., Amores Fernandez, J., Lanier, J., 2024. Llmr: Real-time prompting ofinteractiveworldsusinglargelanguagemodels,in:Proceedingsof the 2024 CHI Conference on Human Factors in Computing Systems, ACM. doi:10.1145/3613904.3642579
2024
-
[17]
Rico:Amobileappdatasetforbuilding data-driven design applications, in: Proceedings of the 30th Annual ACMSymposiumonUserInterfaceSoftwareandTechnology(UIST ’17), pp
Deka, B., Huang, Z., Franzen, C., Hibschman, J., Afergan, D., Li, Y., Nichols,J.,Kumar,R.,2017. Rico:Amobileappdatasetforbuilding data-driven design applications, in: Proceedings of the 30th Annual ACMSymposiumonUserInterfaceSoftwareandTechnology(UIST ’17), pp. 845–854. URL:ht...
2017
-
[18]
A survey for in-context learning
Dong, Q., Li, L., Dai, D., Zheng, C., Wu, Z., Chang, B., Sun, X., Xu, J., Sui, Z., 2022. A survey for in-context learning. arXiv preprint arXiv:2301.00234 URL:https://arxiv.org/abs/2301.00234
2022 arXiv
-
[19]
Isuxdesignstressful? URL: https://www.visily
Douglas,C.,2023. Isuxdesignstressful? URL: https://www.visily. ai/blog/is-ux-design-stressful/
2023
-
[22]
Towards generating ui de- sign feedback with llms, in: Adjunct Proceedings of the 36th Annual ACMSymposiumonUserInterfaceSoftwareandTechnology,ACM
Duan, P., Warner, J., Hartmann, B., 2023. Towards generating ui de- sign feedback with llms, in: Adjunct Proceedings of the 36th Annual ACMSymposiumonUserInterfaceSoftwareandTechnology,ACM. doi:10.1145/3586182.3615810
2023
-
[23]
Generating automatic feedback on ui mockups with large language models, in: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, ACM
Duan, P., Warner, J., Li, Y., Hartmann, B., 2024b. Generating automatic feedback on ui mockups with large language models, in: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, ACM. doi:10.1145/3613904.3642782
2024
-
[24]
Optimizing user interface layouts via gradient descent, in: Proceedings of the 2020 CHIConferenceonHumanFactorsinComputingSystems,pp.1–12
Duan, P., Wierzynski, C., Nachman, L., 2020. Optimizing user interface layouts via gradient descent, in: Proceedings of the 2020 CHIConferenceonHumanFactorsinComputingSystems,pp.1–12. doi:10.1145/3313831.3376589
2020
-
[25]
Predicting interaction effort in web interface widgets
Gardey,J.C.,Grigera,J.,Rodríguez,A.,Rossi,G.,Garrido,A.,2022. Predicting interaction effort in web interface widgets. International Journal of Human-Computer Studies 168, 102919. doi:10.1016/j. ijhcs.2022.102919
2022
-
[26]
Dreamcodevr: Towardsdemocratizingbehaviordesigninvirtualrealitywithspeech- driven programming, in: 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR), IEEE
Giunchi, D., Numan, N., Gatti, E., Steed, A., 2024. Dreamcodevr: Towardsdemocratizingbehaviordesigninvirtualrealitywithspeech- driven programming, in: 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR), IEEE. pp. 579–589. doi:10.1109/VR58804. 2024.00078
2024
-
[27]
Artificial intelligence and interaction design for a positive emotional user experience, in: Karwowski, W., Ahram, T
Gomes, C.C., Preto, S., 2018. Artificial intelligence and interaction design for a positive emotional user experience, in: Karwowski, W., Ahram, T. (Eds.), Intelligent Human Systems Integration. Springer InternationalPublishing,pp.62–68. doi: 10.1007/978-3-319-73888-8_ 11
2018 doi
-
[28]
Large language models for software engineering: A systematic literature review
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., Wang, H., 2024. Large language models for software engineering: A systematic literature review. URL:https: //arxiv.org/abs/2308.10620v6.retrievedfrom https://arxiv.org/abs/ 2308.10620v6
2024 arXiv
-
[29]
Towards reasoning in large lan- guage models: A survey
Huang, J., Chang, K.C.C., 2023. Towards reasoning in large lan- guage models: A survey. URL: https://aclanthology.org/2023. findings-acl.67/. retrieved from https://aclanthology.org/2023. findings-acl.67/
2023
-
[30]
Largelanguagemodels for code completion: A systematic literature review
Husein,R.A.,Aburajouh,H.,Catal,C.,2025. Largelanguagemodels for code completion: A systematic literature review. Computer Standards & Interfaces 92, 103917. URL:https://doi.org/10.1016/ j.csi.2024.103917, doi:10.1016/j.csi.2024.103917. A, Ahmed. et al.:Preprint submitted to El...
2025
-
[31]
Promptmaker: Prompt-based prototyping with large languagemodels,in:ExtendedAbstractsofthe2022CHIConference on Human Factors in Computing Systems, ACM
Jiang, E., Olson, K., Toh, E., Molina, A., Donsbach, A., Terry, M., Cai, C.J., 2022. Promptmaker: Prompt-based prototyping with large languagemodels,in:ExtendedAbstractsofthe2022CHIConference on Human Factors in Computing Systems, ACM. doi: 10.1145/ 3491101.3503564
2022
-
[32]
Johnston, V., Black, M., Wallace, J., Mulvenna, M., Bond, R., 2019. A framework for the development of a dynamic adaptive intelligent user interface to enhance the user experience, in: Proceedings of the 31st European Conference on Cognitive Ergonomics, pp. 32–
2019
-
[33]
Large language model forrequirementsengineering:Asystematicliteraturereview
Khan, J.A., Qayyum, S., Shareef, H.D., 2024. Large language model forrequirementsengineering:Asystematicliteraturereview. License: CC BY 4.0, Retrieved from ResearchGate
2024
-
[34]
Technology trends for ux/ui of smart contents
Kim, S.J., Cho, D.E., 2016. Technology trends for ux/ui of smart contents. The Korea Contents Association Review 14, 29–33
2016
-
[35]
URL: https://doi.org/10.1145/3335082.3335125, doi:10.1145/ 3335082.3335125
-
[36]
Systematic literature reviews in software engi- neering – a systematic literature review
Kitchenham, B., Brereton, O.P., Budgen, D., Turner, M., Bailey, J., Linkman, S., 2009. Systematic literature reviews in software engi- neering – a systematic literature review. Information and Software Technology51,7–15. URL: https://doi.org/10.1016/j.infsof.2008. 09.009, doi:...
2009 doi
-
[37]
Kim,T.S.,Lee,Y.J.,Chang,M.,Kim,J.,2023. Cells,generators,and lenses: Design framework for object-oriented interaction with large language models, in: Proceedings of the 36th Annual ACM Sympo- siumonUserInterfaceSoftwareandTechnology,ACM. doi: 10.1145/ 3586183.3606833
2023
-
[38]
On ’artificial intelligence- user interface’ approach, in: 2019 International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON), pp
Latipova, A., Gasenko, A., Sim, G., 2019. On ’artificial intelligence- user interface’ approach, in: 2019 International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON), pp. 0446–0451. doi:10.1109/SIBIRCON48586.2019.8958406
2019
-
[39]
Kolthoff, K., Kretzer, F., Bartelt, C., Maedche, A., Ponzetto, S.P.,
-
[40]
Pretrain, prompt, and predict: A systematic survey of prompting methods in natural language processing
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., Neubig, G., 2023a. Pretrain, prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Computing Surveys 55, 1–35. doi:10.1145/3529198
-
[41]
Liu,X.B.,Kirilyuk,V.,Yuan,X.,Chi,P.,Olwal,A.,Chen,X.A.,Du, R., 2023b. Experiencing visual captions: Augmented communica- tion with real-time visuals using large language models, in: Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology,...
-
[43]
Ai is not enough: A hybrid technical approach to ai adoption in ui linting with heuristics, in: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, ACM
Lu, Y., Knearem, T., Dutta, S., Blass, J., Kliman-Silver, C., Bentley, F., 2024a. Ai is not enough: A hybrid technical approach to ai adoption in ui linting with heuristics, in: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, ACM. doi:10.1145/36...
- [44]
-
[45]
Liu, Y.F., Luthfi, M.I., Hwang, W.Y., 2024. Enhancing usability and learner engagement: A heuristic evaluation of the ai-enhanced video drama maker app, in: 2024 21st International Joint Conference on Computer Science and Software Engineering (JCSSE), IEEE. pp. 337–342. doi:10...
2024
-
[47]
Machine learning-based prototyping of graphical user in- terfacesformobileapps
Moran,K.,Bernal-Cárdenas,C.,Curcio,M.,Bonett,R.,Poshyvanyk, D., 2020. Machine learning-based prototyping of graphical user in- terfacesformobileapps. IEEETransactionsonSoftwareEngineering 46, 196–221. doi:10.1109/TSE.2018.2844788
2020
-
[48]
The influence of ux design on user retention and conversion rates in mobile apps
Majumder, A.S., 2025. The influence of ux design on user retention and conversion rates in mobile apps. https://arxiv.org/abs/2501. 13407
2025
-
[49]
Holistic multi-layered system design for human-centered dialog systems, in: 2024IEEE4thInternationalConferenceonHuman-MachineSystems (ICHMS), IEEE
Oruche, R., Akula, R., Goruganthu, S.K., Calyam, P., 2024. Holistic multi-layered system design for human-centered dialog systems, in: 2024IEEE4thInternationalConferenceonHuman-MachineSystems (ICHMS), IEEE. pp. 1–8. doi:10.1109/ICHMS59971.2024.10555807
2024
- [50]
-
[51]
Oh, C., Song, J., Choi, J., Kim, S., Lee, S., Suh, B., 2018. I lead, you help but only with enough details: Understanding user experience of co-creation with artificial intelligence, in: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–
2018
-
[52]
URL: https://doi.org/10.1145/3173574.3174223, doi:10.1145/ 3173574.3174223
-
[53]
In situ ai prototyping: Infusing multimodal prompts into mobile settings with mobilemaker, in: 2024 IEEE Symposium on VisualLanguagesandHuman-CentricComputing(VL/HCC),IEEE
Petridis, S., Liu, M.X., Fiannaca, A.J., Tsai, V., Terry, M., Cai, C.J., 2024a. In situ ai prototyping: Infusing multimodal prompts into mobile settings with mobilemaker, in: 2024 IEEE Symposium on VisualLanguagesandHuman-CentricComputing(VL/HCC),IEEE. pp. 121–133. doi:10.1109...
2024
-
[54]
Promptinfuser: Bringing user interface mock-ups to life with large language models, in: Extended Abstractsofthe2023CHIConferenceonHumanFactorsinComput- ing Systems, ACM
Petridis, S., Terry, M., Cai, C.J., 2023. Promptinfuser: Bringing user interface mock-ups to life with large language models, in: Extended Abstractsofthe2023CHIConferenceonHumanFactorsinComput- ing Systems, ACM. doi:10.1145/3544549.3585628
2023
-
[55]
Starrystudioai: Automating ui design with code-based generative ai and rag, in: 2025 IEEE 15th Annual Computing and Communication Workshop and Conference (CCWC), pp
Patel, B., Gagrani, P., Sheth, S., Thakur, K., Varahan, P., Shim, S., 2025. Starrystudioai: Automating ui design with code-based generative ai and rag, in: 2025 IEEE 15th Annual Computing and Communication Workshop and Conference (CCWC), pp. 00937– 00944. doi:10.1109/CCWC62904...
2025
-
[56]
Guidelines for conducting systematic mapping studies in software engineering: An update
Petersen, K., Vakkalanka, S., Kuzniarz, L., 2015. Guidelines for conducting systematic mapping studies in software engineering: An update. InformationandSoftwareTechnology64,1–18. URL: https: //doi.org/10.1016/j.infsof.2015.03.007,doi: 10.1016/j.infsof.2015. 03.007
2015 doi
-
[57]
Salminen, J., Sengün, S., Jung, S., Jansen, B.J., 2019. Design issues in automatically generated persona profiles: A qualitative analysis from 38 think-aloud transcripts, in: Proceedings of the 2019 Con- ference on Human Information Interaction and Retrieval, pp. 225–
2019
-
[58]
Sasaki,I.,Arikawa,M.,Lu,M.,Utsumi,T.,Sato,R.,2024. Geofence- to-conversation: Hierarchical geofencing for augmenting city walks with large language models, in: Adjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction, ACM. doi:10.1145/36404...
2024
-
[59]
Promptinfuser: How tightly coupling ai and ui design impacts designers’ workflows, in: Proceed- ings of the 2024 ACM Designing Interactive Systems Conference, ACM
Petridis, S., Terry, M., Cai, C.J., 2024b. Promptinfuser: How tightly coupling ai and ui design impacts designers’ workflows, in: Proceed- ings of the 2024 ACM Designing Interactive Systems Conference, ACM. pp. 743–756. doi:10.1145/3643834.3661613
2024
-
[60]
Reasoning with large language models, a survey
Plaat, A., Wong, A., Verberne, S., Broekens, J., van Stein, N., Back, T., 2024. Reasoning with large language models, a survey. URL: https://arxiv.org/abs/2407.11511.retrievedfrom https://arxiv.org/ abs/2407.11511
2024
-
[61]
Classi- fying design-level requirements using machine learning for a recom- mender of interaction design patterns
Silva-Rodríguez, V., Nava-Muñoz, S.E., Castro, L.A., Martínez- Pérez, F.E., Pérez-González, H.G., Torres-Reyes, F., 2020. Classi- fying design-level requirements using machine learning for a recom- mender of interaction design patterns. IET Software 14, 544–552. doi:10.1049/ie...
2020
-
[62]
Singhal, G., Singh, A., 2024. The large action model: Pioneering the next generation of web and app engagement, in: 2024 11th International Conference on Reliability, Infocom Technologies and Optimization(TrendsandFutureDirections)(ICRITO),IEEE.pp.1–
2024
-
[63]
Bad ux exposed: A comprehensive guide to avoiding pitfalls
Soegaard, M., 2023. Bad ux exposed: A comprehensive guide to avoiding pitfalls. URL: https://www.interaction-design. org/literature/article/bad-ux-examples. iNTERACTION DESIGN FOUNDATION
2023
-
[64]
Integrating generative artificial intelli- gence to a project-based tangible interaction course
Shaer, O., Cooper, A., 2024. Integrating generative artificial intelli- gence to a project-based tangible interaction course. IEEE Pervasive Computing 23, 63–69. doi:10.1109/MPRV.2023.3346548
2024
-
[65]
Understanding design col- laboration between designers and artificial intelligence: A systematic literature review
Shi, Y., Gao, T., Jiao, X., Cao, N., 2023. Understanding design col- laboration between designers and artificial intelligence: A systematic literature review. Proceedings of the ACM on Human-Computer Interaction 7, 1–35. URL:https://doi.org/10.1145/3610217, doi:10. 1145/361021...
2023 doi
-
[66]
Recent progress in automated code generation from gui images using machine learning techniques
Souza Baulé, D.d., Wangenheim, C.G.v., Wangenheim, A., Hauck, J.C.R., 2020. Recent progress in automated code generation from gui images using machine learning techniques. JUCS - Journal of Universal Computer Science 26, 1095–1127. doi:10.3897/jucs.2020. 058
2020 doi
-
[67]
Where developers feel ai coding tools are working—and where they’re missing the mark
Stack Overflow, 2024. Where developers feel ai coding tools are working—and where they’re missing the mark. URL: https:// shorturl.at/wljWq
2024
-
[68]
doi:10.1109/ICRITO61523.2024.10522132
2024
-
[69]
Eve: A sketch-based software prototyping workbench, in: Extended Abstracts of the 2019 CHI Conference on Human Factors in Com- puting Systems, pp
Suleri, S., Sermuga Pandian, V.P., Shishkovets, S., Jarke, M., 2019. Eve: A sketch-based software prototyping workbench, in: Extended Abstracts of the 2019 CHI Conference on Human Factors in Com- puting Systems, pp. 1–6. URL: https://doi.org/10.1145/3290607. 3312994, doi:10.11...
2019
-
[70]
Song, Y., Bian, Y., Tang, Y., Ma, G., Cai, Z., 2024. Visiontasker: Mobile task automation using vision based ui understanding and llm task planning, in: Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, ACM. doi:10.1145/ 3654777.3676386
2024
-
[71]
Evolution of a UX designer.https://tinyurl
Sonwalkar, V., 2019. Evolution of a UX designer.https://tinyurl. com/4u7yp336
2019
-
[73]
Chartgpt: Leveraging llms to generate charts from abstract natural language
Tian, Y., et al., 2025. Chartgpt: Leveraging llms to generate charts from abstract natural language. IEEE Transactions on Visualization and Computer Graphics 31, 1731–1745. doi: 10.1109/TVCG.2024. 3368621
2025 doi
-
[74]
Artificial intelligence(ai)foruserexperience(ux)design:asystematicliterature reviewandfutureresearchagenda
Åsne Stige, Zamani, E.D., Mikalef, P., Zhu, Y., 2024. Artificial intelligence(ai)foruserexperience(ux)design:asystematicliterature reviewandfutureresearchagenda. InformationTechnology&People
2024
-
[75]
URL:TBD,doi: TBD.articlepublicationdate:29August2023,Issue publication date: 3 September 2024
2024
-
[76]
Enabling conversational interaction with mobile ui using large language models, in: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, ACM
Wang, B., Li, G., Li, Y., 2023. Enabling conversational interaction with mobile ui using large language models, in: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, ACM. doi:10.1145/3544548.3580895
2023
-
[77]
Developing a toolkit for prototyping machine learning-empowered products
Sun, L., Zhou, Z., Wu, W., Zhang, Y., Zhang, R., Xiang, W., 2020. Developing a toolkit for prototyping machine learning-empowered products. International Journal of Design 14, 16
2020
-
[78]
Modeling mobile interface tappability using crowdsourcing and deep learning, in: Proceedings of the 2019 CHIConferenceonHumanFactorsinComputingSystems,pp.1–11
Swearngin, A., Li, Y., 2019. Modeling mobile interface tappability using crowdsourcing and deep learning, in: Proceedings of the 2019 CHIConferenceonHumanFactorsinComputingSystems,pp.1–11. doi:10.1145/3290605.3300305
2019
-
[79]
Farsight: Fostering responsible ai awareness during ai application prototyping, in: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, ACM
Wang, Z.J., Kulkarni, C., Wilcox, L., Terry, M., Madaio, M., 2024c. Farsight: Fostering responsible ai awareness during ai application prototyping, in: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, ACM. doi:10.1145/3613904.3642335
2024
-
[80]
On ai-inspired ui-design
Wei,J.,Courbis,A.L.,Lambolais,T.,Dray,G.,Maalej,W.,2025. On ai-inspired ui-design. IEEE Software doi:10.1109/MS.2025.3536838
2025
-
[81]
Dy- navis: Dynamically synthesized ui widgets for visualization editing, in: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, ACM
Vaithilingam, P., Glassman, E.L., Inala, J.P., Wang, C., 2024. Dy- navis: Dynamically synthesized ui widgets for visualization editing, in: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, ACM. doi:10.1145/3613904.3642639
2024
-
[82]
Beyond the buz- zwords:Ontheperspectiveofaiinuxandviceversa,in:International Conference on Human-Computer Interaction, pp
Wallach, D., Flohr, L., Kaltenhauser, A., 2020. Beyond the buz- zwords:Ontheperspectiveofaiinuxandviceversa,in:International Conference on Human-Computer Interaction, pp. 146–166. doi:10. 1007/978-3-030-50334-5_10
2020
-
[83]
Xiang, W., Zhu, H., Lou, S., Chen, X., Pan, Z., Jin, Y., Chen, S., Sun, L., 2024. Simuser: Generating usability feedback by simulating varioususersinteractingwithmobileapplications,in:Proceedingsof the 2024 CHI Conference on Human Factors in Computing Systems, ACM. doi:10.1145...
2024
-
[84]
Software testing with large language models: Survey, landscape, and vision
Wang, J., Huang, Y., Chen, C., Liu, Z., Wang, S., Wang, Q., 2024a. Software testing with large language models: Survey, landscape, and vision. URL: https://arxiv.org/abs/2307.07221v3. retrieved from https://arxiv.org/abs/2307.07221v3
-
[85]
Wang,Z.,Shen,L.,Kuang,E.,Zhang,S.,Fan,M.,2024b. Exploring the impact of artificial intelligence-generated content (aigc) tools on socialdynamicsinuxcollaboration,in:Proceedingsofthe2024ACM Designing Interactive Systems Conference, ACM. pp. 1594–1606. doi:10.1145/3643834.3660703
-
[86]
The Role of Design in Creating Machine-Learning- Enhanced User Experience
Yang, Q., 2017. The Role of Design in Creating Machine-Learning- Enhanced User Experience. Technical Report. Association for the Advancement of Artificial Intelligence. URL:https://www.aaai.org/ ocs/index.php/SSS/SSS17/paper/viewFile/15363/14575. 2017 AAAI Spring Symposium Series
2017
-
[87]
User portrait based on artificial intelligence, in: Hung, J.C., Yen, N.Y., Chang, J.W
Yuan, T., 2023. User portrait based on artificial intelligence, in: Hung, J.C., Yen, N.Y., Chang, J.W. (Eds.), Frontier Computing. Springer Nature, pp. 359–366. URL: https://doi.org/10.1007/ 978-981-99-1428-9_44 , doi:10.1007/978-981-99-1428-9_44
2023 doi
-
[88]
Burnout: the ugly side of UX
Wojnarowska, O., 2020. Burnout: the ugly side of UX. https:// uxdesign.cc/burnout-the-ugly-side-of-ux-1a6b436a8f46 . Published in UX Collective. Accessed: 2025-03-23
2020
-
[89]
Uiclip: A data-driven model for assessing user interface design, in: Proceedings of the 37th Annual ACM Symposium on UserInterfaceSoftwareandTechnology,ACM
Wu, J., Peng, Y.H., Li, X.A., Swearngin, A., Bigham, J.P., Nichols, J., 2024. Uiclip: A data-driven model for assessing user interface design, in: Proceedings of the 37th Annual ACM Symposium on UserInterfaceSoftwareandTechnology,ACM. doi: 10.1145/3654777. 3676408
2024 doi
-
[90]
A survey of large language models
Zhao, W.X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al., 2023. A survey of large language models. arXiv preprint arXiv:2303.18223 URL: https: //arxiv.org/abs/2303.18223
2023 arXiv
- [91]
-
[92]
Measuring and improving user experience through artificial intelligence-aided design
Yang, B., Wei, L., Pu, Z., 2020. Measuring and improving user experience through artificial intelligence-aided design. Frontiers in Psychology 11, 595374
2020
-
[93]
Zhou, Z., Jin, J., Phadnis, V., Yuan, X., Jiang, J., Qian, X., Zhou, J., Huang, Y., Xu, Z., Zhang, Y., Wright, K., Mayes, J., Sherwood, M., Lee, J., Olwal, A., Kim, D., Iyengar, R., Li, N., Du, R., 2024. Experiencing instructpipe: Building multi-modal ai pipelines via promptin...
2024
-
[95]
Herding ai cats: Lessons from designing a chatbot by prompting gpt-3, in: Proceedings of the 2023 ACM Designing Interactive Systems Conference, ACM
Zamfirescu-Pereira, J.D., Wei, H., Xiao, A., Gu, K., Jung, G., Lee, M.G., Hartmann, B., Yang, Q., 2023. Herding ai cats: Lessons from designing a chatbot by prompting gpt-3, in: Proceedings of the 2023 ACM Designing Interactive Systems Conference, ACM. pp. 2206–
2023
-
[97]
Zhang,X.,Zeng,Y.,Li,Q.,Chen,G.,Xu,Q.,Hu,X.,Peng,Z.,2024. Designwatch: Analyzing users’ operations of mobile apps based on screen recordings, in: Adjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction, ACM. doi:10. 1145/3640471.3680231
2024
-
[99]
Artificial intelli- genceaugmenteddesigniterationsupport,in:202013thInternational Symposium on Computational Intelligence and Design (ISCID), pp
Zhou, C., Chai, C., Liao, J., Chen, Z., Shi, J., 2020. Artificial intelli- genceaugmenteddesigniterationsupport,in:202013thInternational Symposium on Computational Intelligence and Design (ISCID), pp. 354–358. doi:10.1109/ISCID51228.2020.00086
2020
-
[100]
A comprehensive survey on pretrained foundation models: A history from bert to chatgpt
Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., et al., 2023. A comprehensive survey on pretrained foundation models: A history from bert to chatgpt. arXiv preprint arXiv:2302.09419 URL:https://arxiv.org/abs/2302.09419. A, Ahmed. et al....
2023 arXiv
-
[102]
et al.:Preprint submitted to Elsevier Page 19 of 19
[31] A, Ahmed. et al.:Preprint submitted to Elsevier Page 19 of 19
-
[229]
URL: https://doi.org/10.1145/3295750.3298942, doi:10.1145/ 3295750.3298942
-
[2021]
arXiv preprint arXiv:2102.05678 URL:https://arxiv.org/abs/2102.05216
Vins: Visual search for mobile user interface design. arXiv preprint arXiv:2102.05678 URL:https://arxiv.org/abs/2102.05216
-
[2024]
Interlinkinguserstoriesandguiprototyping:Asemi-automatic llm-based approach, in: 2024 IEEE 32nd International Requirements Engineering Conference (RE), IEEE. pp. 380–388. doi: 10.1109/ RE59067.2024.00045
2024
-
[2220]
doi:10.1145/3563657.3596138
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.