pith. sign in

arxiv: 2506.11563 · v2 · submitted 2025-06-13 · 💻 cs.LG · cs.AI

A Survey of Personalized Federated Foundation Models for Privacy-Preserving Recommendation

Zhiwei Li , Guodong Long , Chunxu Zhang , Honglei Zhang , Jing Jiang , Chengqi Zhang This is my paper

Pith reviewed 2026-05-19 09:25 UTC · model grok-4.3

classification 💻 cs.LG cs.AI
keywords federated learningfoundation modelspersonalizationrecommendation systemsprivacy preservationfederated foundation models
0
0 comments X

The pith

Federated foundation models can be adapted with personalization techniques to deliver privacy-preserving recommendations that balance global knowledge and individual user needs.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

This survey reviews recent progress on integrating foundation models into federated learning for recommendation systems. It first examines personalization methods that work under federated constraints, then explores how those methods can adapt large foundation models to keep raw user data local while still capturing personal preferences. The work frames the three elements as an architectural intersection that prior reviews have not treated together, outlining concrete ways the combination addresses both privacy regulations and recommendation effectiveness.

Core claim

The paper claims that personalization techniques effective in federated settings can be transferred to foundation models, allowing collaborative model refinement across devices or organizations without sharing raw data. By balancing the broad generalization of foundation models with user-specific adaptations, this approach achieves privacy-preserving recommendation. The survey provides a comprehensive overview of the emerging field and specifically emphasizes the architectural intersection of federation, personalization, and foundation models in contrast to existing reviews.

What carries the argument

The architectural intersection of federation, personalization, and foundation models, which carries the argument by enabling collaborative refinement of large models while keeping data local and capturing user personality.

If this is right

  • Federated architectures allow foundation models to refine recommendations collaboratively without moving raw user data off devices.
  • Personalization layers added to foundation models can capture individual preferences while the global model supplies broad knowledge.
  • The intersection provides a path to recommendation systems that meet strict privacy regulations without sacrificing performance.
  • Recent adaptations demonstrate viable ways to maintain both generalization and specificity in one system.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The survey framing suggests research should prioritize hybrid architectures that combine large-scale pretraining with lightweight local updates.
  • This approach could extend naturally to other domains where both scale and privacy matter, such as personalized content or health recommendations.
  • Future work might test whether the same intersection reduces the data requirements for effective personalization compared with purely local models.

Load-bearing premise

Techniques for personalization under federated constraints can be successfully adapted to foundation models to achieve an effective balance between global generalization and user-specific needs.

What would settle it

Empirical tests showing that adapted federated foundation models fail to improve personalization metrics over non-personalized federated baselines while still satisfying privacy constraints would undermine the claimed balance.

Figures

Figures reproduced from arXiv: 2506.11563 by Chengqi Zhang, Chunxu Zhang, Guodong Long, Honglei Zhang, Jing Jiang, Zhiwei Li.

Figure 1
Figure 1. Figure 1: Overview of the paper’s structure. The argument progresses from establishing the need [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Comparison of Centralized RS (Left), where all user data is server collected, versus FRS [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: The architecture of Federated Foundation Models for Recommendations, leveraging [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗
read the original abstract

Integrating Foundation Models (FMs) into recommendation systems is an emerging and promising research direction. However, centralized paradigms face growing pressure from privacy concerns and strict regulatory requirements. Federated learning offers a viable solution that enables collaborative model refinement while keeping raw user data on local devices or organizational silos. Yet, applying FMs in this setting creates a fundamental tension, where the system must balance the leverage of global knowledge with the necessity of capturing user personality. This survey provides a comprehensive overview of Personalized Federated Foundation Models for privacy-preserving recommendation, and reviews recent progress in this emerging field. We first analyze personalization techniques that function effectively under federated settings. Furthermore, we discuss the adaptation of foundation models to such federated architectures to balance generalization with user-specific needs for achieving privacy-preserving recommendation. In contrast to existing reviews, our work specifically emphasizes the architectural intersection of federation, personalization, and foundation models. \looseness=-1

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

1 major / 1 minor

Summary. This survey reviews recent progress on Personalized Federated Foundation Models for privacy-preserving recommendation. It first analyzes personalization techniques that work under federated constraints, then discusses adapting foundation models to federated architectures to balance global generalization against user-specific needs. The paper positions its contribution as emphasizing the three-way architectural intersection of federation, personalization, and foundation models, in contrast to prior reviews that address only pairwise combinations.

Significance. If the coverage is accurate and the intersection literature is meaningfully populated, the survey could usefully organize an emerging area and surface adaptation challenges for privacy-preserving recommendation. Explicit categorization of cited works by how directly they address the three-way intersection would strengthen its utility as a reference.

major comments (1)
  1. [Abstract and §1] Abstract and §1: The distinctiveness claim rests on the existence of a substantial body of work at the precise three-way intersection. The manuscript should include an explicit breakdown (e.g., a table or subsection) showing how many cited papers operate at the full intersection versus pairwise settings (federated personalization without foundation models, or foundation models in centralized recommendation). Without this, the framing risks resting on extrapolation rather than direct coverage of integrated systems.
minor comments (1)
  1. Ensure all section headings and subsection numbering are consistent throughout; some headings appear to shift between 'federated personalization' and 'personalized federated' phrasing.

Simulated Author's Rebuttal

1 responses · 0 unresolved

We thank the referee for their constructive feedback on our survey manuscript. We address the major comment below and will revise the paper to strengthen the presentation of the literature at the three-way intersection.

read point-by-point responses

  1. Referee: [Abstract and §1] Abstract and §1: The distinctiveness claim rests on the existence of a substantial body of work at the precise three-way intersection. The manuscript should include an explicit breakdown (e.g., a table or subsection) showing how many cited papers operate at the full intersection versus pairwise settings (federated personalization without foundation models, or foundation models in centralized recommendation). Without this, the framing risks resting on extrapolation rather than direct coverage of integrated systems.

    Authors: We agree that an explicit categorization would improve the manuscript's utility as a reference and better substantiate our positioning relative to prior reviews. In the revised version, we will add a new subsection (likely in §1 or §2) together with a summary table that classifies the cited works according to whether they address the full three-way intersection of federation, personalization, and foundation models, or only pairwise combinations. This classification will be based on the primary technical contributions of each paper and will include approximate counts for each category to clarify the size of the integrated literature. revision: yes

Circularity Check

0 steps flagged

No circularity: survey reviews external literature without derivations or self-referential reductions

full rationale

This is a survey paper whose central claims consist of reviewing and framing existing external literature on the intersection of federated learning, personalization, and foundation models for recommendation. No mathematical derivations, equations, predictions, or fitted parameters appear in the provided text or abstract. The statement that the work 'specifically emphasizes the architectural intersection' is a descriptive framing choice rather than a result derived from prior steps within the paper itself. No load-bearing arguments reduce by construction to self-citations, self-definitions, or fitted inputs; the paper is self-contained as a literature overview against external benchmarks.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

As a survey paper, this work does not introduce new free parameters, axioms, or invented entities; it reviews concepts, techniques, and architectures from the prior literature on federated learning, foundation models, and personalization.

pith-pipeline@v0.9.0 · 5698 in / 1094 out tokens · 35382 ms · 2026-05-19T09:25:58.696212+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

  • IndisputableMonolith/Foundation/RealityFromDistinction.lean reality_from_one_distinction unclear
    ?
    unclear

    Relation between the paper passage and the cited Recognition theorem.

    This survey provides a comprehensive overview of Personalized Federated Foundation Models for privacy-preserving recommendation, and reviews recent progress in this emerging field... emphasizes the architectural intersection of federation, personalization, and foundation models.

What do these tags mean?
matches
The paper's claim is directly supported by a theorem in the formal canon.
supports
The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends
The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses
The paper appears to rely on the theorem as machinery.
contradicts
The paper's claim conflicts with a theorem or certificate in the canon.
unclear
Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.

Reference graph

Works this paper leans on

79 extracted references · 79 canonical work pages · 3 internal anchors

  1. [1]

    A. M. Abdelmoniem, C.-Y . Ho, P. Papageorgiou, and M. Canini. A comprehensive empirical study of heterogeneity in federated learning. IEEE Internet of Things Journal, 10(16):14071– 14083, 2023

    work page 2023

  2. [2]

    Alamgir, F

    Z. Alamgir, F. K. Khan, and S. Karim. Federated recommenders: methods, challenges and future. Cluster Computing, 25(6):4075–4096, 2022

    work page 2022

  3. [3]

    Allouah, A

    Y . Allouah, A. El Mrini, R. Guerraoui, N. Gupta, and R. Pinot. Fine-tuning personalization in federated learning to mitigate adversarial clients. In A. Globerson, L. Mackey, D. Bel- grave, A. Fan, U. Paquet, J. Tomczak, and C. Zhang, editors,Advances in Neural Information Processing Systems, volume 37, pages 100816–100844. Curran Associates, Inc., 2024

    work page 2024

  4. [4]

    Augenstein, H

    S. Augenstein, H. B. McMahan, D. Ramage, S. Ramaswamy, P. Kairouz, M. Chen, R. Mathews, et al. Generative models for effective ml on private, decentralized datasets. arXiv preprint arXiv:1911.06679, 2019

    work page arXiv 1911

  5. [5]

    Awais, M

    M. Awais, M. Naseer, S. Khan, R. M. Anwer, H. Cholakkal, M. Shah, M.-H. Yang, and F. S. Khan. Foundation models defining a new era in vision: a survey and outlook.IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025

    work page 2025

  6. [6]

    J. Bian, Y . Peng, L. Wang, Y . Huang, and J. Xu. A survey on parameter-efficient fine-tuning for foundation models in federated learning. arXiv preprint arXiv:2504.21099, 2025

    work page arXiv 2025

  7. [7]

    Bietti, C.-Y

    A. Bietti, C.-Y . Wei, M. Dudik, J. Langford, and S. Wu. Personalization improves privacy- accuracy tradeoffs in federated learning. In International Conference on Machine Learning, pages 1945–1962. PMLR, 2022

    work page 1945

  8. [8]

    On the Opportunities and Risks of Foundation Models

    R. Bommasani, D. A. Hudson, E. Adeli, R. Altman, S. Arora, S. von Arx, M. S. Bernstein, J. Bohg, A. Bosselut, E. Brunskill, et al. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258, 2021

    work page internal anchor Pith review Pith/arXiv arXiv 2021

  9. [9]

    Bommasani, S

    R. Bommasani, S. Kapoor, K. Klyman, S. Longpre, A. Ramaswami, D. Zhang, M. Schaake, D. E. Ho, A. Narayanan, and P. Liang. Considerations for governing open foundation models. Science, 386(6718):151–153, 2024

    work page 2024

  10. [10]

    Buraya, A

    K. Buraya, A. Farseev, A. Filchenkov, and T.-S. Chua. Towards user personality profiling from multiple social networks. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 31, 2017

    work page 2017

  11. [11]

    D. Chai, L. Wang, K. Chen, and Q. Yang. Secure federated matrix factorization.IS, 36(5):11–20, 2020

    work page 2020

  12. [12]

    C. Chen, J. Liu, H. Tan, X. Li, K. I.-K. Wang, P. Li, K. Sakurai, and D. Dou. Trustwor- thy federated learning: privacy, security, and beyond. Knowledge and Information Systems, 67(3):2321–2356, 2025

    work page 2025

  13. [13]

    H. Chen, Y . Zhang, D. Krompass, J. Gu, and V . Tresp. Feddat: An approach for foundation model finetuning in multi-modal heterogeneous federated learning. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 11285–11293, 2024

    work page 2024

  14. [14]

    Chen and A

    J. Chen and A. Zhang. Fedmbridge: bridgeable multimodal federated learning. In Proceedings of the 41st International Conference on Machine Learning, ICML’24. JMLR.org, 2024

    work page 2024

  15. [15]

    Y . Chen, T. Li, H. Liu, and Y . Yu. Hide and seek (has): A lightweight framework for prompt privacy protection. arXiv preprint arXiv:2309.03057, 2023

    work page arXiv 2023

  16. [16]

    Collins, H

    L. Collins, H. Hassani, A. Mokhtari, and S. Shakkottai. Exploiting shared representations for personalized federated learning. In M. Meila and T. Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 2089–2099. PMLR, 18–24 Jul 2021. 10

    work page 2089

  17. [17]

    T. Cui, H. Li, J. Wang, and Y . Shi. Harmonizing generalization and personalization in federated prompt learning. In R. Salakhutdinov, Z. Kolter, K. Heller, A. Weller, N. Oliver, J. Scarlett, and F. Berkenkamp, editors,Proceedings of the 41st International Conference on Machine Learning, volume 235 of Proceedings of Machine Learning Research, pages 9646–9...

    work page 2024

  18. [18]

    Dhelim, N

    S. Dhelim, N. Aung, M. A. Bouras, H. Ning, and E. Cambria. A survey on personality-aware recommendation systems. Artificial Intelligence Review, pages 1–46, 2022

    work page 2022

  19. [19]

    An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

    A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020

    work page internal anchor Pith review Pith/arXiv arXiv 2010

  20. [20]

    C. Dwork. Differential privacy. In International colloquium on automata, languages, and programming, pages 1–12. Springer, 2006

    work page 2006

  21. [21]

    T. Fan, H. Gu, X. Cao, C. S. Chan, Q. Chen, Y . Chen, Y . Feng, Y . Gu, J. Geng, B. Luo, et al. Ten challenging problems in federated foundation models. IEEE Transactions on Knowledge and Data Engineering, 2025

    work page 2025

  22. [22]

    Galesic, D

    M. Galesic, D. Barkoczi, A. M. Berdahl, D. Biro, G. Carbone, I. Giannoccaro, R. L. Goldstone, C. Gonzalez, A. Kandler, A. B. Kao, R. Kendal, M. Kline, E. Lee, G. F. Massari, A. Mesoudi, H. Olsson, N. Pescetelli, S. J. Sloman, P. E. Smaldino, and D. L. Stein. Beyond collective intelligence: Collective adaptation. Journal of the Royal Society interface, 20(...

    work page 2023

  23. [23]

    Y . Gong, X. Ding, Y . Su, K. Shen, Z. Liu, and G. Zhang. An unified search and recommendation foundation model for cold-start scenario. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, pages 4595–4601, 2023

    work page 2023

  24. [24]

    J. Gu, Z. Han, S. Chen, A. Beirami, B. He, G. Zhang, R. Liao, Y . Qin, V . Tresp, and P. Torr. A systematic survey of prompt engineering on vision-language foundation models. arXiv preprint arXiv:2307.12980, 2023

    work page arXiv 2023

  25. [25]

    Z. He, W. Liu, W. Guo, J. Qin, Y . Zhang, Y . Hu, and R. Tang. A survey on user behavior modeling in recommender systems. arXiv preprint arXiv:2302.11087, 2023

    work page arXiv 2023

  26. [26]

    E. J. Hu, Y . Shen, P. Wallis, Z. Allen-Zhu, Y . Li, S. Wang, L. Wang, and W. Chen. Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685, 2021

    work page internal anchor Pith review Pith/arXiv arXiv 2021

  27. [27]

    L. Hu, Z. Liu, Z. Zhao, L. Hou, L. Nie, and J. Li. A survey of knowledge enhanced pre-trained language models. IEEE Transactions on Knowledge and Data Engineering, 36(4):1413–1430, 2023

    work page 2023

  28. [28]

    P. Jain, J. Rush, A. Smith, S. Song, and A. Guha Thakurta. Differentially private model personalization. Advances in Neural Information Processing Systems, 34:29723–29735, 2021

    work page 2021

  29. [29]

    Javeed, M

    D. Javeed, M. S. Saeed, P. Kumar, A. Jolfaei, S. Islam, and A. N. Islam. Federated learning- based personalized recommendation systems: An overview on security and privacy challenges. IEEE Transactions on Consumer Electronics, 70(1):2618–2627, 2023

    work page 2023

  30. [30]

    H. Ko, S. Lee, Y . Park, and A. Choi. A survey of recommendation systems: recommendation models, techniques, and application fields. Electronics, 11(1):141, 2022

    work page 2022

  31. [31]

    Li and J

    X. Li and J. Wang. Position paper: Assessing robustness, privacy, and fairness in federated learning integrated with foundation models. arXiv preprint arXiv:2402.01857, 2024

    work page arXiv 2024

  32. [32]

    Y . Li, H. Chen, S. Xu, Y . Ge, J. Tan, S. Liu, and Y . Zhang. Fairness in recommendation: Foun- dations, methods, and applications. ACM Transactions on Intelligent Systems and Technology, 14(5):1–48, 2023

    work page 2023

  33. [33]

    Z. Li, G. Long, J. Jiang, and C. Zhang. Personalized item representations in federated multimodal recommendation. arXiv preprint arXiv:2410.08478, 2024. 11

    work page arXiv 2024

  34. [34]

    Z. Li, G. Long, and T. Zhou. Federated recommendation with additive personalization. In ICLR, 2024

    work page 2024

  35. [35]

    Y . Lin, S. Han, H. Mao, Y . Wang, and W. J. Dally. Deep gradient compression: Reducing the communication bandwidth for distributed training. arXiv preprint arXiv:1712.01887, 2017

    work page arXiv 2017

  36. [36]

    P. Liu, L. Zhang, and J. A. Gulla. Pre-train, prompt, and recommendation: A comprehensive survey of language modeling paradigm adaptations in recommender systems. Transactions of the Association for Computational Linguistics, 11:1553–1571, 2023

    work page 2023

  37. [37]

    M Ghari and Y

    P. M Ghari and Y . Shen. Personalized federated learning with mixture of models for adap- tive prediction and model fine-tuning. Advances in Neural Information Processing Systems, 37:92155–92183, 2024

    work page 2024

  38. [38]

    S. C. Matz, R. E. Appel, and B. Croll. Privacy and ethics in the age of big data. 2022

    work page 2022

  39. [39]

    Mclaughlin and L

    C. Mclaughlin and L. Su. Personalized federated learning via feature distribution adaptation. Advances in Neural Information Processing Systems, 37:77038–77059, 2024

    work page 2024

  40. [40]

    McMahan, E

    B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, pages 1273–1282. PMLR, 2017

    work page 2017

  41. [41]

    X. Meng, S. Wang, K. Shu, J. Li, B. Chen, H. Liu, and Y . Zhang. Personalized privacy- preserving social recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32, 2018

    work page 2018

  42. [42]

    A. K. Mohankumar, P. Nema, S. Narasimhan, M. M. Khapra, B. V . Srinivasan, and B. Ravindran. Towards transparent and explainable attention models. arXiv preprint arXiv:2004.14243, 2020

    work page arXiv 2004

  43. [43]

    T. OpenAI. Chatgpt: Optimizing language models for dialogue. openai, 2022

    work page 2022

  44. [44]

    Purificato, L

    E. Purificato, L. Boratto, and E. W. De Luca. User modeling and user profiling: A comprehensive survey. arXiv preprint arXiv:2402.09660, 2024

    work page arXiv 2024

  45. [45]

    P. Qi, D. Chiaro, A. Guzzo, M. Ianni, G. Fortino, and F. Piccialli. Model aggregation techniques in federated learning: A comprehensive survey. Future Generation Computer Systems, 150:272– 293, 2024

    work page 2024

  46. [46]

    Z. Qiu, X. Wu, J. Gao, and W. Fan. U-bert: Pre-training user representations for improved recommendation. In AAAI, volume 35, pages 4320–4327, 2021

    work page 2021

  47. [47]

    Radford, J

    A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark, et al. Learning transferable visual models from natural language supervision. In ICML, pages 8748–8763. PMLR, 2021

    work page 2021

  48. [48]

    C. Ren, H. Yu, H. Peng, X. Tang, B. Zhao, L. Yi, A. Z. Tan, Y . Gao, A. Li, X. Li, et al. Advances and open challenges in federated foundation models. IEEE Communications Surveys & Tutorials, 2025

    work page 2025

  49. [49]

    Sieber, C

    J. Sieber, C. Amo Alonso, A. Didier, M. Zeilinger, and A. Orvieto. Understanding the differences in foundation models: Attention, state space models, and recurrent neural networks. Advances in Neural Information Processing Systems, 37:134534–134566, 2024

    work page 2024

  50. [50]

    Z. Sun, Y . Xu, Y . Liu, W. He, L. Kong, F. Wu, Y . Jiang, and L. Cui. A survey on federated recommendation systems. TNNLS, 2024

    work page 2024

  51. [51]

    A. Z. Tan, H. Yu, L. Cui, and Q. Yang. Towards personalized federated learning. IEEE Transactions on Neural Networks and Learning Systems, 34(12):9587–9603, 2023

    work page 2023

  52. [52]

    Tan and M

    Z. Tan and M. Jiang. User modeling in the era of large language models: Current research and future directions. arXiv preprint arXiv:2312.11518, 2023. 12

    work page arXiv 2023

  53. [53]

    Tariq, M

    A. Tariq, M. A. Serhani, F. M. Sallabi, E. S. Barka, T. Qayyum, H. M. Khater, and K. A. Shuaib. Trustworthy federated learning: A comprehensive review, architecture, key challenges, and future research prospects. IEEE Open Journal of the Communications Society, 2024

    work page 2024

  54. [54]

    Tkalcic and L

    M. Tkalcic and L. Chen. Personality and recommender systems. Recommender systems handbook, 54:715–739, 2015

    work page 2015

  55. [55]

    T. V . V o, A. Bhattacharyya, Y . Lee, and T.-Y . Leong. An adaptive kernel approach to federated learning of heterogeneous causal effects. Advances in Neural Information Processing Systems, 35:24459–24473, 2022

    work page 2022

  56. [56]

    V oigt and A

    P. V oigt and A. V on dem Bussche. The eu general data protection regulation (gdpr).A Practical Guide, 1st Ed., Cham: Springer International Publishing, 10(3152676):10–5555, 2017

    work page 2017

  57. [57]

    L. Wang, H. Zhou, Y . Bao, X. Yan, G. Shen, and X. Kong. Horizontal federated recommender system: A survey. ACM Computing Surveys, 56(9):1–42, 2024

    work page 2024

  58. [58]

    L. Wu, Z. Zheng, Z. Qiu, H. Wang, H. Gu, T. Shen, C. Qin, C. Zhu, H. Zhu, Q. Liu, et al. A survey on large language models for recommendation. arXiv preprint arXiv:2305.19860, 2023

    work page arXiv 2023

  59. [59]

    Y . Wu, C. Tian, J. Li, H. Sun, K. Tam, L. Li, and C. Xu. A survey on federated fine-tuning of large language models, 2025

    work page 2025

  60. [60]

    X. Xin, J. Yang, H. Wang, J. Ma, P. Ren, H. Luo, X. Shi, Z. Chen, and Z. Ren. On the user behavior leakage from recommender system exposure. ACM Transactions on Information Systems, 41(3):1–25, 2023

    work page 2023

  61. [61]

    M. Yang, J. Chen, Y . Zhang, J. Liu, J. Zhang, Q. Ma, H. Verma, Q. Zhang, M. Zhou, I. King, et al. Low-rank adaptation for foundation models: A comprehensive review. arXiv preprint arXiv:2501.00365, 2024

    work page arXiv 2024

  62. [62]

    Q. Yang, Y . Liu, T. Chen, and Y . Tong. Federated machine learning: Concept and applications. ACM Transactions on Intelligent Systems and Technology (TIST), 10(2):1–19, 2019

    work page 2019

  63. [63]

    Y . Yang, G. Long, T. Shen, J. Jiang, and M. Blumenstein. Dual-personalizing adapter for federated foundation models. In A. Globerson, L. Mackey, D. Belgrave, A. Fan, U. Paquet, J. Tomczak, and C. Zhang, editors, Advances in Neural Information Processing Systems , volume 37, pages 39409–39433. Curran Associates, Inc., 2024

    work page 2024

  64. [64]

    S. Yu, J. P. Muñoz, and A. Jannesari. Federated foundation models: Privacy-preserving and collaborative learning for large models. arXiv preprint arXiv:2305.11414, 2023

    work page arXiv 2023

  65. [65]

    Z. Yu, J. Lian, A. Mahmoody, G. Liu, and X. Xie. Adaptive user modeling with long and short-term preferences for personalized recommendation. In IJCAI, volume 7, pages 4213–4219, 2019

    work page 2019

  66. [66]

    B. Yuan, Y . He, J. Davis, T. Zhang, T. Dao, B. Chen, P. S. Liang, C. Re, and C. Zhang. Decentralized training of foundation models in heterogeneous environments. Advances in Neural Information Processing Systems, 35:25464–25477, 2022

    work page 2022

  67. [67]

    W. Yuan, L. Qu, L. Cui, Y . Tong, X. Zhou, and H. Yin. Hetefedrec: Federated recommender systems with model heterogeneity. In 2024 IEEE 40th International Conference on Data Engineering (ICDE), pages 1324–1337. IEEE, 2024

    work page 2024

  68. [68]

    Zhang, Z

    B. Zhang, Z. Liu, C. Cherry, and O. Firat. When scaling meets llm finetuning: The effect of data, model and finetuning method. arXiv preprint arXiv:2402.17193, 2024

    work page arXiv 2024

  69. [69]

    Zhang, G

    C. Zhang, G. Long, H. Guo, X. Fang, Y . Song, Z. Liu, G. Zhou, Z. Zhang, Y . Liu, and B. Yang. Federated adaptation for foundation model-based recommendations. arXiv preprint arXiv:2405.04840, 2024

    work page arXiv 2024

  70. [70]

    Zhang, G

    C. Zhang, G. Long, H. Guo, Z. Liu, G. Zhou, Z. Zhang, Y . Liu, and B. Yang. Multifaceted user modeling in recommendation: A federated foundation models approach. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 13197–13205, 2025. 13

    work page 2025

  71. [71]

    Zhang, G

    C. Zhang, G. Long, T. Zhou, P. Yan, Z. Zhang, C. Zhang, and B. Yang. Dual personalization on federated recommendation. In IJCAI, pages 4558–4566, 2023

    work page 2023

  72. [72]

    Zhang, G

    C. Zhang, G. Long, T. Zhou, Z. Zhang, P. Yan, and B. Yang. When federated recommendation meets cold-start problem: Separating item attributes and user interactions. In Proceedings of the ACM Web Conference 2024, pages 3632–3642, 2024

    work page 2024

  73. [73]

    Zhang, Y

    C. Zhang, Y . Xie, H. Bai, B. Yu, W. Li, and Y . Gao. A survey on federated learning. KBS, 216:106775, 2021

    work page 2021

  74. [74]

    Zhang, H

    H. Zhang, H. Liu, H. Li, and Y . Li. Transfr: Transferable federated recommendation with pre-trained language models. arXiv preprint arXiv:2402.01124, 2024

    work page arXiv 2024

  75. [75]

    Zhang, G

    L. Zhang, G. Li, L. Yuan, X. Ding, and Q. Rong. Hn3s: A federated autoencoder framework for collaborative filtering via hybrid negative sampling and secret sharing. Information Processing & Management, 61(2):103580, 2024

    work page 2024

  76. [76]

    Zhang, L

    S. Zhang, L. Yao, A. Sun, and Y . Tay. Deep learning based recommender system: A survey and new perspectives. ACM computing surveys (CSUR), 52(1):1–38, 2019

    work page 2019

  77. [77]

    L. Zhao, J. Jiang, B. Feng, Q. Wang, C. Shen, and Q. Li. Sear: Secure and efficient aggrega- tion for byzantine-robust federated learning. IEEE Transactions on Dependable and Secure Computing, 19(5):3329–3342, 2021

    work page 2021

  78. [78]

    X. Zhu, J. Li, Y . Liu, C. Ma, and W. Wang. A survey on model compression for large language models. Transactions of the Association for Computational Linguistics, 12:1556–1577, 2024

    work page 2024

  79. [79]

    Zhuang, C

    W. Zhuang, C. Chen, and L. Lyu. When foundation model meets federated learning: Motivations, challenges, and future directions. arXiv preprint arXiv:2306.15546, 2023. 14

    work page arXiv 2023