REVIEW 3 major objections 4 minor 194 references
Vision-Language Models for Edge Networks: A Comprehensive Survey
T0 review · 3 major / 4 minor · reviewed 2026-08-08 · deepseek-v4-flash
Pith's one-line read This survey claims that vision-language models can be efficiently moved from cloud data centers to edge devices through a coordinated cycle of compression, distributed training, and privacy-preserving deployment, and it sets out to map…
desk verdict A structurally useful survey undone by citation errors, circular self-citation, and a copied passage; reject in current form. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central organising object is the 'comprehensive cycle for extending VLMs from the cloud to the edge', presented as a six-step design process in Figure 6. Each step is a distinct category of methods: (1) data selection and pre-processing, (2) model choice across edge and cloud, (3) distributed implementation using federated learning with parent-child model partitioning, (4) post-processing and evaluation, (5) deployment and continuous learning, plus (0) the compression layer of pruning, quantization, and knowledge distillation that runs through the whole cycle. The survey also uses a three-part architecture distinction from the VLM literature (single-stream vs dual-stream encoders, plus fusion mechanisms) and a task taxonomy in Figure 8 (image-text, video-text, and vision-as-VL tasks). These frameworks carry the survey's argument because they turn scattered techniques into a checklist.
What would settle it
The 'comprehensive' claim would be falsified by finding an established edge-VLM method or a widely used lightweight VLM that the taxonomy omits; more concretely, a reader can check Table II and find that the identifier 2405.09215 is claimed for both Xmodel-VLM and ScreenAI, which means the survey's citation layer fails a basic consistency test.
Extended reading notes
Core claim
On the paper's own terms, the discovery is taxonomic: it identifies the load-bearing methods that make edge VLMs viable and arranges them into a deployable pipeline. The survey distinguishes general lightweight VLMs from edge-specific VLMs, presents the six-step design process of data selection, model choice, distributed implementation, post-processing and evaluation, and continuous learning, and catalogues eight open problem areas including compressed lightweight VLMs, context-aware models, cross-modality adaptation, security, privacy, and communication-efficient architectures. It also compiles a catalogue of concrete models (MobileVLM V2, EfficientVLM, MiniVLM, EdgeVL, Moondream2, and others) and applications in healthcare, environmental monitoring, autonomous driving, and surveillance. The paper's contribution is the claim that these pieces fit together into a single comprehensive cycle that researchers and engineers can follow.
Load-bearing premise
The whole survey rests on the assumption that the roughly two hundred works it cites are accurately described, correctly attributed, and representative of the field; the duplicate arXiv identifier in its own Table II shows that this assumption is not safe.
Editorial extensions
If this is right
- Practitioners get a structured checklist for taking a VLM to the edge: compress first, then decide edge vs cloud placement, then distribute training, then evaluate and deploy with continuous learning.
- Security and privacy are treated as first-class steps in the deployment cycle, not afterthoughts: differential privacy, homomorphic encryption, secure aggregation, and federated prompt learning are mapped to specific stages.
- The survey's taxonomy implies that general lightweight VLMs are not automatically edge-ready; edge-specific constraints such as energy budgets and on-device inference matter.
- The eight open challenges named by the survey, such as context-aware VLMs and communication-efficient distributed inference, mark the concrete gaps where future contributions are needed.
Reading between the lines
- Because the survey does not reproduce evaluation setups for the models it cites, its specific numbers (for instance accuracy gains or model sizes) should be verified against the primary sources before being used in design decisions.
- The survey's own Table II assigns the same arXiv identifier (2405.09215) to two different models, Xmodel-VLM and ScreenAI; that suggests the citation layer is not fully reliable and the map should be re-checked against primary literature.
- A natural extension would be a quantitative comparison benchmark that measures latency, memory, and energy of the surveyed compression methods on identical edge hardware; the survey itself provides no such head-to-head numbers.
- The privacy discussion points toward a testable design: a federated prompt-learning plus homomorphic-encryption combination for edge VLMs could be evaluated for accuracy loss and communication cost; the survey lists the ingredients but does not run that experiment.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript surveys vision-language models (VLMs) for edge networks, covering fundamentals, lightweight model designs, efficient fine-tuning methods, edge deployment challenges, applications, and open problems. It positions itself as a comprehensive treatment of the full cycle from cloud-based VLMs to edge deployment, and it provides a taxonomy together with comparison tables of existing surveys and lightweight VLM models.
Significance. If the survey's claims are trustworthy, the paper would be a useful entry point to a rapidly growing area, especially because of its organization around edge deployment (compression, federated learning, security and privacy) and its comparison of existing surveys. The paper is not a technical contribution with proofs or reproducible artifacts, but it does offer a structured taxonomy and broad literature coverage. However, the value of a survey is entirely dependent on the accuracy and provenance of its citations, and it is in this respect that the manuscript currently falls short.
major comments (3)
- [Table II and References [52], [53], [54], [59]] Duplicate arXiv identifiers are assigned to different models: [53] (Xmodel-VLM) and [59] (ScreenAI) both list arXiv:2405.09215, and [52] (LightVLP) and [54] (EM-VLM4AD) both list arXiv:2403.19838. Since an arXiv ID uniquely identifies one paper, at least two of these entries are necessarily wrong, and the reader cannot determine which technique belongs to which model. This directly undermines the survey's promise of accurate representation of prior work and must be corrected for every entry in Table II.
- [Section IV.A, Bilingual Medical Mixture LLM paragraph] The paragraph describing BiMediX is written in the first person ('We developed a semi-automated English-to-Arabic translation pipeline...') and closely matches the abstract of reference [136] without quotation or explicit attribution. This is not an original synthesis by the survey authors; it is an apparent verbatim reuse of the primary paper's wording. The passage must be rewritten as a third-person description with appropriate citation, or the manuscript cannot be considered a reliable secondary source.
- [Section V.B, discussion of dynamic inference and model scaling] The discussion of dynamic inference and model scaling cites reference [168], which is the survey itself, as the sole support for several claims (e.g., the problems of limited computational resources and unpredictable latency, and the mitigation via modular architectures and resource-aware scheduling). Using one's own survey to support one's own recommendations is circular and provides no external evidence. These claims need to be supported by actual prior work, and the self-citation should be removed.
minor comments (4)
- [Reference [7]] The reference points to a 'consensus.app' URL with a 'utm_source=chatgpt' tracking parameter; this is not a proper scholarly citation and should be replaced with the arXiv identifier of the underlying paper (arXiv:2309.16739).
- [Section II.C] There are numerous typographical and formatting errors, including 'comparision' in the opening sentence and inconsistent spacing around model names (e.g., 'RA VEN', 'ALLaV A').
- [Figure 1] The figure contains several misspellings: 'Survelliance', 'Heatlhcare', and 'Sem-supervised learning' instead of 'Semi-supervised learning'; these should be corrected.
- [Reference [54]] The author attribution for EM-VLM4AD is given as 'Z. Wu et al.' in reference [54], but the same paper is correctly attributed to Gopalkrishnan, Greer, and Trivedi in reference [175]; the metadata should be reconciled.
Circularity Check
One load-bearing self-citation in Section V.B; the survey's central synthesis otherwise rests on external sources, though citation-integrity errors weaken its comprehensiveness claim.
-
self citation load bearing
[Section V.B, 'Problems in Model Optimization for Edge Networks' (Open Challenges)]
"Dynamic inference, which adjusts model complexity at runtime based on available resources, faces critical issues, including limited computational resources and unpredictable latency, adversely impacting real-time performance [168]. These can be mitigated through modular architectures that selectively activate model components depending on resource availability and by employing resource-aware scheduling algorithms for effective real-time adjustments [168]."
Reference [168] in the bibliography is this paper itself: 'A. Sharshar, L. U. Khan, W. Ullah, and M. Guizani, Vision-language models for edge networks: A comprehensive survey, arXiv preprint arXiv:2502.07855, 2025.' The paper's own open-challenge section therefore cites the same document as the authority for the claimed problems of dynamic inference and model scaling and for the proposed mitigations (modular architectures, resource-aware scheduling, federated learning). There is no external, independently verifiable source for these load-bearing statements; the support chain reduces to the survey asserting its own conclusions.
full rationale
This is a survey paper with no mathematical derivation chain or quantitative predictions, so the circularity analysis focuses on the self-support structure of its claims. The only clear circular step is in Section V.B, where the open-challenge discussion of dynamic inference and model scaling is cited to reference [168], which is the present arXiv paper itself (same authors and title). That makes the paper's recommended mitigations self-referential: the survey is its own source for the very claims it uses to define open problems. This is not a minor or ornamental citation; it is the sole support for the dynamic-inference problem statement and mitigation. However, the paper's central claim of being a comprehensive survey does not reduce to this self-citation. Most sections, including fundamentals, compression, federated learning, applications, security, and privacy, are supported by a broad set of external references, and the organization and comparison tables are independent editorial content. I therefore score 4 rather than 6-8. The manuscript also contains serious citation-integrity problems that are not circularity but affect trustworthiness: Table II and the reference list assign arXiv:2403.19838 to both LightVLP [52] and EM-VLM4AD [54], and arXiv:2405.09215 to both Xmodel-VLM [53] and ScreenAI [59]; one arXiv ID cannot identify two different papers, so the model comparison in Table II cannot be reliably traced. In addition, Section IV.A's 'Bilingual Medical Mixture LLM' passage is written in the first person ('We developed a semi-automated English-to-Arabic translation pipeline...') and closely matches the abstract of BiMediX [136] without quotation or attribution, so part of the survey text is not demonstrably the authors' own synthesis. These failures undermine the advertised comprehensiveness and verifiability, but they are not reduction-by-construction circularity; they are weighed here as aggravating evidence about the reliability of the reference base.
Assumptions & free parameters
assumptions (2)
- domain assumption Cited references accurately support the statements made in the survey.
- domain assumption The survey's taxonomy and paper selection are representative of the field.
Cite this review
Pith. "Pith review of Vision-Language Models for Edge Networks: A Comprehensive Survey." pith.science (2026). https://pith.science/paper/CMX4TGQT
@misc{pith2026250207855,
author = {Pith},
title = {Pith review of: Vision-Language Models for Edge Networks: A Comprehensive Survey},
year = {2026},
howpublished = {\url{https://pith.science/paper/CMX4TGQT}},
note = {Machine review of arXiv:2502.07855}
}
read the original abstract
Vision Large Language Models (VLMs) combine visual understanding with natural language processing, enabling tasks like image captioning, visual question answering, and video analysis. While VLMs show impressive capabilities across domains such as autonomous vehicles, smart surveillance, and healthcare, their deployment on resource-constrained edge devices remains challenging due to processing power, memory, and energy limitations. This survey explores recent advancements in optimizing VLMs for edge environments, focusing on model compression techniques, including pruning, quantization, knowledge distillation, and specialized hardware solutions that enhance efficiency. We provide a detailed discussion of efficient training and fine-tuning methods, edge deployment challenges, and privacy considerations. Additionally, we discuss the diverse applications of lightweight VLMs across healthcare, environmental monitoring, and autonomous systems, illustrating their growing impact. By highlighting key design strategies, current challenges, and offering recommendations for future directions, this survey aims to inspire further research into the practical deployment of VLMs, ultimately making advanced AI accessible in resource-limited settings.
Figures
Figures from the paper (5 more)
Reference graph
Works this paper leans on
-
[59]
Screenai: A vision-language model for ui and infographics understanding,
G. AI, “Screenai: A vision-language model for ui and infographics understanding,”arXiv, 2024, arXiv:2405.09215
arXiv 2024
-
[168]
Vision- language models for edge networks: A comprehensive survey,
A. Sharshar, L. U. Khan, W. Ullah, and M. Guizani, “Vision- language models for edge networks: A comprehensive survey,” arXiv preprint arXiv:2502.07855, 2025. [Online]. Available: https: //arxiv.org/html/2502.07855v1
arXiv 2025
-
[136]
Bimedix: Bilingual medical mixture of experts llm,
S. Pieri, S. S. Mullappilly, F. S. Khan, R. M. Anwer, S. Khan, T. Baldwin, and H. Cholakkal, “Bimedix: Bilingual medical mixture of experts llm,” 2024. [Online]. Available: https://arxiv.org/abs/2402. 13253
2024
-
[2]
Oscar: Object-semantics aligned pre-training for vision-language tasks,
X. Li, X. Yin, C. Li, X. Hu, P. Zhang, L. Wang, H. Hu, L. Dong, F. Wei, Y . Choiet al., “Oscar: Object-semantics aligned pre-training for vision-language tasks,” inEuropean Conference on Computer Vision. Springer, 2020, pp. 121–137
2020
-
[3]
Vilt: Vision-and-language transformer without convolution or region supervision,
W. Kim, B. Son, and I. Kim, “Vilt: Vision-and-language transformer without convolution or region supervision,” inInternational Conference on Machine Learning. PMLR, 2021, pp. 5583–5594
2021
-
[4]
Edge intelligence empowered vehicular metaverse: Key design aspects and future directions,
L. U. Khan, A. Elhagry, M. Guizani, and A. El Saddik, “Edge intelligence empowered vehicular metaverse: Key design aspects and future directions,”IEEE Internet of Things Magazine, vol. 7, no. 1, pp. 120–126, 2024
2024
-
[5]
Edge ai: On-demand accelerating deep neural network inference via edge computing,
H. Li, K. Li, Z. Yang, Y . Guo, W. Yu, and W. Dai, “Edge ai: On-demand accelerating deep neural network inference via edge computing,”IEEE Transactions on Wireless Communications, vol. 19, no. 1, pp. 144–156, 2019
2019
-
[6]
Lite trans- former with long-short range attention,
F. Wu, A. Fan, A. Baevski, Y . Dauphin, and M. Auli, “Lite trans- former with long-short range attention,” inInternational Conference on Learning Representations, 2020
2020
Show all 194 references
-
[8]
Efficientvlm: Fast and accurate vision-language models via knowledge distillation and modal-adaptive pruning,
T. Wang, W. Zhou, Y . Zeng, and X. Zhang, “Efficientvlm: Fast and accurate vision-language models via knowledge distillation and modal-adaptive pruning,”arXiv preprint arXiv:2210.07795, 2022. [Online]. Available: https://arxiv.org/abs/2210.07795
2022 arXiv
-
[10]
Quantization and training of neural networks for effi- cient integer-arithmetic-only inference,
B. Jacob, S. Kligys, B. Chen, M. Zhu, M. Tang, A. Howard, B. Steiner, and J. Rolfe, “Quantization and training of neural networks for effi- cient integer-arithmetic-only inference,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 2704–2713
2018
-
[12]
Efficient processing of deep neural networks: A tutorial and survey,
V . Sze, Y .-H. Chen, T.-J. Yang, and J. S. Emer, “Efficient processing of deep neural networks: A tutorial and survey,”Proceedings of the IEEE, vol. 105, no. 12, pp. 2295–2329, 2017
2017
-
[13]
Edge tpu: State-of-the-art ai at the edge,
V . J. Reddi, N. Jeffries, K. Panchapakesan, R. Jain, P. Pabla, R. Mehta, P. Narkhede, and D. Kanter, “Edge tpu: State-of-the-art ai at the edge,” arXiv preprint arXiv:2005.04268, 2020
2005 arXiv
-
[14]
Deep learning for autonomous driving: Techniques and applications,
C. Chen, Q. Chen, L. Jin, and G. Hua, “Deep learning for autonomous driving: Techniques and applications,”IEEE Transactions on Intelligent Transportation Systems, vol. 21, no. 1, pp. 291–306, 2019
2019
-
[15]
Real-time human activity recognition with miniaturized wearable sensors using deep learning,
Z. Wang, B. Yang, C. Xie, D. Xie, and K. Liu, “Real-time human activity recognition with miniaturized wearable sensors using deep learning,”Sensors, vol. 20, no. 12, p. 3456, 2020
2020
-
[16]
Efficientnetv2: Smaller models and faster training,
M. Tan and Q. V . Le, “Efficientnetv2: Smaller models and faster training,”arXiv preprint arXiv:2104.00298, 2021
2021 arXiv
-
[17]
Can deep learning revolutionize mobile sensing?
N. D. Lane, S. Bhattacharya, A. Mathur, P. Georgiev, C. Forlivesi, F. Kawsar, S. Mirri, F. Antonelli, and R. Tesoriero, “Can deep learning revolutionize mobile sensing?”Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications, pp. 117– 122, 2015
2015
-
[18]
In-datacenter performance analysis of a tensor processing unit,
N. P. Jouppi, C. Young, N. Patil, D. Patterson, G. Agrawal, R. Bajwa, S. Bates, S. Bhatia, N. Boden, A. Borcherset al., “In-datacenter performance analysis of a tensor processing unit,”Proceedings of the 44th Annual International Symposium on Computer Architecture, pp. 1–12, 2017
2017
-
[19]
Language mod- els are few-shot learners,
T. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askellet al., “Language mod- els are few-shot learners,”Advances in neural information processing systems, vol. 33, pp. 1877–1901, 2020
1901
-
[20]
Learning transferable visual models from natural language supervision,
A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clarket al., “Learning transferable visual models from natural language supervision,”Proceedings of the International Conference on Machine Learning, pp. 8748–8763, 2021
2021
-
[21]
Internet of things (iot) for next-generation smart systems: A review of current challenges, future trends and prospects for emerging 5g-iot scenarios,
A. Zanella and N. Bui, “Internet of things (iot) for next-generation smart systems: A review of current challenges, future trends and prospects for emerging 5g-iot scenarios,”IEEE Internet of Things Journal, vol. 7, no. 5, p. 8972389, 2020
2020
-
[22]
Hardware acceleration for machine learning inference on edge devices: A review,
J. Zhang, L. De Glossi, S. Eilers, and S. Kohlbrecher, “Hardware acceleration for machine learning inference on edge devices: A review,” IEEE Access, vol. 8, pp. 82 554–82 566, 2020
2020
-
[23]
Cloud and edge computing for deep learning applications,
L. Chen, K. Wang, X. Tian, T. Su, and W. Li, “Cloud and edge computing for deep learning applications,”IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 5, pp. 1719–1734, 2021
2021
-
[24]
Mnasnet: Platform-aware neural architecture search for mobile,
M. Tan, B. Chen, R. Pang, V . Vasudevan, M. Sandler, A. Howard, and Q. V . Le, “Mnasnet: Platform-aware neural architecture search for mobile,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019, pp. 2820–2828
2019
-
[25]
Slimmable neural networks,
J. Yu and T. Huang, “Slimmable neural networks,”arXiv preprint arXiv:1812.08928, 2019
2019 arXiv
-
[26]
Attention is all you need,
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, . Kaiser, and I. Polosukhin, “Attention is all you need,” in Advances in Neural Information Processing Systems, 2017, pp. 5998– 6008
2017
-
[27]
Transformer-based model for text classification and question answering,
T. Chen, Z. Zhang, S. Zhang, Q. Xu, and Y . Ma, “Transformer-based model for text classification and question answering,”IEEE Access, vol. 8, pp. 160 543–160 552, 2020
2020
-
[28]
Squeeze-and-excitation networks,
J. Hu, L. Shen, and G. Sun, “Squeeze-and-excitation networks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 7132–7141
2018
-
[29]
Searching for mobilenetv3,
A. Howard, M. Sandler, G. Chu, L.-C. Chen, B. Chen, M. Tan, W. Wang, Y . Zhu, R. Pang, V . Vasudevanet al., “Searching for mobilenetv3,” inProceedings of the IEEE International Conference on Computer Vision, 2019, pp. 1314–1324
2019
-
[30]
Dermatologist-level classification of skin cancer with deep neural networks,
A. Esteva, B. Kuprel, R. A. Novoa, J. Ko, S. M. Swetter, H. M. Blau, and S. Thrun, “Dermatologist-level classification of skin cancer with deep neural networks,”Nature, vol. 542, pp. 115–118, 2017
2017
-
[31]
High-performance medicine: The convergence of human and artificial intelligence,
E. J. Topol, “High-performance medicine: The convergence of human and artificial intelligence,”Nature Medicine, vol. 25, no. 1, pp. 44–56, 2019
2019
-
[32]
Faster r-cnn: Towards real- time object detection with region proposal networks,
S. Ren, K. He, R. Girshick, and J. Sun, “Faster r-cnn: Towards real- time object detection with region proposal networks,” inAdvances in Neural Information Processing Systems, 2015, pp. 91–99
2015
-
[33]
Ssd: Single shot multibox detector,
W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y . Fu, and A. C. Berg, “Ssd: Single shot multibox detector,”Proceedings of the European Conference on Computer Vision, pp. 21–37, 2016
2016
-
[34]
A survey of vision- language pre-trained models,
Y . Du, Z. Liu, J. Li, and W. X. Zhao, “A survey of vision- language pre-trained models,” inProceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22, L. D. Raedt, Ed. International Joint Conferences on Artificial Intelligence Organiza...
2022 doi
-
[35]
Vision-language intelligence: Tasks, representation learning, and large models,
F. Li, H. Zhang, Y .-F. Zhang, S. Liu, J. Guo, L. M. Ni, P. Zhang, and L. Zhang, “Vision-language intelligence: Tasks, representation learning, and large models,” 2022. [Online]. Available: https://arxiv.org/abs/2203.01922
2022 arXiv
-
[36]
A survey of efficient fine-tuning methods for vision-language models prompt and adapter,
J. Xing, J. Liu, J. Wang, L. Sun, X. Chen, X. Gu, and Y . Wang, “A survey of efficient fine-tuning methods for vision-language models prompt and adapter,”Computers & Graphics, vol. 119, p. 103885, 2024. [Online]. Available: https://www.sciencedirect.com/ science/article/pii/S0...
2024
-
[37]
Exploring the frontier of vision-language models: A survey of current methodologies and future directions,
A. Ghosh, A. Acharya, S. Saha, V . Jain, and A. Chadha, “Exploring the frontier of vision-language models: A survey of current methodologies and future directions,” 2024. [Online]. Available: https://arxiv.org/abs/2404.07214
2024
-
[38]
Vision-language models for vision tasks: A survey,
J. Zhang, J. Huang, S. Jin, and S. Lu, “Vision-language models for vision tasks: A survey,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 46, no. 8, pp. 5625–5644, 2024
2024
-
[39]
A survey on multimodal large language models for autonomous driving,
C. Cui, Y . Ma, X. Cao, W. Ye, Y . Zhou, K. Liang, J. Chen, J. Lu, Z. Yang, K.-D. Liao, T. Gao, E. Li, K. Tang, Z. Cao, T. Zhou, A. Liu, X. Yan, S. Mei, J. Cao, Z. Wang, and C. Zheng, “A survey on multimodal large language models for autonomous driving,” pp. 958–979, 2024
2024
-
[40]
A survey on multimodal large language models,
S. Yin, C. Fu, S. Zhao, K. Li, X. Sun, T. Xu, and E. Chen, “A survey on multimodal large language models,” 2024. [Online]. Available: https://arxiv.org/abs/2306.13549
2024 arXiv
-
[42]
Artificial intelligence market by offering, technology, end-user industry and geography - global forecast to 2026,
MarketsandMarkets, “Artificial intelligence market by offering, technology, end-user industry and geography - global forecast to 2026,” 2021, accessed: 2024-07-16. [On- line]. Available: https://www.marketsandmarkets.com/Market-Reports/ artificial-intelligence-market-74851580.html
2026
-
[43]
Design choices for vision language models in 2024,
T. Gigant, “Design choices for vision language models in 2024,” Hugging Face, 2024. [Online]. Available: https://huggingface.co/blog/ vision-language-models
2024
-
[44]
Edge ai hardware market by device type, processor type, end user, and application: Global opportunity analysis and industry forecast, 20182025,
Allied Market Research, “Edge ai hardware market by device type, processor type, end user, and application: Global opportunity analysis and industry forecast, 20182025,” 2020, accessed: 2024- 07-16. [Online]. Available: https://www.alliedmarketresearch.com/ edge-ai-hardware-market
2020
-
[45]
Attention is all you need,
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,”arXiv preprint arXiv:1706.03762, 2017
2017 arXiv
-
[46]
An image is worth 16x16 words: Transformers for image recognition at scale,
A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gellyet al., “An image is worth 16x16 words: Transformers for image recognition at scale,”arXiv preprint arXiv:2010.11929, 2020
2010 arXiv
-
[47]
Visual- bert: A simple and performant baseline for vision and language,
L. H. Li, M. Yatskar, D. Yin, C.-J. Hsieh, and K.-W. Chang, “Visual- bert: A simple and performant baseline for vision and language,”arXiv preprint arXiv:1908.03557, 2019
1908 arXiv
-
[48]
Vl-bert: Pre-training of generic visual-linguistic representations,
W. Su, X. Zhu, Y . Cao, B. Li, L. Lu, F. Wei, and J. Dai, “Vl-bert: Pre-training of generic visual-linguistic representations,”arXiv preprint arXiv:1908.08530, 2019
1908 arXiv
-
[49]
Vilt: Vision-and-language trans- former without convolution or region supervision,
W. Kim, B. Son, and I. Kim, “Vilt: Vision-and-language trans- former without convolution or region supervision,”arXiv preprint arXiv:2102.03334, 2021
2021 arXiv
-
[50]
Mobilevlm v2: Faster and stronger baseline for vision language model,
J. Liuet al., “Mobilevlm v2: Faster and stronger baseline for vision language model,”arXiv, 2024, arXiv:2402.03766
2024 arXiv
-
[51]
Unified-io: A unified model for vision, language, and multi-modal tasks,
J. Lu, C. Clark, R. Zellers, R. Mottaghi, and A. Kembhavi, “Unified-io: A unified model for vision, language, and multi-modal tasks,” 2022. [Online]. Available: https://arxiv.org/abs/2206.08916
2022 arXiv
-
[55]
Vitamin: Designing scalable vision models in the vision-language era,
J. Chen, Q. Yu, X. Shen, A. Yuille, and L.-C. Chen, “Vitamin: Designing scalable vision models in the vision-language era,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2024, pp. 12 954–12 966
2024
-
[56]
Driving with language: Introducing wayves multimodal driving model lingo-2,
W. AI, “Driving with language: Introducing wayves multimodal driving model lingo-2,”Wayve, 2024, available: https://wayve.ai/blog/lingo-2
2024
-
[57]
Instructblip: Towards general-purpose vision-language models with instruction tuning,
W. Dai, J. Li, D. Liet al., “Instructblip: Towards general-purpose vision-language models with instruction tuning,”OpenReview, 2024, available: https://openreview.net/forum?id=vvoWPYqZJA
2024
-
[58]
Raven: Multitask retrieval augmented vision-language learning,
R. Kumaret al., “Raven: Multitask retrieval augmented vision-language learning,”arXiv, 2024, arXiv:2406.19150
2024 arXiv
-
[60]
Allava: Harnessing gpt4v-synthesized data for lite vision-language models,
G. H. Chen, S. Chen, R. Zhang, J. Chen, X. Wu, Z. Zhang, Z. Chen, J. Li, X. Wan, and B. Wang, “Allava: Harnessing gpt4v-synthesized data for lite vision-language models,” 2024. [Online]. Available: https://arxiv.org/abs/2402.11684
2024 arXiv
-
[62]
Learning transferable visual models from natural language supervision,
A. Radford, J. W. Kim, K. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clarket al., “Learning transferable visual models from natural language supervision,”arXiv preprint arXiv:2103.00020, 2021
2021 arXiv
-
[63]
Vilbert: Pretraining task- agnostic visiolinguistic representations for vision-and-language tasks,
J. Lu, D. Batra, D. Parikh, and S. Lee, “Vilbert: Pretraining task- agnostic visiolinguistic representations for vision-and-language tasks,” arXiv preprint arXiv:1908.02265, 2019
1908 arXiv
-
[64]
Lxmert: Learning cross-modality encoder representations from transformers,
H. Tan and M. Bansal, “Lxmert: Learning cross-modality encoder representations from transformers,”arXiv preprint arXiv:1908.07490, 2019
1908 arXiv
-
[65]
Apollo: Unified adapter and prompt learning for vision language models,
S. Chowdhury, S. Nag, and D. Manocha, “Apollo: Unified adapter and prompt learning for vision language models,”arXiv preprint arXiv:2304.07356, 2023
2023 arXiv
-
[67]
Conditional prompt learning for vision-language models,
——, “Conditional prompt learning for vision-language models,”arXiv preprint arXiv:2109.01134, 2022
2022 arXiv
-
[68]
The power of scale for parameter-efficient prompt tuning,
B. Lester, R. Al-Rfou, and N. Constant, “The power of scale for parameter-efficient prompt tuning,”arXiv preprint arXiv:2104.08691, 2021
2021 arXiv
-
[69]
P- tuning v2: Prompt tuning can be comparable to fine-tuning universally across scales and tasks,
X. Liu, Y . Zheng, Z. Du, M. Ding, Y . Qian, Z. Yang, and J. Tang, “P- tuning v2: Prompt tuning can be comparable to fine-tuning universally across scales and tasks,”arXiv preprint arXiv:2110.07602, 2021
2021 arXiv
-
[70]
Denseclip: Language-guided dense prediction with context-aware prompting,
Y . Rao, W. Zhao, G. Chen, Y . Tang, Z. Zhu, G. Huang, and H. Li, “Denseclip: Language-guided dense prediction with context-aware prompting,”arXiv preprint arXiv:2112.01518, 2022
2022 arXiv
-
[71]
Proda: Prompt distribution learning for efficient and effective fine-tuning of pre-trained models,
R. Wang, R. He, B. Xu, J. Lin, H. Shi, W. Liu, Z. Zeng, J. Ma, and Y . Chen, “Proda: Prompt distribution learning for efficient and effective fine-tuning of pre-trained models,”arXiv preprint arXiv:2111.12434, 2021
2021 arXiv
-
[72]
Parameter-efficient transfer learning for nlp,
N. Houlsby, A. Giurgiu, S. Jastrzebski, B. Morrone, Q. de Laroussilhe, A. Gesmundo, M. Attariyan, and S. Gelly, “Parameter-efficient transfer learning for nlp,”arXiv preprint arXiv:1902.00751, 2019
1902 arXiv
-
[73]
Lora: Low-rank adaptation of large language models,
E. Hu, Y . Shen, P. Wallis, Z. Allen-Zhu, Y . Li, L. Wang, and W. Chen, “Lora: Low-rank adaptation of large language models,”arXiv preprint arXiv:2106.09685, 2021
2021 arXiv
-
[74]
Adapterfusion: Non-destructive task composition for transfer learn- ing,
J. Pfeiffer, A. Rckl, A. Kamath, K. Cho, I. Gurevych, and S. Ruder, “Adapterfusion: Non-destructive task composition for transfer learn- ing,”arXiv preprint arXiv:2005.00247, 2021
2005 arXiv
-
[75]
Vl-adapter: Parameter-efficient transfer learning for vision-and-language tasks,
W. Sung, J. Cho, and M. Bansal, “Vl-adapter: Parameter-efficient transfer learning for vision-and-language tasks,”arXiv preprint arXiv:2106.01558, 2021
2021 arXiv
-
[76]
Clip-adapter: Better vision-language models with feature adapters,
P. Gao, S. Geng, R. Zhang, T. Ma, R. Fang, Y . Zhang, H. Li, Y . Xu, X. Zhu, and J. Dai, “Clip-adapter: Better vision-language models with feature adapters,”International Journal of Computer Vision, 2021
2021
-
[77]
Self-adapting large visual-language models to edge devices across visual modalities,
K. Cai, Z. Duan, G. Liu, C. Fleming, and C. X. Lu, “Self-adapting large visual-language models to edge devices across visual modalities,”
-
[78]
Resource optimized network virtualization empowered metaverse for wireless networks,
L. U. Khan, M. Guizani, C.-D. Wang, and D. Wu, “Resource optimized network virtualization empowered metaverse for wireless networks,” in ICC 2024-IEEE International Conference on Communications. IEEE, 2024, pp. 4251–4256
2024
-
[79]
Survey on intelligence edge computing in 6g: characteristics, challenges, potential use cases, and market drivers,
A. Al-Ansi, A. Al-Ansi, A. Muthanna, I. Elgendy, and A. Kouch- eryavy, “Survey on intelligence edge computing in 6g: characteristics, challenges, potential use cases, and market drivers,”Future Internet, vol. 13, no. 5, p. 118, 2021
2021
-
[80]
Authentication in mobile cloud computing: a survey,
M. Alizadeh, S. Abolfazli, M. Zamani, S. Baaaharun, and K. Sakurai, “Authentication in mobile cloud computing: a survey,”Journal of Network and Computer Applications, vol. 61, pp. 59–80, 2016
2016
-
[81]
Karthikeyan and M
P. Karthikeyan and M. Thangavel,Applications of security, mobile, analytic and cloud (SMAC) technologies for effective information processing and management. Springer, 2019
2019
-
[82]
Edge cloud computing technologies for internet of things: a primer,
T. Shiyun, “Edge cloud computing technologies for internet of things: a primer,”IEEE Access, 2021
2021
-
[83]
Sdn enhanced multi-access edge computing (mec) for e2e mobility and qos management,
S. Shah, M. Gregory, S. Li, and R. Fontes, “Sdn enhanced multi-access edge computing (mec) for e2e mobility and qos management,”IEEE Access, vol. 8, pp. 77 459–77 469, 2020
2020
-
[84]
Edge computing security: state of the art and challenges,
Y . Xiao, Y . Jia, C. Liu, X. Cheng, J. Yu, and W. Lv, “Edge computing security: state of the art and challenges,”Proceedings of the IEEE, vol. 107, no. 8, pp. 1608–1631, 2019
2019
-
[85]
Efficient prompting for llm-based generative internet of things,
B. Xiao, B. Kantarci, J. Kang, D. Niyato, and M. Guizani, “Efficient prompting for llm-based generative internet of things,” arXiv preprint arXiv:2406.10382, 2024. [Online]. Available: https: //arxiv.org/abs/2406.10382
2024 arXiv
-
[86]
Llmind: Orchestrating ai and iot with llm for complex task execution,
H. Cui, Y . Du, Q. Yang, Y . Shao, and S. C. Liew, “Llmind: Orchestrating ai and iot with llm for complex task execution,” arXiv preprint arXiv:2312.09007, 2024. [Online]. Available: https: //arxiv.org/abs/2312.09007
2024 arXiv
-
[87]
Self-adapting large visual-language models to edge devices across visual modalities,
K. Cai, Z. Duan, G. Liu, C. Fleming, and C. X. Lu, “Self-adapting large visual-language models to edge devices across visual modalities,”arXiv preprint arXiv:2403.04908, 2024
2024 arXiv
-
[88]
Minivlm: A smaller and faster vision-language model,
J. Wang, X. Hu, P. Zhang, X. Li, L. Wang, L. Zhang, J. Gao, and Z. Liu, “Minivlm: A smaller and faster vision-language model,”arXiv preprint arXiv:2012.06946, 2020
2012 arXiv
-
[89]
Lightvlp: A lightweight vision-language pre-training via gated interactive masked autoencoders,
Y . Xu, L. Wang, J. Chen, J. Wang, P. Zhang, and Z. Liu, “Lightvlp: A lightweight vision-language pre-training via gated interactive masked autoencoders,” inProceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition (CVPR), 2023
2023
-
[90]
Tiny vlms bring ai text plus image vision to the edge,
Anonymous, “Tiny vlms bring ai text plus image vision to the edge,” TechHQ, 2024, https://techhq.com
2024
-
[91]
Vila: On pre-training for visual language models,
J. Lin, H. Yin, W. Ping, Y . Lu, P. Molchanov, A. Tao, H. Mao, J. Kautz, M. Shoeybi, and S. Han, “Vila: On pre-training for visual language models,” 2024. [Online]. Available: https://arxiv.org/abs/2312.07533
2024 arXiv
-
[92]
Edge-llm: Enabling efficient large language model adaptation on edge devices,
Z. Yu, Z. Wang, Y . Li, H. You, R. Gao, X. Zhou, S. R. Bommu, Y . K. Zhao, and Y . C. Lin, “Edge-llm: Enabling efficient large language model adaptation on edge devices,”arXiv preprint arXiv:2406.15758, 2024
2024 arXiv
-
[93]
Patch slimming for efficient vision transformers,
Y . Tang, K. Han, Y . Wang, C. Xu, J. Guo, C. Xu, and D. Tao, “Patch slimming for efficient vision transformers,” 2022. [Online]. Available: https://arxiv.org/abs/2106.02852
2022 arXiv
-
[94]
Data selection for efficient model update in federated learning,
L. Shi and V . Radu, “Data selection for efficient model update in federated learning,”arXiv preprint, vol. arXiv:2111.03512, 2021. [Online]. Available: https://arxiv.org/abs/2111.03512
2021 arXiv
-
[95]
A systematic literature review on the use of federated learning and bioinspired computing,
R. M. de Souza, A. Holm, M. Biczyk, and L. N. de Castro, “A systematic literature review on the use of federated learning and bioinspired computing,”Electronics, vol. 13, no. 16, p. 3157, 2024. [Online]. Available: https://www.mdpi.com/2079-9292/13/16/3157
2024
-
[96]
Enhancing edge-assisted federated learning with asynchronous aggregation and cluster pairing,
X. Sha, W. Sun, X. Liu, Y . Luo, and C. Luo, “Enhancing edge-assisted federated learning with asynchronous aggregation and cluster pairing,” Electronics, vol. 13, no. 11, p. 2135, 2024. [Online]. Available: https://www.mdpi.com/2079-9292/13/11/2135
2024
-
[97]
A multi-dimensional reverse auction mechanism for volatile federated learning in the mobile edge computing systems,
Y . Hong, Z. Zheng, and Z. Wang, “A multi-dimensional reverse auction mechanism for volatile federated learning in the mobile edge computing systems,”Electronics, vol. 13, no. 16, p. 3154, 2024. [Online]. Available: https://www.mdpi.com/2079-9292/13/16/3154
2024
-
[98]
Mobilenets: Efficient convolutional neural networks for mobile vision applications,
A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, “Mobilenets: Efficient convolutional neural networks for mobile vision applications,” arXiv preprint, vol. arXiv:1704.04861, 2017. [Online]. Available: https://arxiv.org/abs/1704.04861
2017 arXiv
-
[99]
Mobilenetv2: Inverted residuals and linear bottlenecks,
M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, “Mobilenetv2: Inverted residuals and linear bottlenecks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018, pp. 4510–4520. [Online]. Avail- able: https://openaccess.thecvf...
2018
-
[100]
Deep residual learning for image recognition,
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 770–778. [Online]. Available: https://openaccess.thecvf.com/content cvpr 2016/ html/He Deep Re...
2016
-
[101]
Bert: Pre-training of deep bidirectional transformers for language understanding,
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2019, pp. 4171–41...
2019
-
[102]
Quantization and training of neural networks for efficient integer-arithmetic-only inference,
B. Jacob, S. Kligys, B. Chen, M. Zhu, M. Tang, A. Howard, H. Adam, and D. Kalenichenko, “Quantization and training of neural networks for efficient integer-arithmetic-only inference,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018,...
2018
-
[103]
Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding,
S. Han, H. Mao, and W. J. Dally, “Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding,” 2016. [Online]. Available: https://arxiv.org/abs/1510.00149
2016 arXiv
-
[104]
Distilling the knowledge in a neural network,
G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,”arXiv preprint, vol. arXiv:1503.02531, 2015. [Online]. Available: https://arxiv.org/abs/1503.02531
2015 arXiv
-
[105]
Neural architecture search: A survey,
T. Elsken, J. H. Metzen, and F. Hutter, “Neural architecture search: A survey,”Journal of Machine Learning Research, vol. 20, no. 55, pp. 1–21, 2019. [Online]. Available: http://www.jmlr.org/papers/volume20/ 18-598/18-598.pdf
2019
-
[106]
Large batch training of convolutional networks,
Y . You, I. Gitman, and B. Ginsburg, “Large batch training of convolutional networks,”arXiv preprint, vol. arXiv:1708.03888, 2017. [Online]. Available: https://arxiv.org/abs/1708.03888
2017 arXiv
-
[107]
Expanding the reach of federated learning by reducing client resource requirements,
S. Caldas, J. Konen, H. B. McMahan, and A. Talwalkar, “Expanding the reach of federated learning by reducing client resource requirements,”arXiv preprint, vol. arXiv:1812.07210, 2018. [Online]. Available: https://arxiv.org/abs/1812.07210
2018 arXiv
-
[108]
Comprehensive survey of model compression and speed up for vision transformers,
F. Chen, Z. Luo, L. Zhou, X. Pan, and Y . Jiang, “Comprehensive survey of model compression and speed up for vision transformers,”arXiv preprint arXiv:2404.10407, 2024
2024 arXiv
-
[109]
Structured pruning learns compact and accurate models,
M. Xia, Z. Zhong, and D. Chen, “Structured pruning learns compact and accurate models,”arXiv preprint arXiv:2204.00408, 2022
2022 arXiv
-
[110]
Combining compressions for multiplicative size scaling on natural language tasks,
R. Movva, J. Lei, S. Longpre, A. Gupta, and C. DuBois, “Combining compressions for multiplicative size scaling on natural language tasks,” arXiv preprint arXiv:2208.09684, 2022
2022 arXiv
-
[111]
Dq-bart: Efficient sequence-to-sequence model via joint distillation and quantization,
Z. Li, Z. Wang, M. Tan, R. Nallapati, P. Bhatia, A. Arnold, B. Xiang, and D. Roth, “Dq-bart: Efficient sequence-to-sequence model via joint distillation and quantization,”arXiv preprint arXiv:2203.11239, 2022
2022 arXiv
-
[112]
Advances and open problems in federated learning,
P. Kairouz, H. B. McMahan, B. Avent, A. Bellet, M. Bennis, A. N. Bhagojiet al., “Advances and open problems in federated learning,” arXiv preprint, vol. arXiv:1912.04977, 2019. [Online]. Available: https://arxiv.org/abs/1912.04977
1912 arXiv
-
[113]
Federated machine learning: Concept and applications,
Q. Yang, Y . Liu, T. Chen, and Y . Tong, “Federated machine learning: Concept and applications,”ACM Transactions on Intelligent Systems and Technology (TIST), vol. 10, no. 2, pp. 1–19, 2019. [Online]. Available: https://dl.acm.org/doi/10.1145/3298981
2019 doi
-
[114]
Communication-efficient learning of deep networks from decentralized data,
H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient learning of deep networks from decentralized data,” inProceedings of the 20th International Conference on Artificial Intelligence and Statistics (AISTATS), 2017, pp. 1273–1282. [Online]...
2017
-
[115]
Robust and communication- efficient federated learning from non-iid data,
F. Sattler, K.-R. Mller, and W. Samek, “Robust and communication- efficient federated learning from non-iid data,”IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 9, pp. 3400– 3413, 2019. [Online]. Available: https://ieeexplore.ieee.org/document/ 8889996
2019
-
[116]
Federated multi-task learning,
V . Smith, C.-K. Chiang, M. Sanjabi, and A. Talwalkar, “Federated multi-task learning,” inProceedings of the 31st International Confer- ence on Neural Information Processing Systems (NeurIPS), 2017, pp. 4427–4437. [Online]. Available: https://proceedings.neurips.cc/paper/ 2017...
2017
-
[117]
Bayesian nonparametric federated learning of neural networks,
M. Yurochkin, M. Agarwal, S. Ghosh, K. Greenewald, N. Hoang, and Y . Khazaeni, “Bayesian nonparametric federated learning of neural networks,” inProceedings of the 36th International Conference on Machine Learning (ICML), 2019, pp. 7252–7261. [Online]. Available: https://proce...
2019
-
[118]
Federated optimization: Distributed machine learning for on-device intelligence,
J. Konen, H. B. McMahan, F. X. Yu, P. Richtrik, A. T. Suresh, and D. Bacon, “Federated optimization: Distributed machine learning for on-device intelligence,”arXiv preprint, vol. arXiv:1610.02527, 2016. [Online]. Available: https://arxiv.org/abs/1610.02527
2016 arXiv
-
[119]
Ldp-fl: Practical private aggregation in federated learning with local differential privacy,
S. Truex, L. Liu, M. E. Gursoy, L. Yu, and W. Wei, “Ldp-fl: Practical private aggregation in federated learning with local differential privacy,” arXiv preprint arXiv:2005.13129, 2020
2005 arXiv
-
[120]
Practical secure aggregation for privacy-preserving machine learning,
K. Bonawitzet al., “Practical secure aggregation for privacy-preserving machine learning,” inProceedings of the ACM on International Con- ference on Advances in Neural Information Processing Systems (NIPS), 2017
2017
-
[121]
Openfhe: Open-source fully homomorphic encryption library,
O. D. Team, “Openfhe: Open-source fully homomorphic encryption library,” https://github.com/openfheorg/openfhe-development, 2022
2022
-
[122]
Towards edge- based federated learning: A systematic survey,
X. Yao, Z. Wang, Y . Zhang, and Y . Zhang, “Towards edge- based federated learning: A systematic survey,”IEEE Transactions on Network and Service Management, vol. 19, no. 2, pp. 1751–1771, 2022. [Online]. Available: https://ieeexplore.ieee.org/document/9685161
2022
-
[123]
Edge-based continual learning: Achieving privacy-preserving, fast, and accurate model adaptation,
Z. Wang, X. Yao, Y . Zhang, and Y . Zhang, “Edge-based continual learning: Achieving privacy-preserving, fast, and accurate model adaptation,”IEEE Network, vol. 35, no. 4, pp. 247–253, 2021. [Online]. Available: https://ieeexplore.ieee.org/document/9490544
2021
-
[124]
Federated meta-learning: Concept and applications,
T. Li, A. K. Sahu, A. Talwalkar, and V . Smith, “Federated meta-learning: Concept and applications,” inProceedings of the 35th International Conference on Neural Information Processing Systems (NeurIPS), 2021, pp. 10 132–10 142. [Online]. Available: https://proceedings.neurips...
2021
-
[125]
Federated evaluation: A unified framework for privacy-preserving model evaluation,
J. Xu, S. Zhou, and S. Zhao, “Federated evaluation: A unified framework for privacy-preserving model evaluation,” IEEE Transactions on Dependable and Secure Computing, vol. 19, no. 3, pp. 1457–1469, 2022. [Online]. Available: https://ieeexplore.ieee.org/document/9336284
2022
-
[126]
Federated hyperparameter tuning with bayesian optimization,
H. Zhang, X. Liu, Z. Jiang, and J. Ren, “Federated hyperparameter tuning with bayesian optimization,”IEEE Transactions on Cybernetics, vol. 51, no. 11, pp. 5234–5245, 2021. [Online]. Available: https://ieeexplore.ieee.org/document/9340104
2021
-
[127]
Continuous federated learning with dynamic client participation,
J. Liu, X. Chen, H. Zhao, and Z. Wang, “Continuous federated learning with dynamic client participation,”IEEE Transactions on Neural Networks and Learning Systems, vol. 35, no. 2, pp. 312–325, 2024. [Online]. Available: https://ieeexplore.ieee.org/document/9565234
2024
-
[128]
Sparse federated learning: Reducing communication overhead for edge computing,
H. Zhang, Y . Liu, and J. Ren, “Sparse federated learning: Reducing communication overhead for edge computing,”IEEE Transactions on Parallel and Distributed Systems, vol. 35, no. 3, pp. 478–490, 2024. [Online]. Available: https://ieeexplore.ieee.org/document/9618745
2024
-
[129]
Orchestrated edge deployment for federated learning in heterogeneous environments,
X. Wang, J. Xu, and X. Chen, “Orchestrated edge deployment for federated learning in heterogeneous environments,”IEEE Transactions on Mobile Computing, vol. 23, no. 1, pp. 112–126, 2024. [Online]. Available: https://ieeexplore.ieee.org/document/9654782
2024
-
[130]
Adaptive federated learning in resource-constrained environments,
T. Chen, Q. Yang, and Y . Liu, “Adaptive federated learning in resource-constrained environments,”IEEE Internet of Things Journal, vol. 11, no. 5, pp. 2789–2801, 2024. [Online]. Available: https://ieeexplore.ieee.org/document/9687123
2024
-
[131]
Kubefl: A kubernetes-based federated learning framework for scalable edge computing,
J. Xu, W. Li, and H. Wang, “Kubefl: A kubernetes-based federated learning framework for scalable edge computing,”Journal of Parallel and Distributed Computing, vol. 167, pp. 12–22, 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/ S0743731523000024
2023
-
[132]
Federated continual learning: Advances and challenges,
X. Yao, Y . Zhang, and Z. Wang, “Federated continual learning: Advances and challenges,”IEEE Transactions on Emerging Topics in Computing, vol. 9, no. 2, pp. 324–335, 2024. [Online]. Available: https://ieeexplore.ieee.org/document/9647563
2024
-
[133]
Reinforcement learning in federated learning systems: A survey,
X. Zhu, J. Ren, and H. Zhang, “Reinforcement learning in federated learning systems: A survey,”IEEE Access, vol. 12, pp. 1123– 1145, 2024. [Online]. Available: https://ieeexplore.ieee.org/document/ 9658793
2024
-
[134]
A joint communication and learning framework for hierarchical split federated learning,
L. U. Khan, M. Guizani, A. Al-Fuqaha, C. S. Hong, D. Niyato, and Z. Han, “A joint communication and learning framework for hierarchical split federated learning,”IEEE Internet of Things Journal, 2023
2023
-
[135]
Vision-language pre-training: Basics, recent advances, and future trends,
Z. Gan, L. Li, C. Li, L. Wang, Z. Liu, and J. Gao, “Vision-language pre-training: Basics, recent advances, and future trends,” 2022. [Online]. Available: https://arxiv.org/abs/2210.09263
2022 arXiv
-
[137]
Vilmedic: a framework for research at the intersection of vision and language in medical ai,
J.-B. Delbrouck, K. K. Saab, and M. Varma, “Vilmedic: a framework for research at the intersection of vision and language in medical ai,”Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL), pp. 23–34, 2022
2022
-
[138]
Medblip: Bootstrapping language-image pre-training from 3d medical images and texts,
Q. Chen, X. Hu, Z. Wang, and Y . Hong, “Medblip: Bootstrapping language-image pre-training from 3d medical images and texts,”ArXiv, vol. abs/2305.10799, 2023
2023 arXiv
-
[139]
Lightweight transfer learning models for ultrasound-guided classifica- tion of covid-19 patients,
M. E. Karar, O. Reyad, M. Abd-elnaby, A. AbdelAty, and M. Shouman, “Lightweight transfer learning models for ultrasound-guided classifica- tion of covid-19 patients,”Computers, Materials & Continua, 2021
2021
-
[140]
Customizing general- purpose foundation models for medical report generation,
B. Yang, A. Raza, Y . Zou, and T. Zhang, “Customizing general- purpose foundation models for medical report generation,”ArXiv, vol. abs/2306.05642, 2023
2023 arXiv
-
[141]
Geollava: Efficient fine-tuned vision-language models for temporal change detection in remote sensing,
H. Elgendy, A. Sharshar, A. Aboeitta, Y . Ashraf, and M. Guizani, “Geollava: Efficient fine-tuned vision-language models for temporal change detection in remote sensing,” 2025. [Online]. Available: https://arxiv.org/abs/2410.19552
2025 arXiv
-
[142]
Satin: A multi-task metadataset for classifying satellite imagery using vision-language models,
J. Roberts, K. Han, and S. Albanie, “Satin: A multi-task metadataset for classifying satellite imagery using vision-language models,”ArXiv, 2023
2023
-
[143]
Aerialvln: Vision-and-language navigation for uavs,
S. Liu, H. Zhang, Y . Qi, P. Wang, Y . Zhang, and Q. Wu, “Aerialvln: Vision-and-language navigation for uavs,”ArXiv, vol. abs/2308.06735, 2023
2023 arXiv
-
[144]
Changeclip: Remote sensing change detection with multimodal vision-language representation learning,
S. Dong, L. Wang, B. Du, and X. Meng, “Changeclip: Remote sensing change detection with multimodal vision-language representation learning,”ISPRS Journal of Photogrammetry and Remote Sensing, vol. 208, pp. 53–69, 2024. [Online]. Available: https://www. sciencedirect.com/scienc...
2024
-
[145]
Bi-modal transformer-based approach for visual question answering in remote sensing imagery,
Y . Bazi, M. M. A. Rahhal, M. L. Mekhalfi, M. Zuair, and F. Melgani, “Bi-modal transformer-based approach for visual question answering in remote sensing imagery,”IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–11, 2022
2022
-
[146]
Vision language models in autonomous driving and intelligent transportation systems,
X. Zhou, M. Liu, B. L. agar, E. Yurtsever, and A. C. Knoll, “Vision language models in autonomous driving and intelligent transportation systems,”ArXiv, vol. abs/2310.14414, 2023
2023 arXiv
-
[147]
Language prompt for autonomous driving,
D. Wu, W. Han, T. Wang, Y .-H. Liu, X. Zhang, and J. Shen, “Language prompt for autonomous driving,”ArXiv, vol. abs/2309.04379, 2023
2023 arXiv
-
[148]
Detecting and learning city intersection traffic contexts for autonomous vehicles,
J. Gao, D. Wang, C.-P. Lin, C. Luo, Y . Ruan, and M. Yuan, “Detecting and learning city intersection traffic contexts for autonomous vehicles,” Journal of Smart Cities and Society, 2022
2022
-
[149]
Crisscross- global vision transformers model for very high resolution aerial image semantic segmentation,
G. Deng, Z. Wu, M. Xu, C. Wang, Z. Wang, and Z. Lu, “Crisscross- global vision transformers model for very high resolution aerial image semantic segmentation,”IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–19, 2023
2023
-
[150]
Tracking urban heartbeat and policy compliance through vision and language- based sensing,
T. Chowdhury, Q. Ding, I. Mandel, W. Ju, and J. Ortiz, “Tracking urban heartbeat and policy compliance through vision and language- based sensing,”Proceedings of the 8th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, 2021
2021
-
[151]
Vision-language models in remote sensing: Current progress and future trends,
C. Wen, Y . Hu, X. Li, Z. Yuan, and X. X. Zhu, “Vision-language models in remote sensing: Current progress and future trends,”ArXiv, vol. abs/2305.05726, 2023
2023 arXiv
-
[152]
Vision-language models as success detectors,
Y . Du, K. Konyushkova, M. Denil, A. Raju, J. Landon, F. Hill, N. de Freitas, and S. Cabi, “Vision-language models as success detectors,”ArXiv, vol. abs/2303.07280, 2023
2023 arXiv
-
[153]
Improving vision-and-language navigation by generating future-view image semantics,
J. Li and M. Bansal, “Improving vision-and-language navigation by generating future-view image semantics,”2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10 803– 10 812, 2023
2023
-
[154]
Tiny vlms bring ai text plus image vision to the edge,
TechHQ, “Tiny vlms bring ai text plus image vision to the edge,” https://techhq.com/tiny-vlm-trends-2024, 2024
2024
-
[155]
Self-adapting large visual-language models to edge devices across visual modalities,
K. Cai, Z. Duan, G. Liu, C. Fleming, and C. X. Lu, “Self-adapting large visual-language models to edge devices across visual modalities,” ECCV 2024, 2024
2024
-
[156]
Moondream2: A tiny vision-language model for edge devices,
K. Vikhyat, “Moondream2: A tiny vision-language model for edge devices,” https://github.com/vikhyatk/moondream2, 2024
2024
-
[157]
A survey on the integration and optimization of large language models in edge computing envi- ronments,
S. Bhardwaj, P. Singh, and M. K. Pandit, “A survey on the integration and optimization of large language models in edge computing envi- ronments,” in2024 16th International Conference on Computer and Automation Engineering (ICCAE), 2024, pp. 168–172
2024
-
[158]
Visual language intelligence and edge ai 2.0,
Y . J. Lu, H. D. Yin, J. Lin, D. Franklin, H. Tang, S. Yang, C. Su, and S. Han, “Visual language intelligence and edge ai 2.0,”NVIDIA Technical Blog, 2024
2024
-
[159]
Mobile edge intelligence for large language models: A contemporary survey,
G. Qu, Q. Chen, W. Wei, Z. Lin, X. Chen, and K. Huang, “Mobile edge intelligence for large language models: A contemporary survey,” TechRxiv, 2024
2024
-
[160]
Pushing large language models to the 6g edge: Vision, challenges, and oppor- tunities,
Z. Lin, G. Qu, Q. Chen, X. Chen, Z. Chen, and K. Huang, “Pushing large language models to the 6g edge: Vision, challenges, and oppor- tunities,”arXiv preprint arXiv:2309.16739, 2023
2023 arXiv
-
[161]
Generative inference of large language models in edge computing: An energy efficient approach,
X. Yuan, H. Li, K. Ota, and M. Dong, “Generative inference of large language models in edge computing: An energy efficient approach,” in 2024 International Wireless Communications and Mobile Computing (IWCMC), 2024, pp. 244–249
2024
-
[162]
Mobile edge intelligence for large language models: A contemporary survey,
G. Qu, Q. Chen, W. Wei, Z. Lin, X. Chen, and K. Huang, “Mobile edge intelligence for large language models: A contemporary survey,” arXiv preprint arXiv:2407.18921, 2024
2024 arXiv
-
[163]
Towards edge general intelligence via large language models: Opportunities and challenges,
H. Chen, W. Deng, S. Yang, J. Xu, Z. Jiang, E. C. H. Ngai, J. Liu, and X. Liu, “Towards edge general intelligence via large language models: Opportunities and challenges,” 2024. [Online]. Available: https://arxiv.org/abs/2410.18125
2024 arXiv
-
[164]
Vision transformer models for mobile/edge devices: A survey,
S. I. Lee, K. Koo, J. H. Lee, G. Lee, S. Jeong, S. Oh, and H. Kim, “Vision transformer models for mobile/edge devices: A survey,”Mul- timedia Systems, 2024
2024
-
[165]
Dime-fm: Distilling multimodal and efficient foundation models,
X. Sun, P. Zhang, P. Zhang, H. Shah, K. Saenko, and X. Xia, “Dime-fm: Distilling multimodal and efficient foundation models,”
-
[166]
Edgevl: Self-adapting large visual-language models to edge devices,
Ramdrop, “Edgevl: Self-adapting large visual-language models to edge devices,” https://github.com/ramdrop/edgevl, 2024
2024
-
[167]
Adapting vision-language models for edge devices,
S. Science, “Adapting vision-language models for edge devices,” https: //simplescience.ai/vlm-edge-adaptation, 2024
2024
-
[169]
Efficient multimodal large language models: A survey,
Y . Jin, J. Liet al., “Efficient multimodal large language models: A survey,”arXiv preprint arXiv:2405.10739, 2024. [Online]. Available: https://arxiv.org/html/2405.10739v1
2024
-
[171]
Mixture of experts made personalized: Federated prompt learn- ing for vision-language models,
——, “Mixture of experts made personalized: Federated prompt learn- ing for vision-language models,”arXiv preprint arXiv:2410.10114, 2024
2024 arXiv
-
[172]
Flora: Enhancing vision- language models with parameter-efficient federated learning,
D. P. Nguyen, J. P. Munoz, and A. Jannesari, “Flora: Enhancing vision- language models with parameter-efficient federated learning,”arXiv preprint arXiv:2404.15182, 2024
2024 arXiv
-
[173]
Federated learning from vision- language foundation models,
B. Pan, W. Huang, and Y . Shi, “Federated learning from vision- language foundation models,”arXiv preprint arXiv:2409.19610, 2024
2024 arXiv
-
[174]
To- wards multi-modal transformers in federated learning,
G. Sun, M. Mendieta, A. Dutta, X. Li, and C. Chen, “To- wards multi-modal transformers in federated learning,”arXiv preprint arXiv:2404.12467, 2024
2024 arXiv
-
[175]
Multi-frame, lightweight & efficient vision-language models for question answering in autonomous driving,
A. Gopalkrishnan, R. Greer, and M. Trivedi, “Multi-frame, lightweight & efficient vision-language models for question answering in autonomous driving,” 2024. [Online]. Available: https://arxiv.org/abs/ 2403.19838
2024 arXiv
-
[176]
Litevila: A lightweight vision- language model for scene understanding in autonomous driving,
Y . Cheng, M.-H. Chen, and S.-H. Lai, “Litevila: A lightweight vision- language model for scene understanding in autonomous driving,” ECCV 2024 Workshop W-CODA, 2024
2024
-
[177]
Semantic scene understanding with large language models on unmanned aerial vehicles,
J. de Curt, I. de Zarz, and C. Calafate, “Semantic scene understanding with large language models on unmanned aerial vehicles,”Drones, vol. 7, p. 114, 02 2023
2023
-
[178]
Edge-assisted object segmentation using multimodal feature fusion,
Y . Liu, X. Wanget al., “Edge-assisted object segmentation using multimodal feature fusion,”ACM Transactions on Sensor Networks, vol. 19, no. 2, p. 22, 2023. [Online]. Available: https://dl.acm.org/doi/10.1145/3612922
2023 doi
-
[179]
Dynafuse: Dynamic fusion for resource efficient multi-modal machine learning inference,
H. Alikhani, A. Kanduriet al., “Dynafuse: Dynamic fusion for resource efficient multi-modal machine learning inference,”arXiv preprint arXiv:2306.15333, 2023. [Online]. Available: https://www. researchgate.net/publication/374181098 DynaFuse Dynamic Fusion for Resource Efficien...
2023 arXiv
-
[180]
Few-shot learning with multimodal fusion for efficient cloudedge collaborative mmwave beam selection,
Y . Zhang, J. Li, Q. Wanget al., “Few-shot learning with multimodal fusion for efficient cloudedge collaborative mmwave beam selection,” Electronics, vol. 14, no. 4, p. 804, 2025. [Online]. Available: https://www.mdpi.com/2079-9292/14/4/804
2025
-
[181]
Unraveling cross-modality knowledge conflicts in large vision-language models,
T. Zhuet al., “Unraveling cross-modality knowledge conflicts in large vision-language models,”arXiv preprint arXiv:2410.03659, 2024
2024 arXiv
-
[182]
Visual prompt multi-modal tracking,
Y . Cheng, M.-H. Chen, and S.-H. Lai, “Visual prompt multi-modal tracking,” inProceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), 2024
2024
-
[183]
Cross-modality fusion for depth prediction via rgb and thermal data,
S. Tianet al., “Cross-modality fusion for depth prediction via rgb and thermal data,”IEEE Xplore, 2023
2023
-
[184]
Beyond gradients: Exploiting adversarial priors in model inversion attacks,
D. Usynin, D. Rueckert, and G. Kaissis, “Beyond gradients: Exploiting adversarial priors in model inversion attacks,”ArXiv, 2022
2022
-
[185]
Boosting model inversion attacks with adversarial examples,
S. Zhou, T. Zhu, D. Ye, X. Yu, and W. Zhou, “Boosting model inversion attacks with adversarial examples,”ArXiv, 2023
2023
-
[186]
Towards adversarial attack on vision- language pre-training models,
J. Zhang, Q. Yi, and J. Sang, “Towards adversarial attack on vision- language pre-training models,” inProceedings of the 30th ACM Inter- national Conference on Multimedia, 2022
2022
-
[187]
Defending against model inversion attack by adversarial examples,
J. Wen, S. Yiu, and L. Hui, “Defending against model inversion attack by adversarial examples,” in2021 IEEE International Conference on Cyber Security and Resilience (CSR), 2021, pp. 551–556
2021
-
[188]
A formal model for secure multiparty computation,
A. Rathore, M. Blanton, M. Gaboardi, and L. Ziarek, “A formal model for secure multiparty computation,” 2023. [Online]. Available: https://arxiv.org/abs/2306.00308
2023 arXiv
-
[189]
Set-level guidance attack: Boosting adversarial transferability of vision-language pre-training models,
D. Lu, Z. Wang, T. Wang, W. Guan, H. Gao, and F. Zheng, “Set-level guidance attack: Boosting adversarial transferability of vision-language pre-training models,”ArXiv, 2023
2023
-
[190]
Privacy-preserving federated learning using homomorphic encryption,
J. Park and H.-K. Lim, “Privacy-preserving federated learning using homomorphic encryption,”Applied Sciences, 2022
2022
-
[191]
Privacy-preserving federated learning using homomorphic en- cryption,
——, “Privacy-preserving federated learning using homomorphic en- cryption,”Applied Sciences, vol. 12, p. 734, 2022
2022
-
[192]
Privacy preserving machine learning with homomorphic encryption and federated learning,
H. Fang and Q. Qian, “Privacy preserving machine learning with homomorphic encryption and federated learning,”Future Internet, vol. 13, p. 94, 2021
2021
-
[193]
Privacy enhanced federated learning via privacy masks and additive homomorphic encryption,
C. Shen and W. Zhang, “Privacy enhanced federated learning via privacy masks and additive homomorphic encryption,” in2023 Inter- national Conference on Networking and Network Applications (NaNA), 2023, pp. 471–478
2023
-
[194]
Secure federated learning with a homomorphic encryption model,
N. Hussien, S. A. Salman, and M. Aljanabi, “Secure federated learning with a homomorphic encryption model,”International Journal Papier Advance and Scientific Review, 2023
2023
-
[195]
Privacy-preserving federated learning using homomorphic encryption with different encryption keys,
J. Park, N. Y . Yu, and H. Lim, “Privacy-preserving federated learning using homomorphic encryption with different encryption keys,” in2022 13th International Conference on Information and Communication Technology Convergence (ICTC), 2022, pp. 1869–1871
2022
-
[196]
Privacypreserving federated learning based on multikey homomorphic encryption,
J. Ma, S.-A. Naas, S. Sigg, and X. Lyu, “Privacypreserving federated learning based on multikey homomorphic encryption,”International Journal of Intelligent Systems, vol. 37, pp. 5880–5901, 2021
2021
-
[197]
A homomorphic signcryption-based privacy preserving federated learning framework for iots,
W. Du, M. Li, Y . Han, X. A. Wang, and Z. Wei, “A homomorphic signcryption-based privacy preserving federated learning framework for iots,”Security and Communication Networks, 2022
2022
-
[198]
Com- bining homomorphic encryption and differential privacy in federated learning,
A. G. Sbert, M. Checri, O. Stan, R. Sirdey, and C. Gouy-Pailler, “Com- bining homomorphic encryption and differential privacy in federated learning,” in2023 20th Annual International Conference on Privacy, Security and Trust (PST), 2023, pp. 1–7
2023
-
[199]
Memory optimization at edge for distributed convolution neural network,
S. Naveen and M. R. Kounte, “Memory optimization at edge for distributed convolution neural network,”Transactions on Emerging Telecommunications Technologies, 2022
2022
-
[200]
Declarative data serving: The future of machine learning inference on the edge,
T. Shaowang, N. Jain, D. Matthews, and S. Krishnan, “Declarative data serving: The future of machine learning inference on the edge,”Proc. VLDB Endow., vol. 14, pp. 2555–2562, 2021
2021
-
[201]
Energy-efficient task adaptation for nlp edge inference leveraging heterogeneous memory architectures,
Z. Fu, A. Avaliani, and M. Donato, “Energy-efficient task adaptation for nlp edge inference leveraging heterogeneous memory architectures,” ArXiv, 2023
2023
-
[202]
Pipeline parallelism for inference on heterogeneous edge computing,
Y . Hu, C. Imes, X. Zhao, S. Kundu, P. Beerel, S. Crago, and J. Walters, “Pipeline parallelism for inference on heterogeneous edge computing,” ArXiv, 2021
2021
-
[203]
Devit: Decomposing vision transformers for collaborative inference in edge devices,
G. Xu, Z. Hao, Y . Luo, H. Hu, J. An, and S. Mao, “Devit: Decomposing vision transformers for collaborative inference in edge devices,”ArXiv, 2023
2023
-
[204]
Search-time efficient device constraints-aware neural architecture search,
O. Dutta, T. Kanvar, and S. Agarwal, “Search-time efficient device constraints-aware neural architecture search,”ArXiv, 2023. Ahmed Sharsharis currently pursuing a PhD in Computer Vision at Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) in Abu Dhabi, UAE. He ...
2023
-
[2023]
Available: https://arxiv.org/abs/2303.18232
[Online]. Available: https://arxiv.org/abs/2303.18232
Reviewed August 8, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.