A task-oriented semantic communication framework for LLaVA-based vehicle assistants that crops image slices matched to the user's question and allocates transmission power by fused objective and subjective attention, improving VQA accuracy at low SNR.
Edge-Cloud Collaborative Motion Planning for Autonomous Driving with Large Language Models
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Integrating large language models (LLMs) into autonomous driving enhances personalization and adaptability in open-world scenarios. However, traditional edge computing models still face significant challenges in processing complex driving data, particularly regarding real-time performance and system efficiency. To address these challenges, this study introduces EC-Drive, a novel edge-cloud collaborative autonomous driving system with data drift detection capabilities. EC-Drive utilizes drift detection algorithms to selectively upload critical data, including new obstacles and traffic pattern changes, to the cloud for processing by GPT-4, while routine data is efficiently managed by smaller LLMs on edge devices. This approach not only reduces inference latency but also improves system efficiency by optimizing communication resource use. Experimental validation confirms the system's robust processing capabilities and practical applicability in real-world driving conditions, demonstrating the effectiveness of this edge-cloud collaboration framework. Our data and system demonstration will be released at https://sites.google.com/view/ec-drive.
fields
cs.AI 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networks
A task-oriented semantic communication framework for LLaVA-based vehicle assistants that crops image slices matched to the user's question and allocates transmission power by fused objective and subjective attention, improving VQA accuracy at low SNR.