Some methods (e.g., RAG) adopt CPU offloading as a baseline to accelerate these operations relative to GPU execution

With custom logic for fine-grained pipelining, optimized random access, the U55C FPGA can better reduce, overlap communication, computation latency than GPUs · 2024