no code implementations • 18 Apr 2024 • Chao Jin, Zili Zhang, Xuanlin Jiang, Fangyue Liu, Xin Liu, Xuanzhe Liu, Xin Jin
We implement RAGCache and evaluate it on vLLM, a state-of-the-art LLM inference system and Faiss, a state-of-the-art vector database.
no code implementations • 25 Mar 2024 • Zhangqian Bi, Yao Wan, Zheng Wang, Hongyu Zhang, Batu Guan, Fangxin Lu, Zili Zhang, Yulei Sui, Xuanhua Shi, Hai Jin
Large language models (LLMs) have shown remarkable progress in automated code generation.
no code implementations • 16 Jun 2023 • Jianhui Meng, Xiaolong Wu, Tairan Ye, Jingsen Yu, Likang Gu, Zili Zhang, Yang Li
A three-phase isolated AC-DC-DC power supply is widely used in the industrial field due to its attractive features such as high-power density, modularity for easy expansion and electrical isolation.
no code implementations • 10 May 2023 • Bingyang Wu, Yinmin Zhong, Zili Zhang, Gang Huang, Xuanzhe Liu, Xin Jin
Based on the new semi information-agnostic setting of LLM inference, the scheduler leverages the input length information to assign an appropriate initial queue for each arrival job to join.
no code implementations • 13 May 2019 • Yuying Xing, Guoxian Yu, Carlotta Domeniconi, Jun Wang, Zili Zhang, Maozu Guo
To preserve the intrinsic structure of the data matrices, M3Lcmf collaboratively factorizes them into low-rank matrices, explores the latent relationships between bags, instances, and labels, and selectively merges the data matrices.
no code implementations • 3 Nov 2013 • Xiaoge Zhang, Qi Liu, Yong Hu, Felix T. S. Chan, Sankaran Mahadevan, Zili Zhang, Yong Deng
When the edge weight changes, the proposed algorithm can recognize the affected vertices and reconstruct them spontaneously.