Search Results for author: LanTing LI

Found 1 papers, 0 papers with code

Accelerating Retrieval-Augmented Language Model Serving with Speculation

no code implementations25 Jan 2024 Zhihao Zhang, Alan Zhu, Lijie Yang, Yihua Xu, LanTing LI, Phitchaya Mangpo Phothilimthana, Zhihao Jia

Retrieval-augmented language models (RaLM) have demonstrated the potential to solve knowledge-intensive natural language processing (NLP) tasks by combining a non-parametric knowledge base with a parametric language model.

Language Modelling Retrieval

Cannot find the paper you are looking for? You can Submit a new open access paper.