no code implementations • 30 Dec 2023 • Peihua Mai, Ran Yan, Rui Ye, Youjia Yang, Yinchuan Li, Yan Pang
In response, we present ConfusionPrompt, a novel private LLM inference framework designed to obfuscate the server by: (i) decomposing the prompt into sub-prompts, and (ii) generating pseudo prompts along with the genuine sub-prompts as input to the online LLM.
1 code implementation • 13 Oct 2023 • Peihua Mai, Ran Yan, Zhe Huang, Youjia Yang, Yan Pang
Large Language Models (LLMs) excel in natural language understanding by capturing hidden semantics in vector space.