1 code implementation • 9 May 2024 • Zifan He, Zongyue Qin, Neha Prakriya, Yizhou Sun, Jason Cong
With an additional 0. 5% - 2% of parameters, HMT can easily plug in and augment future LLMs to handle long context effectively.
no code implementations • 18 May 2023 • Yunsheng Bai, Atefeh Sohrabizadeh, Zongyue Qin, Ziniu Hu, Yizhou Sun, Jason Cong
In addition, these programs can be compiled and converted into a control data flow graph (CDFG), and the compiler also provides fine-grained alignment between the code tokens and the CDFG nodes.