no code implementations • 12 Jan 2024 • Jia Li, Ge Li, YunFei Zhao, Yongmin Li, Zhi Jin, Hao Zhu, Huanyu Liu, Kaibo Liu, Lecheng Wang, Zheng Fang, Lanshen Wang, Jiazheng Ding, Xuanming Zhang, Yihong Dong, Yuqi Zhu, Bin Gu, Mengfei Yang
Compared to previous benchmarks, DevEval aligns to practical projects in multiple dimensions, e. g., real program distributions, sufficient dependencies, and enough-scale project contexts.
1 code implementation • 6 Sep 2023 • Yuqi Zhu, Ge Li, YunFei Zhao, Jia Li, Zhi Jin, Hong Mei
With an analysis of loss distributions of code tokens, we find that code tokens can be divided into two categories: challenging tokens that are difficult to predict and confident tokens that can be easily inferred.
no code implementations • 31 Mar 2023 • Jia Li, YunFei Zhao, Yongmin Li, Ge Li, Zhi Jin
A key question is how to make prompts (i. e., Prompting Techniques).
1 code implementation • NeurIPS 2021 • Han Peng, Ge Li, Wenhan Wang, YunFei Zhao, Zhi Jin
Learning distributed representation of source code requires modelling its syntax and semantics.