Never Lost in the Middle: Improving Large Language Models via Attention Strengthening Question Answering

1 code implementation • 15 Nov 2023 • He Junqing, Pan Kunhao, Dong Xiaoqun, Song Zhuoyang, Liu Yibo, Liang Yuxin, Wang Hao, Sun Qianguo, Zhang Songxin, Xie Zejian, Zhang Jiaxing

While large language models (LLMs) are equipped with longer text input capabilities than before, they are struggling to seek correct information in long contexts.

Passage Retrieval Question Answering +1