1 code implementation • 16 Apr 2024 • J. Pablo Muñoz, Jinjie Yuan, Nilesh Jain
Recently, several approaches successfully demonstrated that weight-sharing Neural Architecture Search (NAS) can effectively explore a search space of elastic low-rank adapters (LoRA), allowing the parameter-efficient fine-tuning (PEFT) and compression of large language models.
1 code implementation • NeurIPS 2021 • Ruichu Cai, Jinjie Yuan, Boyan Xu, Zhifeng Hao
The key lies in the generalizability of (i) the encoding method to model the question and the database schema and (ii) the question-schema linking method to learn the mapping between words in the question and tables/columns in the database schema.
Ranked #4 on Text-To-SQL on spider (Exact Match Accuracy (Test) metric)