Empirical Studies of Parameter Efficient Methods for Large Language Models of Code and Knowledge Transfer to R

no code implementations • 16 Mar 2024 • Amirreza Esmaeili, Iman Saberi, Fatemeh H. Fard

We will assess their performance compared to fully fine-tuned models, whether they can be used for knowledge transfer from natural language models to code (using T5 and Llama models), and their ability to adapt the learned knowledge to an unseen language.

Transfer Learning