What In-Context Learning "Learns" In-Context: Disentangling Task Recognition and Task Learning

1 code implementation • 16 May 2023 • Jane Pan, Tianyu Gao, Howard Chen, Danqi Chen

Large language models (LLMs) exploit in-context learning (ICL) to solve tasks with only a few demonstrations, but its mechanisms are not yet well-understood.

In-Context Learning