Paper Announcement
Our preprint on understanding in-context learning in Gemma2-2b is on arxiv! We found a circuit in the model that performs in-context learning and interpreted the information flow in it. See this X post for a short explanation.
Our preprint on understanding in-context learning in Gemma2-2b is on arxiv! We found a circuit in the model that performs in-context learning and interpreted the information flow in it. See this X post for a short explanation.