A Deep Dive into In-Context Learning - CoLLAs 2024 - PART 2
Автор: Conference on Lifelong Learning Agents (CoLLAs)
Загружено: 2024-10-23
Просмотров: 166
Speaker: Amal Rannen-Triki, Jorg Bornschein & Johannes von Oswald
Abstract: This tutorial will attempt to present our current understanding of in-context learning (ICL), starting with a brief historical overview, discussing the relationship between meta-learning and in-context learning. We will shed light on ICL through different methodological approaches and perspectives . These include studying ICL mechanistically, analyzing conditions on data distributions for ICL to emerge, contrasting ICL with fine-tuning, and its interaction with online learning. Each section will not only present the current findings, but also the limitations of the tools used and open questions that could benefit from further exploration. The tutorial aims to provide participants with required context as well as a list of open and interesting problems that warrant further exploration from the community.
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
