Hugo Laurençon | What Matters When Building Vision-Language Models?
Автор: London Machine Learning Meetup
Загружено: 2024-11-28
Просмотров: 443
Organised by Evolution AI - AI data extraction from financial documents - https://www.evolution.ai/
Abstract: The growing interest in vision-language models (VLMs) has been driven by improvements in large language models and vision transformers. Despite the abundance of literature on this subject, we observe that critical decisions regarding the design of VLMs are often not justified. We argue that these unsupported decisions impede progress in the field by making it difficult to identify which choices improve model performance. To address this issue, we conduct extensive experiments around pre-trained models, architecture choice, data, and training methods. Our consolidation of findings includes the development of the models Idefics2 and Idefics3.
Bio: I spent 3 years at Hugging Face while I was doing my PhD, and my research focused on developing vision-language models and creating datasets for their training. Now I've just started a new role as an AI Research Scientist at Meta.
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
![[EEML'24] Jovana Mitrović - Vision Language Models](https://ricktube.ru/thumbnail/rUQUv4u7jFs/mqdefault.jpg)
