Mastering Google's VLM PaliGemma: Tips And Tricks For Success and Fine Tuning

Colab (code) Inference : https://drp.li/GVIjV
Colab (code) Fine Tuning : https://drp.li/I0w8d
HF Blog: https://huggingface.co/blog/paligemma
HF Spaces: https://huggingface.co/spaces/big-vis...

Models : https://huggingface.co/collections/go...

For more tutorials on using LLMs and building Agents, check out my Patreon:
Patreon:   / samwitteveen  
Twitter:   / sam_witteveen  

🕵️ Interested in building LLM Agents? Fill out the form below
Building LLM Agents Form: https://drp.li/dIMes

👨‍💻Github:
https://github.com/samwit/langchain-t... (updated)
https://git hub.com/samwit/llm-tutorials

⏱️Time Stamps:
00:00 Intro
00:50 What is PaliGemma?
01:13 PaLI-3 Paper
01:26 SigLIP Paper
01:36 Hugging Face Blog: PaliGemma
03:19 PaliGemma: Three Pre-trained Checkpoints
05:11 PaliGemma different Sizes and Releases
05:53 PaliGemma Hugging Face Spaces Demo
09:39 ScreenAI Datasets
10:44 Code Time
10:55 Using PaliGemma with Transformers
14:54 PaliGemma Finetuning