Turning Words Into Numbers: HuggingFace Tokenizers
Автор: MFK in Tech
Загружено: 2025-04-22
Просмотров: 1863
🤗 In this video, we dive into the Hugging Face Transformers Tokenizers!
📌 What you’ll learn:
What makes up a tokenization pipeline?
Convert text into numbers.
Input IDs and Attention Masks
📚 Resources and Links:
GitHub Source Code: https://github.com/MehmetFiratKomurcu...
HuggingFace Course: https://huggingface.co/learn/llm-cour...
Softmax Function: https://en.wikipedia.org/wiki/Softmax...
💬 Stay Connected:
LinkedIn: / mehmetfiratkomurcu
Twitter: https://x.com/mfkintech
Newsletter: https://firatkomurcu.com
Blog: https://blog.firatkomurcu.com
GitHub: https://github.com/MehmetFiratKomurcu
👍 If you find this video helpful, please like, subscribe, and share it with your fellow developers! Your support encourages me to create more content like this!
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
