Hosting LLMs on Kubernetes for Digital Sovereignty
Автор: Cloud Native Suisse Romande
Загружено: 2026-01-19
Просмотров: 3
KCD Suisse Romande 2025: https://kcd.cloud-native-romandy.ch/
Speaker: Lena Fuhrimann
Are you concerned about the privacy and sustainability of AI models? This talk provides a practical guide to hosting Large Language Models on your own Kubernetes clusters. We will compare and contrast a range of popular tools and frameworks like Ollama, vLLM, and Llamafile to help you choose the right solution for your needs. We'll explore how these tools enable a sovereign approach to AI, allowing organizations to maintain full control over their data, models, and infrastructure. Learn how to build a private, scalable, and secure AI environment that meets your data residency and sustainability requirements.
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
