DeepSeek-R1-Distill-Qwen-32B + VLLM + OpenWebUI + SearXNG: Best Local Free Replica for DeepSeek Chat

this video demos how to build a super awesome FREE LOCAL REPLICA of chat.deepseek.com with reasoning and web search capabilities using DeepSeek-R1-Distill-Qwen-32B GGUF + VLLM + OpenWebUI + SearXNG Search Engine

Download DeepSeek R1 Model
https://huggingface.co/bartowski/Deep...

Step 1: Activate Free GPU(s) on Kaggle
   • Free GPU Model Training on Kaggle  

Step 2: Install VLLM
   • DeepSeek R1 + Aider + Cline3.2 + VLLM...  
   • DeepSeek R1 + VLLM + Cline 3.2: Run O...  

Step 3: Install OpenWebUI
   • Dolphin 3.0 + Ollama + OpenWebUI: Ult...  
   • Qwen SmallThinker-3B: Reasoning Like ...  

Step 4: Install SearXNG
   • Perplexica + SearXNG: Best Open Sourc...  

Step 5:
Lastly, Follow this tutorial to config WebSearch with DeepSeek R1 Model on OpenWebUI

Kaggle notebooks:
Notebook is only created for demonstration and serve as a guidance for those who were interested using similar methods to build projects. It is NOT a free giveaway for a few reasons. 1. it works while the video is recorded, However it does not guarantee to work at a later date as tech communities make code changes all the time. Please follow the tutorial and create your own version of it if needed. 2. If you have any questions or need help, please join the discord server community to discuss or subscribe to the channel. 3. if you need further professional assistance, please feel to book a consulting call. Thanks for understanding

Discuss:
  / discord  

Consulting:
https://cal.com/productdeploy

Buy Me a Coffee to support the channel, It means a lot
https://ko-fi.com/productdeploy

Follow me on x.com:
https://x.com/jacobcdev


Helpful links:
https://huggingface.co/bartowski/Deep...
https://github.com/searxng/searxng
https://docs.searxng.org/
https://docs.openwebui.com/tutorials/...
https://github.com/vllm-project/vllm

Must Watch:
   • Ollama + Nginx + Kaggle GPU: Best way...  
How to Use Free GPU on Kaggle:
   • Free GPU Model Training on Kaggle  
How to Setup Visual Studio Code Web on Kaggle
   • Roo-Cline (Cline 3.1 Fork) + Ollama +...  
Transform Kaggle Notebook to Virtual Machine with Good GPU, CPU and RAM
   • Transform Kaggle and Colab Notebooks ...  

You might also like:

PlayList
   • AI Web Scrapers  
   • AI Coders  
   • Media Gen and ComfyUI Tutorials  
   • Free AI Video Generators  
   • AI Agents  
   • AI Sound Generators  
   • LLM Reviews  


Music from #Uppbeat (free for Creators!):
https://uppbeat.io/t/21-on-the-block/...
License code: MKM7BDGHR8BXIH2S

Music from #Uppbeat (free for Creators!):
https://uppbeat.io/t/theo-gerard/the-...
License code: ATVBJRKCLBUUMZYA