Deepseek R1 671b on a $500 AI PC!

Running Deepseek R1 on my HP Z440 Local Ai Server https://digitalspaceport.com/500-deep... spawned curiosity that turned into a video. I was doing a follow-up to the prior video on dual GPU 24GB VRAM setup focused on "maxing out" the Z440. I remembered I had 512GB of DDR4 in 64GB sticks... basically I had to toss that in and give DS a run. I tested that with E5-2650 V4 and E5-2696 V4 plus tested Gemma 3, Cogito, QwQ on the E5-2650V4.

Writeup: https://digitalspaceport.com/500-deep...
24GB $750 Local Ai Server w/ Dual 3060 12GB    • AI Home Server 24GB VRAM $750 Budget ...  

RIG PARTS
SYSTEM - HP Z440 https://geni.us/HP_Z440
I did run against the E5-2696 v4, read about that on the site in more depth
CPU - Intel Xeon E5-2650 v4 https://geni.us/Xeon-E5-2650-V4
CPU - Intel Xeon E5-2696 v4 https://geni.us/E5-2696-V4
I think it is advisable to hit between 32GB to 64GB RAM in 4 channels to max sys bw
RAM - DDR4 LARGE GB https://geni.us/512GB-DDR4-LRDIMM
RAM - 2400 SMALLER GB https://geni.us/DDR4-RAM-ECC-2400
1TB EVO 870 SSD https://geni.us/evo-870-ssd-1TB
Other HP Cheap Workstation Options
HP Z640 https://geni.us/HP_Z640
HP Z840 https://geni.us/HP_Z840

Deepseek R1 671b on $2000 AMD EPYC    • Deepseek R1 671b Running and Testing ...  

👍 Subscribe youtube.com/c/digitalspaceport?sub_co...

🌐 Website https://digitalspaceport.com

Ways to Support:
🚀 Join as a member for members-only content and extra perks    / digitalspaceport  
☕ Buy Me a Coffee https://www.buymeacoffee.com/digitals...
🔳 Patreon   / digitalspaceport  

Chapters
0:00 Deepseek R1 671b $500 Build
0:48 Install 512GB Ram
2:02 Deepseek R1 671b Benchmark - E5-2650 V4
2:45 Deepseek R1 671b Benchmark - E5-2696 V4
3:50 QwQ 32b q4 Benchmark - E5-2650 V4
4:10 Gemma 3 4b q4 Benchmark - E5-2650 V4
4:25 Cogito 14b q8 Benchmark - E5-2650 V4
5:14 Gemma 3 12b q8 Benchmark - E5-2650 V4
6:53 Conclusions
8:54 Dual 3060 12GB vs E5-2650 V4
10:15 Why Ollama
10:56 E5-2650 V4 vs E5-2696 V4
12:52 Local Ai Server Recommendations
15:54 What was Peak Wattage
16:36 CPU Ai Inference is possible

*****
As an Amazon Associate I earn from qualifying purchases.
When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****