AI Home Server 24GB VRAM $750 Budget Build and LLM Benchmarking

$750 Budget Dual 3060 12GB Local Ai Server Writeup https://digitalspaceport.com/local-ai... on Proxmox with Ollama and OpenWebUI testing Google Gemma3 27b and 12b, Qwen QwQ 32b, Cogito 14b, Deepcoder 14b and Mistral3.1. Mistral appears broken currently however.

$750 AI SERVER BUILD
HP Z440 https://geni.us/HP_Z440
3060 12GB (need 2 for 24GB) https://geni.us/3060_GPU_12GB
6 to 8 pin PCIe adapter cable https://geni.us/GPUPowerAdapt6pin-8pin

https://community-scripts.github.io/P...

👍 Subscribe youtube.com/c/digitalspaceport?sub_co...
🌐 Website https://digitalspaceport.com

Ways to Support:
🚀 Join as a member for members-only content and extra perks    / digitalspaceport  
☕ Buy Me a Coffee https://www.buymeacoffee.com/digitals...
🔳 Patreon   / digitalspaceport  

Chapters
0:00 $750 Ai Server Build
1:21 Z440 System Overview
2:41 Z440 Front USB Boot Halt Bypass
3:03 Local Ai PC Setup
6:13 HP Z440 Bios Settings for Proxmox LXC
9:24 Proxmox Installation Steps
12:56 Ollama LLM Performance Numbers
24:50 Build Cost Breakdown
27:04 Conclusion

*****
As an Amazon Associate I earn from qualifying purchases.
When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****