Inside the SUPER NVIDIA H200 Server From Supermicro

We take a look at the giant 8U Supermicro SYS-821GE-TNHR. It is the super popular NVIDIA HGX H100 and H200 platform for air-cooled data centers. While taking it apart, we explain the design and what makes this very different in the industry.

Please note: We need to say this is sponsored. Supermicro pulled the expensive system out of the rack for us. It was also cheaper to fly George and me to the server than to fly the server to the STH studio.

STH Main Site Article: https://www.servethehome.com/supermic...

Substack: https://axautikgroupllc.substack.com/
STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09

----------------------------------------------------------------------
Become a STH YT Member and Support Us
----------------------------------------------------------------------
Join STH YouTube membership to support the channel:    / @servethehomevideo  
Professional Users Substack: https://axautikgroupllc.substack.com/
----------------------------------------------------------------------
Where to Find The Unit We Purchased
Note we may earn a small commission if you use these links to purchase a product through them.
----------------------------------------------------------------------
STH Merch on Spring: https://the-sth-merch-shop.myteesprin...

----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Forums: https://forums.servethehome.com
Follow on Twitter:   / servethehome  
Follow on LinkedIn:   / servethehome-com  
Follow on Facebook:   / servethehome  
Follow on Instagram:   / servethehome  

----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
Touring the xAI Colossus:    • Inside the World's Largest AI Supercluster...  
NVIDIA HGX H100:    • Liquid Cooling High-End Servers Direct to ...  
NVIDIA HGX A100:    • Top-End AI Training Inspur NF5488A5 8x NVI...  
NVIDIA V100:    • Hands-on with an 8x NVIDIA Tesla V100 SXM3...  
NVIDIA P100:    • NVIDIA Tesla SXM2 GPU Installation in Deep...  
NVIDIA L40S:    • THIS is NVIDIA's New AI GPU for up to 10,0...  
NVIDIA Arm with A100:    • Now THIS is an Arm Server! Ampere Altra Ma...  

----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
10:30 Power Supplies
11:30 Power Consumption
11:57 Networking 4Tbps of Network Bandwidth
18:30 Wrap-up