Development Trends of AI Servers: From Full System to Rack-Level Design
Since the beginning of 2024, the artificial intelligence (AI) server market has experienced a significant surge, with numerous manufacturers unveiling their latest AI server products at Computex 2024. In addition to the servers themselves, major chipmakers like Nvidia, AMD, and Intel also showcased a wide array of rack-level and thermal management solutions, with the Nvidia DGX GB200 NVLink 72 standing out as a key product. This shift marks an important development for pure server manufacturers, who are now focusing not only on server production but also on advancing into the supply chain for rack-level solutions. This report provides insights into the latest development trends in the AI server market, examining the new rollouts from leading GPU suppliers. It also explores the major product strategies of prominent AI server manufacturers such as Supermicro, Ingrasys, QCT, and Gigabyte, alongside traditional server manufacturers like Wiwynn, Inventec, and Tyan, as revealed through their product launches at Computex 2024.
Table of Contents
1. PROMISING AI SERVER MARKET WITH DIVERSE PRODUCT OFFERINGS
1.1 AI Servers Featuring Nvidia HGX and MGX Architectures
1.1.1 Air-Cooled and Liquid-Cooled HGX Architecture Servers Launched Simultaneously, with Liquid Cooling Solutions Effectively Limiting Server Height
1.1.2 Nvidia MGX Offers Greater Flexibility in Server Design, Leading to Diverse AI Server Models
1.2 AMD and Intel Separately Collaborate with Manufacturers to Enter the AI Server Market
2. SERVER MAKERS ACTIVELY COLLABORATE WITH NVIDIA FOR RACK-LEVEL SOLUTIONS
2.1 Manufacturers Compete with Nvidia DGX GB200 NVLink 72 Racks within the Same Architecture
2.2 Manufacturers Seek Differentiation in Rack Design, Collaborating with Various Upstream and Liquid Cooling Vendors
3. MIC PERSPECTIVE
3.1 The AI Server Market Remains Hot, with a Significant Increase in Product Specs and the Number of Vendors
3.2 Air-Cooled and Liquid-Cooled Servers Target Different Customer Groups; Liquid Cooling Enhances AI Computing Density in a Single Rack
3.3 High Power Consumption of AI Servers Accelerates the Adoption of Liquid Cooling, Making Rack-Level Solutions a Norm
3.4 Nvidia Continues to Dominate the AI Server Market, with AMD and Intel Making Progress AI
Appendix
LIST OF COMPANIES
1. PROMISING AI SERVER MARKET WITH DIVERSE PRODUCT OFFERINGS
1.1 AI Servers Featuring Nvidia HGX and MGX Architectures
1.1.1 Air-Cooled and Liquid-Cooled HGX Architecture Servers Launched Simultaneously, with Liquid Cooling Solutions Effectively Limiting Server Height
1.1.2 Nvidia MGX Offers Greater Flexibility in Server Design, Leading to Diverse AI Server Models
1.2 AMD and Intel Separately Collaborate with Manufacturers to Enter the AI Server Market
2. SERVER MAKERS ACTIVELY COLLABORATE WITH NVIDIA FOR RACK-LEVEL SOLUTIONS
2.1 Manufacturers Compete with Nvidia DGX GB200 NVLink 72 Racks within the Same Architecture
2.2 Manufacturers Seek Differentiation in Rack Design, Collaborating with Various Upstream and Liquid Cooling Vendors
3. MIC PERSPECTIVE
3.1 The AI Server Market Remains Hot, with a Significant Increase in Product Specs and the Number of Vendors
3.2 Air-Cooled and Liquid-Cooled Servers Target Different Customer Groups; Liquid Cooling Enhances AI Computing Density in a Single Rack
3.3 High Power Consumption of AI Servers Accelerates the Adoption of Liquid Cooling, Making Rack-Level Solutions a Norm
3.4 Nvidia Continues to Dominate the AI Server Market, with AMD and Intel Making Progress AI
Appendix
LIST OF COMPANIES
LIST OF TABLES
Table 1: Comparison of DGX GB200 NVLink 72 Systems Displayed at Computex 2024
Table 1: Comparison of DGX GB200 NVLink 72 Systems Displayed at Computex 2024
LIST OF FIGURES
Figure 1: Nvidia HGX Architecture Air-Cooled Servers Displayed by Various Vendors at Computex 2024
Figure 2: Nvidia HGX Architecture Liquid-Cooled Servers Displayed by Various Vendors at Computex 2024
Figure 3: Nvidia MGX Architecture Servers Displayed by Various Manufacturers at Computex 2024
Figure 4: AMD AI Training Servers Displayed by Various Vendors at Computex 2024
Figure 5: Intel AI Training Servers Displayed by Various Vendors at Computex 2024
Figure 6: Nvidia DGX GB200 NVLink 72 Racks Displayed by Various Manufacturers at Computex 2024.
Figure 7: Product Specifications Inside the DGX GB200 NVLink 72 Rack
Figure 1: Nvidia HGX Architecture Air-Cooled Servers Displayed by Various Vendors at Computex 2024
Figure 2: Nvidia HGX Architecture Liquid-Cooled Servers Displayed by Various Vendors at Computex 2024
Figure 3: Nvidia MGX Architecture Servers Displayed by Various Manufacturers at Computex 2024
Figure 4: AMD AI Training Servers Displayed by Various Vendors at Computex 2024
Figure 5: Intel AI Training Servers Displayed by Various Vendors at Computex 2024
Figure 6: Nvidia DGX GB200 NVLink 72 Racks Displayed by Various Manufacturers at Computex 2024.
Figure 7: Product Specifications Inside the DGX GB200 NVLink 72 Rack
