Intel Gaudi3 AI Chip Price, Performance and Specifications

TapTechNews June 7th news, Intel disclosed at the 2024 Computex Taipei that the price of the Gaudi3 AI chip is 15650 US dollars (TapTechNews note: currently about 113000 RMB), basically half that of the NVIDIA H100 chip.

Jim McGregor of TiriasResearch tweeted that the price of the Intel baseboard equipped with 8 Intel Gaudi2 AI chips is 65000 US dollars, and the single price is 8125 US dollars (currently about 58899 RMB).

And the price of the Intel baseboard equipped with 8 Intel Gaudi3 AI chips is 125000 US dollars, which is equivalent to a single price of 15650 US dollars.

Of course, the above prices refer to the prices for bulk purchases with the baseboard. If large customers make bulk purchases, the price can be even more favorable.

In comparison, the retail price of NVIDIA's H100 80GB graphics card is 30000 US dollars (currently about 217000 RMB), or even higher. In addition, HSBC also predicts that the average selling price (ASP) of the 'entry-level' B100 GPU will be between 30000 and 35000 US dollars, and that of GB200 (one Grace CPU and two B200 GPUs) is estimated to be between 60000 and 70000 US dollars.

Intel officially introduced that the new Gaudi3 has a 170% increase in training performance and a 50% increase in inference ability compared to the NVIDIA H100, and has a 40% improvement in efficiency.

The Intel's brand-new Gaudi3 AI accelerator is fabricated with 5nm process, with FP8 performance twice that of the previous generation, BF16 performance four times that of the previous generation, network bandwidth twice that of the previous generation, and memory bandwidth 1.5 times that of the previous generation, and it is available in three forms: Mezz card, onboard, and PCIe.