At a product release on July 11, Intel announced that it will launch a second-generation deep learning AI accelerator customized for the China market.
Named “Habana Gaudi 2,” the AI accelerator uses 7nm chips made by Taiwan Semiconductor Manufacturing Company (TSMC). Intel said the Chinese version differs little in performance compared to the general version, called Gaudi 2, but in order to conform to the US’s restrictions on exports to China, Intel has tweaked the design to conform with the US law.
Media said the new Gaudi 2 supports easy expansion and large language models which will improve AI training and deduction. At a 2022 BERT Training Throughput test, Gaudi 2’s performance is reportedly twice that of the similar Nvidia product, the A100 80GB GPU. Last August, the US put restrictions on Nvidia’s exports of A100 and H100 GPU products to China.
Intel said that Gaudi 2 and the third-generation Gaudi 3 that uses TSMC’s 5nm chips will be available to Chinese customers and conforms to the laws.