tweak logo

Ny AI Chip Revolutionerer ChatGPT

GQ7YKsoXAAAGj2-
Translate from : Ny AI Chip Revolutionerer ChatGPT
Sohu, a new chipset claims to be 20 times faster than Nvidia's flagship H100 in running transformers like ChatGPT. The creators aim to revolutionize the AI hardware market.
By Maria
13 aug. 2024 08:57 am
f

Nvidia's H100 and B200 Graphics Processing Units (GPUs) are the power behind AI chatbots like ChatGPT. These chipsets have sent Nvidia to the forefront of the AI hardware industry, with a market value of over $3 trillion - more than Microsoft and Apple last month.

But now a relatively young startup founded by two Harvard dropouts has set its sights on a piece of the AI hardware pie. Etched, a California-based startup company, is out to disrupt the AI chipset market with their transformer ASIC chip named Sohu. Sohu claims to be 20 times faster at running transformer models like ChatGPT than Nvidia's flagship H100.

mfs4l3n8_etched-ai-chip_625x300_16_July_24.webp

The B200, which is Nvidia's more powerful offering than the H100, is, the company claims, 10 times slower than the Sohu, based on emulation tests. Sohu takes a completely different approach to providing high computational power to run billions of parameters for transformer models. Unlike GPUs, which can perform more computationally heavy tasks, Etched chooses to create a specialized chip designed only for transformer AI models — the ones that power ChatGPT, Sora, and Google's Gemini.

Etched Ai Chip.jpg

This means that Sohu cannot run other AI models such as Convolutional Neural Networks. This opens up the possibility to explore new AI products that until now have not been possible due to limited power on GPUs.

Etched have claimed they already have "millions of dollars" worth of pre-orders. The company has also secured a deal with TSMC (Taiwan Semiconductor Manufacturing Company) to manufacture the 4-nanometer chip, promising that this deal will help "scale up our first year of production."

Latest processor - cpu

Most read processor - cpu

Latest processor - cpu

Our Partners