OpenAI presents 'Jalapeño', its first AI chip

Sam Altman, CEO of OpenAI
Yuichi YAMAZAKI / AFP
OpenAI on Wednesday unveiled its first custom-built chip, called Jalapeño, to make ChatGPT and other artificial intelligence products work faster and more cost-effectively.
The chip, developed in conjunction with semiconductor manufacturer Broadcom, was designed specifically for AI inference, the process of running an AI model to generating responses, as opposed to expensively training a model from scratch.
PCs with AI: what is Nvidia's new bet and how it can change the way we use notebooks
IBM announces the world's first chip below 1 nanometer; understand what this means
"While OpenAI is still evaluating final performance, early testing indicates that Jalapeño will deliver substantially better performance per watt than the most advanced technology," the company said in its blog.
The company highlighted that its own AI models contributed to the chip's design.
The chip is designed to work with a wide range of AI models, not just OpenAI's products, and will be deployed in data centers managed by Microsoft and others partners starting this year.
By controlling the design of its own chip, OpenAI aims to reduce its dependence on external suppliers like Nvidia.
Broadcom CEO Hock Tan said this chip was "just the beginning" of the collaboration between both companies.
SEE ALSO
OpenIA and Anthropic bosses refuse to join hands at event

Source: G1