The new TPU v8 comes in two versions, each with their own focus area:
Overall, the new generation is 80% faster in terms of performance-per-dollar and twice as energy efficient as the previous model.
In addition to the hardware, Google also unveiled a new platform to help companies build "AI agents." The vision is to move away from simple chatbots and instead create agents that can independently reason and perform tasks to create concrete results.
The new platform acts as an all-in-one control center. Here, companies can build and manage their agents across different models. While Google is of course pushing their own Gemini models, the platform is open, so you can also integrate external models such as Claude. This should make it easier for organizations to maintain an overview of their AI systems as they become more complex.
The new TPU chips are expected to be rolled out to enterprises later this year.