> ## Content Index
> Fetch the complete content index at: https://spyglass.org/llms.txt
> Use this file to discover other available public pages before exploring further.

# We're Gonna Need a Bigger GPU
- URL: https://spyglass.org/nvidia-blackwell-gpus/
- Published: 2024-03-18T22:32:41.000Z
- Updated: 2024-03-18T22:57:18.000Z
- Author: M.G. Siegler
- Tags: nvidia, tech, apple, ai, jensen huang

[Nvidia CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’Nvidia on Monday announced a new generation of artificial intelligence chips and software for running AI models.![](https://sc.cnbcfm.com/applications/cnbc.com/staticcontent/img/favicon.ico)CNBCKif Leswing![](https://image.cnbcfm.com/api/v1/image/107389058-1710796556355-gettyimages-2094827132-js2_9711_sbgkhl7z.jpeg?v=1710796623&w=1920&h=1080)](https://www.cnbc.com/2024/03/18/nvidia-announces-gb200-blackwell-ai-chip-launching-later-this-year.html?ref=spyglass.org)

NVIDIA is clearly wasting no time resting on their [lofty](https://finance.yahoo.com/quote/NVDA/?guccounter=1&guce%5Freferrer=aHR0cHM6Ly93d3cuZ29vZ2xlLmNvbS8&guce%5Freferrer%5Fsig=AQAAAEUXRPg5Tw7FB7GjUFYdOur6sC7uH5B5tDNljY3gowqw8b0XBOOBdLp4yjoIHYQ7dPa7r9mmD0se0VqHp8jebGfQFMZsBuLMGpJ92izo95GITprNll2jLCQtYU0NnCMqZnKsEO0G-GeJCR6pn0OIt9cumdsNT9LIp0P5mH1pc-iQ&ref=spyglass.org) laurels:[1](#footnote)

> The new generation of AI graphics processors is named Blackwell. The first Blackwell chip is called the GB200 and will ship later this year. Nvidia is enticing its customers with more powerful chips to spur new orders. Companies and software makers, for example, are still scrambling to get their hands on the current generation of “Hopper” H100s and similar chips.  
>  
> “Hopper is fantastic, but we need bigger GPUs,” Nvidia CEO Jensen Huang said on Monday at the company’s developer conference in California.

As we ride into the sunset of [Moore's Law](https://en.wikipedia.org/wiki/Moore%27s%5Flaw?ref=spyglass.org), we've been conditioned to expect CPU upgrades to be small speed bumps, but no longer the huge performance gains of yesteryear. GPUs, it seems, are a different story:

> Every two years Nvidia updates its GPU architecture, unlocking a big jump in performance. Many of the AI models released over the past year were trained on the company’s Hopper architecture — used by chips such as the H100 — which was announced in 2022.  
>  
> Nvidia says Blackwell-based processors, like the GB200, offer a huge performance upgrade for AI companies, with 20 petaflops in AI performance versus 4 petaflops for the H100\. The additional processing power will enable AI companies to train bigger and more intricate models, Nvidia said.

Yes, that's a *5x* change in petaflops. But what about practical usage in real-world AI? Well, when put together in a new rack:

> Nvidia said that the system can deploy a 27-trillion-parameter model. That’s much larger than even the biggest models, such as GPT-4, which reportedly has 1.7 trillion parameters. Many artificial intelligence researchers believe bigger models with more parameters and data [could unlock new capabilities](https://openai.com/research/ai-and-compute?ref=spyglass.org).

---

1 NVIDIA is getting dangerously close to passing Apple -- yes, Apple -- [ in market cap](https://companiesmarketcap.com/?ref=spyglass.org). [Forget Intel](https://spyglass.org/intel-outside/), currently, Apple sits at $2.68T while NVIDIA is at $2.21T. In fact, they're basically as close to Apple as Apple is to current #1 Microsoft ($3.10T). Apple had a nice boost early on from their own [AI-related report today](https://spyglass.org/google-ai-iphone/), before settling back to reality. How much would Jensen Huang like to pass Apple, [do we think](https://appleinsider.com/articles/19/01/18/apples-management-doesnt-want-nvidia-support-in-macos-and-thats-a-bad-sign-for-the-mac-pro?ref=spyglass.org#:~:text=Then%20in%20October%202008%2C%20Apple,were%20causing%20the%20MacBook%20problems.)?