Trends

Nvidia at a crossroads in AI evolution

What happened: A strategic inflection point for Nvidia’s AI future At its annual GTC conference last week, Nvidia attempted to regain control of the AI narrative after a rocky start to the year. From the DeepSeek scandal to the underwhelming reception of the RTX 50-Series, 2024 has tested investor c…

Nvidia-decentralisation-challenge

Headline

What happened: A strategic inflection point for Nvidia’s AI future At its annual GTC conference last week, Nvidia attempted to regain control of the AI narrative after a rocky start to the year. From the DeepSeek scandal to the underwhelming reception of the RTX 50-Series, 2024…

Context

At its annual GTC conference last week, Nvidia attempted to regain control of the AI narrative after a rocky start to the year. From the DeepSeek scandal to the underwhelming reception of the RTX 50-Series, 2024 has tested investor confidence in the semiconductor giant. But new concerns have surfaced regarding the company’s long-term direction—especially its reliance on ultra-high-end, expensive GPUs as the cornerstone of its AI infrastructure strategy. Tory Green, CEO of GPU aggregator io.net, drew a sharp parallel in an interview with Capacity , warning that Nvidia could suffer the same fate as IBM. Once a dominant force in computing, IBM fell behind as the industry shifted towards decentralised, cost-efficient models. According to Green, Nvidia’s $30,000 GPUs are already out of step with the evolving demands of AI workloads.

Evidence

Pending intelligence enrichment.

Analysis

Green’s argument centres on decentralisation: a shift towards distributing compute tasks across a diverse array of lower-cost GPU resources, rather than consolidating them in hyperscale data centres filled with expensive hardware. This model—fostered by edge providers, smaller data centres, and even individual contributors—can intelligently pair tasks with the right performance tier, reducing inefficiencies and costs. Nvidia has acknowledged some need for change. The company has recently pivoted towards photonics and quantum computing, reversing its earlier dismissals. CEO Jensen Huang announced a new quantum research centre in Boston and launched “Quantum Day” at GTC. But critics like Green suggest these moves may be reactive rather than visionary. In particular, Nvidia’s pricing remains a concern. Analysts note that its Blackwell chips are costlier to manufacture than prior generations, potentially undermining margins. If decentralised models gain traction, Nvidia’s centralised approach could become a costly liability rather than a strategic advantage. Also read: DigitalBridge CEO on AI infrastructure and investment trends Also read: Iliad Group invests $3B in AI infrastructure

Key Points

  • GPU aggregator warns Nvidia risks IBM-like decline amid centralised AI strategy
  • High-end $30,000 GPUs seen as misaligned with scalable, decentralised AI future

Actions

Pending intelligence enrichment.

Author

JoyceDong