Thumbnail for E167: Google's Woke AI disaster, Nvidia smashes earnings (again), Groq's LPU breakthrough & more

E167: Google's Woke AI disaster, Nvidia smashes earnings (again), Groq's LPU breakthrough & more


Episode Details
Channel

All-In Podcast

Published

2/23/2024

Episode Summary

In episode 167 of the All-In Podcast, hosts Jason Calacanis, Chamath Palihapitiya, David Sacks, and David Friedberg delve into the week's biggest tech stories. The primary focus is on Nvidia's extraordinary financial results, where a massive surge in demand for its GPUs—driven by the global Generative AI infrastructure buildout in Data centers by Cloud Service Providers like Google, Amazon, and Microsoft—led to a record-breaking market cap increase, surpassing a recent milestone set by Meta. David Sacks provides a cautionary analysis, comparing Nvidia's trajectory to that of Cisco during the dot-com bubble to question the company's long-term Terminal Value. A significant counterpoint to Nvidia's dominance emerges with Groq, a Deep Tech company in which Chamath Palihapitiya is the seed investor. Founded by Jonathan Ross, Groq had a viral moment showcasing its LPUs (Language Processing Units), which are demonstrably faster and cheaper for AI Inference, a distinct market from the Training market Nvidia dominates. This highlights the difficult, multi-year journey of Deep Tech ventures, with Elon Musk's Tesla and OpenAI cited as other examples of building a Competitive Moat. The conversation then shifts to Google's major public relations disaster with its Gemini AI. The model produced historically inaccurate images, which the hosts label a clear example of Woke AI. They attribute the failure to a flawed corporate culture, referencing a tweet from Paul Graham, where a monopoly allows non-performant ideologies to permeate product development through processes like Reinforcement Learning. This shift from information retrieval to Information Interpretation gives Google immense control, but the hosts, including CEO Sundar Pichai's critics, argue it has been used to sacrifice Truth (in AI). The debacle is seen as a massive opportunity for Open Source alternatives. The episode briefly concludes with David Sacks providing an update on the war between Russia and Ukraine.

Investment Ideas
Key Topics & People
Elon Musk
Elon Musk
Person

CEO of Tesla and SpaceX, referenced regarding Walter Isaacson's upcoming biography.

Host on the All-In Podcast who was absent during this episode.

Host on the All-In Podcast and entrepreneur.

Host on the All-In Podcast, software investor, and venture capitalist.

Host and moderator of the All-In Podcast.

Nvidia
Nvidia
Organization

Leading tech company that Dan Loeb is currently buying stock in.

PayPal
PayPal
Organization

A legacy payments company struggling in a race-to-the-bottom sector.

All-In Podcast
Organization

The show hosting the overarching discussion on economics, politics, and culture.

Meta
Meta
Organization

The parent company of Facebook, heavily involved in open-sourcing hardware designs and AI models.

OpenAI
OpenAI
Organization

An AI research and deployment company that created ChatGPT.

Tesla
Organization

An electric vehicle and AI company building massive supercomputers for physical world inference.

Google
Google
Organization

A leading technology company that developed its own AI chips and is active in AI model development.

Microsoft
Microsoft
Organization

A major tech company heavily investing in AI infrastructure and dealing with M&A regulatory challenges.

Amazon
Amazon
Organization

A major technology company developing its own proprietary silicon and AI capabilities.

Generative AI
Technology

Advanced AI models capable of generating insights, reasoning, and context for autonomous robotic systems.

CEO of Google, responsible for leading its massive AI infrastructure push.

Gemini
Technology

Google's flagship generative AI model integrated into its enterprise workflows.

CEO of Nvidia, known for guiding the company's AI hardware dominance

The imperative for large language models to provide factual and unbiased information to retain user trust.

CUDA
CUDA
Technology

Nvidia's parallel computing platform that created an entrenched software moat for AI and high-performance computing.

Groq
Groq
Organization

Hardware company focused on high-speed inference processing for AI.

Technology based on substantial scientific or engineering challenges.

GPUs
Technology

Graphics Processing Units, fundamental hardware for AI infrastructure.

Russia
Russia
PoliticalEntity

A country involved in a geopolitical conflict that has strained supply chains and accelerated global inflation.

Ukraine
Ukraine
PoliticalEntity

A nation in conflict where massive artillery and explosive usage is directly depleting global copper supplies.

CPUs
Technology

Central Processing Units experiencing a huge resurgence in intensity, driving demand for new semiconductor fabs.

Cisco
Cisco
Organization

Networking company that successfully captured market share during the rise of data networking.

Companies offering cloud computing infrastructure, allowing OpenAI to convert CapEx to OpEx.

A movement in software development seen as a major competitive threat to the closed, proprietary models of companies like Anthropic and OpenAI.

YouTube
YouTube
Organization

Video platform facing legal scrutiny over algorithmic addiction and child safety.

Business advantages like brand, network effects, or hardware that protect against AI disruption.

Woke AI
Topic

A term used by David Sacks to describe AI models with a built-in political bias, which he considers an Orwellian threat that could be used for censorship and population control.

Founder and CEO of Groq and the founder of Google's TPU. Chamath interviewed him about the AI landscape and AI acceleration.

The process of using a trained AI model to generate an output or prediction for a user. This task prioritizes speed and low cost, representing a distinct market segment from AI training.

A new class of processor developed by Groq, specifically designed for the speed and cost efficiency needed for AI inference tasks, as opposed to training.

The computationally intensive process of building an AI model by feeding it massive datasets. This is the market segment currently dominated by Nvidia's high-powered GPUs.

A business model shift from information retrieval (like search results) to providing a synthesized, single answer. This gives AI providers like Google significant power to shape the information presented, introducing the risk of bias.

An investment concept referring to the value of a business beyond a specific forecast period. The hosts debate Nvidia's terminal value, questioning if the current AI buildout is a one-time event or a sustainable, recurring revenue stream.

Co-founder of Y Combinator. His tweet is referenced to explain how a company with a monopoly (like Google) can develop a dysfunctional or non-performant culture without facing immediate market consequences.

Reinforcement Learning
ScientificConcept

A machine learning technique, specifically Reinforcement Learning from Human Feedback (RLHF), used to fine-tune AI models. It is identified as a key process where human biases were explicitly encoded into Google's Gemini.

Data centers
Technology

Large-scale facilities that house servers and networking equipment. The massive, accelerated buildout of AI-specific data centers is the primary driver of Nvidia's revenue.