Thumbnail for E167: Google's Woke AI disaster, Nvidia smashes earnings (again), Groq's LPU breakthrough & more

E167: Google's Woke AI disaster, Nvidia smashes earnings (again), Groq's LPU breakthrough & more


Episode Details
Channel

All-In Podcast

Published

2/23/2024

Episode Summary

In episode 167 of the All-In Podcast, hosts Jason Calacanis, Chamath Palihapitiya, David Sacks, and David Friedberg delve into the week's biggest tech stories. The primary focus is on Nvidia's extraordinary financial results, where a massive surge in demand for its GPUs—driven by the global Generative AI infrastructure buildout in Data centers by Cloud Service Providers like Google, Amazon, and Microsoft—led to a record-breaking market cap increase, surpassing a recent milestone set by Meta. David Sacks provides a cautionary analysis, comparing Nvidia's trajectory to that of Cisco during the dot-com bubble to question the company's long-term Terminal Value. A significant counterpoint to Nvidia's dominance emerges with Groq, a Deep Tech company in which Chamath Palihapitiya is the seed investor. Founded by Jonathan Ross, Groq had a viral moment showcasing its LPUs (Language Processing Units), which are demonstrably faster and cheaper for AI Inference, a distinct market from the Training market Nvidia dominates. This highlights the difficult, multi-year journey of Deep Tech ventures, with Elon Musk's Tesla and OpenAI cited as other examples of building a Competitive Moat. The conversation then shifts to Google's major public relations disaster with its Gemini AI. The model produced historically inaccurate images, which the hosts label a clear example of Woke AI. They attribute the failure to a flawed corporate culture, referencing a tweet from Paul Graham, where a monopoly allows non-performant ideologies to permeate product development through processes like Reinforcement Learning. This shift from information retrieval to Information Interpretation gives Google immense control, but the hosts, including CEO Sundar Pichai's critics, argue it has been used to sacrifice Truth (in AI). The debacle is seen as a massive opportunity for Open Source alternatives. The episode briefly concludes with David Sacks providing an update on the war between Russia and Ukraine.

Key Topics & People
Amazon
Amazon
Organization

A hyperscaler developing custom AI chips like Inferentia and Trainium.

Tesla
Organization

An electric vehicle company that utilizes Nvidia's hardware for its self-driving training computers.

Elon Musk
Elon Musk
Person

CEO of Tesla driving autonomous technology and humanoid robotics initiatives like Optimus.

CUDA
CUDA
Technology

Nvidia's proprietary software stack that serves as a massive strategic moat.

Meta
Meta
Organization

A prominent AI developer contributing heavily to open source via its Llama models.

Google
Google
Organization

A major tech company competing in the AI hardware space with its TPUs.

Gemini
Technology

Google's proprietary large language model for generative AI and reasoning.

OpenAI
OpenAI
Organization

A leading AI research organization known for its generative models and massive developer adoption.

Groq
Groq
Organization

A company discussed in relation to an acquisition by Nvidia to enhance AI inference capabilities.

Podcast host and investor discussed in the context of the Groq acquisition.

Podcast host who discusses the immense productivity gains achieved through AI in his business.

Nvidia
Nvidia
Organization

The world's most valuable tech company focusing on AI infrastructure and computing platforms.

CEO of Nvidia guiding the company's transition into an AI infrastructure giant.

Ukraine
Ukraine
PoliticalEntity

Eastern European nation under attack by Russia.

Russia
Russia
PoliticalEntity

Geopolitical adversary of the US, currently waging war in Ukraine.

All-In Podcast
Organization

The podcast hosting the interview with Senator John Fetterman.

Podcast host interviewing Travis Kalanick and Michael Dell live in Austin.

A host of the All-In Podcast who provides analysis on the SaaS market, arguing that AI is creating a new value layer on top of existing SaaS, rather than making it obsolete.

A software paradigm that China might use to distribute AI broadly for productivity rather than direct profit.

Microsoft
Microsoft
Organization

A major technology company that went public early, creating immense wealth for retail investors.

Cisco
Cisco
Organization

Major networking hardware company that announced a large acquisition in the software space.

Generative AI
Technology

Advanced AI systems that can generate text, images, and other media on demand.

Woke AI
Topic

A term used by David Sacks to describe AI models with a built-in political bias, which he considers an Orwellian threat that could be used for censorship and population control.

YouTube
YouTube
Organization

A video-sharing platform that has been involved in demonetization and labeling of content, particularly discussions that challenge official narratives.

PayPal
PayPal
Organization

A financial services company mentioned as an example of a 'risk averse middleman' that can be pressured to debank or demonetize individuals or groups for their speech.

GPUs
Technology

Graphics Processing Units, essential hardware for training and running powerful AI models, both in the cloud and on local workstations.

The CEO of Google, whose leadership is implicitly discussed in the context of Google's launch of Gemini and the company's strategic imperative to compete in the AI space.

Founder and CEO of Groq and the founder of Google's TPU. Chamath interviewed him about the AI landscape and AI acceleration.

The process of using a trained AI model to generate an output or prediction for a user. This task prioritizes speed and low cost, representing a distinct market segment from AI training.

A new class of processor developed by Groq, specifically designed for the speed and cost efficiency needed for AI inference tasks, as opposed to training.

The computationally intensive process of building an AI model by feeding it massive datasets. This is the market segment currently dominated by Nvidia's high-powered GPUs.

CPUs
Technology

Central Processing Units, the traditional workhorse of computing. Their serial processing nature is contrasted with the parallel processing capabilities of GPUs, which are far better suited for AI workloads.

A sustainable competitive advantage. The discussion covers Nvidia's deep moat built on hardware and software (CUDA), and how 'deep tech' companies like Groq aim to build their own moats through years of difficult R&D.

A business model shift from information retrieval (like search results) to providing a synthesized, single answer. This gives AI providers like Google significant power to shape the information presented, introducing the risk of bias.

A central theme in the critique of Google's Gemini, with the hosts arguing that the primary objective of any AI product must be accuracy and truthfulness, not the promotion of a social or political ideology.

Companies like Amazon AWS, Google Cloud, and Microsoft Azure that are the largest purchasers of Nvidia's GPUs. They are building the next generation of cloud infrastructure for AI applications.

A category of companies founded on significant scientific or engineering innovation. These ventures, like Groq or SpaceX, typically have long, capital-intensive development cycles but can result in highly defensible, market-defining businesses.

An investment concept referring to the value of a business beyond a specific forecast period. The hosts debate Nvidia's terminal value, questioning if the current AI buildout is a one-time event or a sustainable, recurring revenue stream.

Co-founder of Y Combinator. His tweet is referenced to explain how a company with a monopoly (like Google) can develop a dysfunctional or non-performant culture without facing immediate market consequences.

Reinforcement Learning
ScientificConcept

A machine learning technique, specifically Reinforcement Learning from Human Feedback (RLHF), used to fine-tune AI models. It is identified as a key process where human biases were explicitly encoded into Google's Gemini.

Data centers
Technology

Large-scale facilities that house servers and networking equipment. The massive, accelerated buildout of AI-specific data centers is the primary driver of Nvidia's revenue.