Thumbnail for E167: Google's Woke AI disaster, Nvidia smashes earnings (again), Groq's LPU breakthrough & more

E167: Google's Woke AI disaster, Nvidia smashes earnings (again), Groq's LPU breakthrough & more


Episode Details
Channel

All-In Podcast

Published

2/23/2024

Episode Summary

In episode 167 of the All-In Podcast, hosts Jason Calacanis, Chamath Palihapitiya, David Sacks, and David Friedberg delve into the week's biggest tech stories. The primary focus is on Nvidia's extraordinary financial results, where a massive surge in demand for its GPUs—driven by the global Generative AI infrastructure buildout in Data centers by Cloud Service Providers like Google, Amazon, and Microsoft—led to a record-breaking market cap increase, surpassing a recent milestone set by Meta. David Sacks provides a cautionary analysis, comparing Nvidia's trajectory to that of Cisco during the dot-com bubble to question the company's long-term Terminal Value. A significant counterpoint to Nvidia's dominance emerges with Groq, a Deep Tech company in which Chamath Palihapitiya is the seed investor. Founded by Jonathan Ross, Groq had a viral moment showcasing its LPUs (Language Processing Units), which are demonstrably faster and cheaper for AI Inference, a distinct market from the Training market Nvidia dominates. This highlights the difficult, multi-year journey of Deep Tech ventures, with Elon Musk's Tesla and OpenAI cited as other examples of building a Competitive Moat. The conversation then shifts to Google's major public relations disaster with its Gemini AI. The model produced historically inaccurate images, which the hosts label a clear example of Woke AI. They attribute the failure to a flawed corporate culture, referencing a tweet from Paul Graham, where a monopoly allows non-performant ideologies to permeate product development through processes like Reinforcement Learning. This shift from information retrieval to Information Interpretation gives Google immense control, but the hosts, including CEO Sundar Pichai's critics, argue it has been used to sacrifice Truth (in AI). The debacle is seen as a massive opportunity for Open Source alternatives. The episode briefly concludes with David Sacks providing an update on the war between Russia and Ukraine.

Key Topics & People
YouTube
YouTube
Organization

Video platform facing legal scrutiny over algorithmic addiction and child safety.

Meta
Meta
Organization

Tech giant facing major lawsuits over child safety and platform addiction.

Tesla
Organization

Innovative auto company led by Elon Musk, disrupting traditional car brands.

Elon Musk
Elon Musk
Person

CEO of Tesla and SpaceX, recognized for relentless hardware innovation.

CEO of Nvidia, noted for calling out the AI inflection point.

Nvidia
Nvidia
Organization

Highly profitable AI chip manufacturer driving the AI infrastructure buildout.

Microsoft
Microsoft
Organization

Tech company heavily invested in AI and cloud infrastructure.

Podcast host, investor, and organizer of the All-In Liquidity Conference.

Podcast host, scientist, and newly appointed member of PCAST.

Podcast host, investor, and newly appointed co-chair of PCAST.

Podcast host and tech investor discussing consumer AI trends.

Business advantages like brand, network effects, or hardware that protect against AI disruption.

Gemini
Technology

Google's AI model competing in the consumer and enterprise space.

Google
Google
Organization

Tech giant competing vigorously in consumer AI with its Gemini models.

OpenAI
OpenAI
Organization

AI lab facing strategic shifts, focusing on enterprise while adjusting consumer projects.

Generative AI
Technology

The overarching breakthrough technology driving the current market supercycle and reshaping industries.

All-In Podcast
Organization

The podcast featuring the interview on longevity, psychedelics, and technology.

GPUs
Technology

Graphics Processing Units used extensively for AI compute.

Groq
Groq
Organization

AI chipmaker known for high-speed LPUs, mentioned alongside Nvidia.

Amazon
Amazon
Organization

A hyperscaler developing custom AI chips like Inferentia and Trainium.

CUDA
CUDA
Technology

Nvidia's proprietary software stack that serves as a massive strategic moat.

Ukraine
Ukraine
PoliticalEntity

Eastern European nation under attack by Russia.

Russia
Russia
PoliticalEntity

Geopolitical adversary of the US, currently waging war in Ukraine.

A software paradigm that China might use to distribute AI broadly for productivity rather than direct profit.

Cisco
Cisco
Organization

Major networking hardware company that announced a large acquisition in the software space.

Woke AI
Topic

A term used by David Sacks to describe AI models with a built-in political bias, which he considers an Orwellian threat that could be used for censorship and population control.

PayPal
PayPal
Organization

A financial services company mentioned as an example of a 'risk averse middleman' that can be pressured to debank or demonetize individuals or groups for their speech.

The CEO of Google, whose leadership is implicitly discussed in the context of Google's launch of Gemini and the company's strategic imperative to compete in the AI space.

Founder and CEO of Groq and the founder of Google's TPU. Chamath interviewed him about the AI landscape and AI acceleration.

The process of using a trained AI model to generate an output or prediction for a user. This task prioritizes speed and low cost, representing a distinct market segment from AI training.

A new class of processor developed by Groq, specifically designed for the speed and cost efficiency needed for AI inference tasks, as opposed to training.

The computationally intensive process of building an AI model by feeding it massive datasets. This is the market segment currently dominated by Nvidia's high-powered GPUs.

CPUs
Technology

Central Processing Units, the traditional workhorse of computing. Their serial processing nature is contrasted with the parallel processing capabilities of GPUs, which are far better suited for AI workloads.

A business model shift from information retrieval (like search results) to providing a synthesized, single answer. This gives AI providers like Google significant power to shape the information presented, introducing the risk of bias.

A central theme in the critique of Google's Gemini, with the hosts arguing that the primary objective of any AI product must be accuracy and truthfulness, not the promotion of a social or political ideology.

Companies like Amazon AWS, Google Cloud, and Microsoft Azure that are the largest purchasers of Nvidia's GPUs. They are building the next generation of cloud infrastructure for AI applications.

A category of companies founded on significant scientific or engineering innovation. These ventures, like Groq or SpaceX, typically have long, capital-intensive development cycles but can result in highly defensible, market-defining businesses.

An investment concept referring to the value of a business beyond a specific forecast period. The hosts debate Nvidia's terminal value, questioning if the current AI buildout is a one-time event or a sustainable, recurring revenue stream.

Co-founder of Y Combinator. His tweet is referenced to explain how a company with a monopoly (like Google) can develop a dysfunctional or non-performant culture without facing immediate market consequences.

Reinforcement Learning
ScientificConcept

A machine learning technique, specifically Reinforcement Learning from Human Feedback (RLHF), used to fine-tune AI models. It is identified as a key process where human biases were explicitly encoded into Google's Gemini.

Data centers
Technology

Large-scale facilities that house servers and networking equipment. The massive, accelerated buildout of AI-specific data centers is the primary driver of Nvidia's revenue.