Thumbnail for E167: Google's Woke AI disaster, Nvidia smashes earnings (again), Groq's LPU breakthrough & more

E167: Google's Woke AI disaster, Nvidia smashes earnings (again), Groq's LPU breakthrough & more


Episode Details
Channel

All-In Podcast

Published

2/23/2024

Episode Summary

In episode 167 of the All-In Podcast, hosts Jason Calacanis, Chamath Palihapitiya, David Sacks, and David Friedberg delve into the week's biggest tech stories. The primary focus is on Nvidia's extraordinary financial results, where a massive surge in demand for its GPUs—driven by the global Generative AI infrastructure buildout in Data centers by Cloud Service Providers like Google, Amazon, and Microsoft—led to a record-breaking market cap increase, surpassing a recent milestone set by Meta. David Sacks provides a cautionary analysis, comparing Nvidia's trajectory to that of Cisco during the dot-com bubble to question the company's long-term Terminal Value. A significant counterpoint to Nvidia's dominance emerges with Groq, a Deep Tech company in which Chamath Palihapitiya is the seed investor. Founded by Jonathan Ross, Groq had a viral moment showcasing its LPUs (Language Processing Units), which are demonstrably faster and cheaper for AI Inference, a distinct market from the Training market Nvidia dominates. This highlights the difficult, multi-year journey of Deep Tech ventures, with Elon Musk's Tesla and OpenAI cited as other examples of building a Competitive Moat. The conversation then shifts to Google's major public relations disaster with its Gemini AI. The model produced historically inaccurate images, which the hosts label a clear example of Woke AI. They attribute the failure to a flawed corporate culture, referencing a tweet from Paul Graham, where a monopoly allows non-performant ideologies to permeate product development through processes like Reinforcement Learning. This shift from information retrieval to Information Interpretation gives Google immense control, but the hosts, including CEO Sundar Pichai's critics, argue it has been used to sacrifice Truth (in AI). The debacle is seen as a massive opportunity for Open Source alternatives. The episode briefly concludes with David Sacks providing an update on the war between Russia and Ukraine.

Key Topics & People
Ukraine
Ukraine
PoliticalEntity

Eastern European nation under attack by Russia.

Russia
Russia
PoliticalEntity

Geopolitical adversary of the US, currently waging war in Ukraine.

All-In Podcast
Organization

The podcast hosting the interview with Senator John Fetterman.

Co-host of the All-In Podcast who interviewed Senator John Fetterman on various political and economic topics.

Amazon
Amazon
Organization

Tech giant heavily referenced for establishing the modern e-commerce and logistics infrastructure that Atoms seeks to emulate for food.

Google
Google
Organization

Tech giant historically feared by startups, now providing open models like Gemma and leading AI development.

OpenAI
OpenAI
Organization

Leading AI research lab and creator of ChatGPT, mentioned regarding open-source models and AI scaling.

Nvidia
Nvidia
Organization

Dominant AI chip designer, referenced as a foundational holding in the proposed Invest America accounts.

Tesla
Organization

Electric vehicle and AI company building self-driving tech and humanoid robotics, praised by Kalanick as the 'Google' of physical AI.

Elon Musk
Elon Musk
Person

CEO of Tesla and Boring Company, noted for moving his businesses out of California to Texas due to a better operating environment.

Podcast host interviewing Travis Kalanick and Michael Dell live in Austin.

A host of the All-In Podcast who provides analysis on the SaaS market, arguing that AI is creating a new value layer on top of existing SaaS, rather than making it obsolete.

A software paradigm that China might use to distribute AI broadly for productivity rather than direct profit.

CEO of Nvidia, heavily investing in the AI scaling and foundational model companies.

Microsoft
Microsoft
Organization

A major technology company that went public early, creating immense wealth for retail investors.

Co-host of the All-In Podcast participating in the capital markets discussion.

Gemini
Technology

Google's AI model suite, permitted for lawful use cases within classified military networks.

Cisco
Cisco
Organization

Major networking hardware company that announced a large acquisition in the software space.

Meta
Meta
Organization

The social technology titan aggressively pushing into the wearables market with new smart hardware to capture ambient AI workflows.

Generative AI
Technology

Advanced AI systems that can generate text, images, and other media on demand.

Woke AI
Topic

A term used by David Sacks to describe AI models with a built-in political bias, which he considers an Orwellian threat that could be used for censorship and population control.

YouTube
YouTube
Organization

A video-sharing platform that has been involved in demonetization and labeling of content, particularly discussions that challenge official narratives.

PayPal
PayPal
Organization

A financial services company mentioned as an example of a 'risk averse middleman' that can be pressured to debank or demonetize individuals or groups for their speech.

GPUs
Technology

Graphics Processing Units, essential hardware for training and running powerful AI models, both in the cloud and on local workstations.

The CEO of Google, whose leadership is implicitly discussed in the context of Google's launch of Gemini and the company's strategic imperative to compete in the AI space.

Founder and CEO of Groq and the founder of Google's TPU. Chamath interviewed him about the AI landscape and AI acceleration.

Groq
Groq
Organization

A startup building proprietary hardware for AI, co-founded by Jonathan Ross. Chamath funded it in 2016 and sees it as a key 'picks and shovels' player.

The process of using a trained AI model to generate an output or prediction for a user. This task prioritizes speed and low cost, representing a distinct market segment from AI training.

A new class of processor developed by Groq, specifically designed for the speed and cost efficiency needed for AI inference tasks, as opposed to training.

The computationally intensive process of building an AI model by feeding it massive datasets. This is the market segment currently dominated by Nvidia's high-powered GPUs.

CPUs
Technology

Central Processing Units, the traditional workhorse of computing. Their serial processing nature is contrasted with the parallel processing capabilities of GPUs, which are far better suited for AI workloads.

A sustainable competitive advantage. The discussion covers Nvidia's deep moat built on hardware and software (CUDA), and how 'deep tech' companies like Groq aim to build their own moats through years of difficult R&D.

A business model shift from information retrieval (like search results) to providing a synthesized, single answer. This gives AI providers like Google significant power to shape the information presented, introducing the risk of bias.

A central theme in the critique of Google's Gemini, with the hosts arguing that the primary objective of any AI product must be accuracy and truthfulness, not the promotion of a social or political ideology.

Companies like Amazon AWS, Google Cloud, and Microsoft Azure that are the largest purchasers of Nvidia's GPUs. They are building the next generation of cloud infrastructure for AI applications.

A category of companies founded on significant scientific or engineering innovation. These ventures, like Groq or SpaceX, typically have long, capital-intensive development cycles but can result in highly defensible, market-defining businesses.

An investment concept referring to the value of a business beyond a specific forecast period. The hosts debate Nvidia's terminal value, questioning if the current AI buildout is a one-time event or a sustainable, recurring revenue stream.

CUDA
CUDA
Technology

Nvidia's parallel computing platform and programming model. It represents a massive software-based competitive moat, as the AI ecosystem is largely built on it, making it difficult for developers to switch to competing hardware.

Co-founder of Y Combinator. His tweet is referenced to explain how a company with a monopoly (like Google) can develop a dysfunctional or non-performant culture without facing immediate market consequences.

Reinforcement Learning
ScientificConcept

A machine learning technique, specifically Reinforcement Learning from Human Feedback (RLHF), used to fine-tune AI models. It is identified as a key process where human biases were explicitly encoded into Google's Gemini.

Data centers
Technology

Large-scale facilities that house servers and networking equipment. The massive, accelerated buildout of AI-specific data centers is the primary driver of Nvidia's revenue.