From the New World
From the New World
Martin Casado: AI's Hard Limits and Open Problems
1×
0:00
-48:08

Martin Casado: AI's Hard Limits and Open Problems

The Bitter Lesson, Anti-Monopoly Incentives, Information Theory, Synthetic Data, and Little Tech
Brian Chau
Sep 02, 2024
Share
Transcript

A 1960s cartoon-style image showing modern, sleek GPUs (graphics processing units) being tightly wrapped and held down by a comical, exaggerated hunting net. The net completely wraps around all the GPUs, creating a clear sense of them being bound together. Above the net, the words 'Entropy Bound' are written in bold, retro-style letters, fitting the 1960s cartoon aesthetic. The GPUs retain their modern look, featuring elements like RGB lighting, multiple fans, and intricate circuitry, but are depicted in a 60s art style. The overall scene maintains the classic cartoon vibe with bold lines and flat colors, focusing on the modern GPUs, the humorous hunting net that tightly wraps them, and the 'Entropy Bound' text above.

Timestamps:

1:57 Interview starts / Will there be an AI monopoly?

5:33 The Bitter Lesson

19:30 Government AI Scaling Projects

25:09 AI Agents Versus Information Theory

34:25 Little Tech and Politics

Find Martin:

https://a16z.com/author/martin-casado/

https://x.com/martin_casado

Mentioned in the Episode:

William Perry and Martin’s course at Stanford: https://web.stanford.edu/class/msande91si/slides/msande91si_course_information.pdf

US Senate AI Roadmap: https://www.politico.com/f/?id=0000018f-79a9-d62d-ab9f-f9af975d0000

Entropy bounds in Information Theory: https://en.wikipedia.org/wiki/Entropy_(information_theory)

Martin and Ion Stoica on Little Tech and Open Source: https://www.economist.com/by-invitation/2024/07/29/keep-the-code-behind-ai-open-say-two-entrepreneurs

0 Comments
From the New World
From the New World
THE podcast on institutions.
Listen on
Substack App
Spotify
RSS Feed
Appears in episode
Brian Chau
Recent Episodes
[Classic Episode] Erik Torenberg: Upstream of the Revolution
 • Brian Chau
Beyang Liu: Machine Learning That People Want
 • Brian Chau
Max Meyer: The New Needs Friends
 • Brian Chau
Isaac Simpson: The Aesthetics of a New America
 • Brian Chau and Isaac Simpson
Jeremy Carl: Who Protects the Unprotected Class
 • Brian Chau and Jeremy Carl
Matt Adelstein: Probable Arguments for God
 • Brian Chau and Bentham's Bulldog
Dean Ball: AI is Already Highly Regulated
 • Brian Chau and Dean W. Ball