Acquired - NVIDIA CEO Jensen Huang

0:00I will say, David, I would love to have Nvidia's full production team every episode. It was nice not having to worry about turning the cameras on and off and making sure that nothing bad happened myself while we were recording this. Yeah, just the gear. I mean, the drives that came out of the camera. All right, red cameras for the home studio starting next episode. Yeah, good. All right, let's do it.

0:30Welcome to this episode of Acquired, the podcast about great technology companies and the stories and playbooks behind them. I'm Ben Gilbert. I'm David Rosenthal. And we are your hosts. Listeners, just so we don't bury the lead, this episode was insanely cool for David and I. Yeah.

0:58After researching Nvidia for something like 500 hours over the last two years, we flew down to Nvidia headquarters to sit down with Jensen himself. And Jensen of course is the founder and CEO of Nvidia, the company powering this whole AI explosion at the time of recording Nvidia is worth $1.1 trillion and is the sixth most valuable company in the entire world. And right now is a crucible moment for the company.

1:26Expectations are set high. I mean, sky high. They have about the most impressive strategic position and lead against their competitors of any company that we've ever studied. But here's the question that everyone is wondering, will NVIDIA's insane prosperity continue for years to come? Is AI going to be the next trillion dollar technology wave? How sure are we of that? And if so, can NVIDIA actually maintain their ridiculous dominance as this market comes to take shape?

1:56So Jensen takes us down memory lane with stories of how they went from graphics to the data center to AI, how they survived multiple near-death experiences. He also has plenty of advice for founders and he shared an emotional side to the founder journey toward the end of the episode. Yeah, I got a new perspective on the company and on him as a founder and a leader just from doing this despite you know we thought we knew everything before we came in advance and uh it turned out we didn't turns out the protagonist actually knows more yes. All right well listeners join the slack there is incredible discussion of everything about this company AI the whole ecosystem and a bunch of other episodes that we've done recently going on in there right now so that is acquired dot fm slash slack we would love to see you.

2:43And without further ado, this show is not investment advice. David and I may have investments in the companies we discuss. And this show is for informational and entertainment purposes only on to Jensen. So Jensen, this is acquired. So we want to start with story time. So we want to wind the clock all the way back to, I believe it was 1997. You're getting ready to ship the Riva 128, which is one of the largest graphics chips ever created in the history of computing.

3:12It is the first fully 3D accelerated graphics pipeline for a computer. And you guys have about six months of cash left. And so you decide to... do the entire testing in simulation rather than ever receiving a physical prototype. You commission the production run site unseen with the rest of the company's money. So you're betting it all right here on the Riva 128. It comes back and of the 32 DirectX blend modes, it supports eight of them. And you have to convince the market to buy it and you've got to convince developers not to use anything but those eight blend modes.

3:54Walk us through what that felt like. The other 24 weren't that important. Okay, so wait a minute. First question. Was that the plan all a lot? Like when did you realize the link? I realized I didn't learn about it until it was too late. We should have implemented all 32. Yeah, but we built and so we had to make the best of it. That was really an extraordinary time. Remember, Riva 120 was MV3. MV1 and MV2 were based on forward texture mapping.

4:24no triangles, but curves, and it testulated the curves. And because we were rendering higher-level objects, we essentially avoided using Z-buffers. And we thought that was going to be a good rendering approach, and turns out to have been completely the wrong answer. And so what Revo Run28 was was a reset of our company. Now remember, at the time that we started the company in 1993, we were the only consumer 3D graphics company ever created.

4:51We were focused on transforming the PC into an accelerated PC because at the time, Windows was really a software rendered system. And so anyways, Riva 128 was a reset of our company because by the time that we realized we had gone down the wrong road, Microsoft had already rolled out DirectX. It was fundamentally incompatible with NVIDIA's architecture. 30 competitors have already shown up even though we were the first company at the time that we were founded.

5:19so the world was a completely different place. The question about what to do as a company's strategy, at that point, I would have said that we made a whole bunch of wrong decisions, but on that day that mattered, we made a sequence of extraordinarily good decisions. And that time, 1997, was probably in video's best moment. And the reason for that was our backs were up against the wall, we were running out of time, we're running out of money, and for a lot of employees running out of hope.

5:49And the question is, what do we do? Well, the first thing that we did was we decided that, look, do we have access now here? We're not going to fight it. Let's go figure out a way to build the best thing in the world for it. And Rivo 128 is the world's first fully accelerated hardware accelerated pipeline for rendering 3D. And so, the transform, the projection, every single element all the way down to the frame buffer was completely hardware accelerated.

6:16We implemented a texture cache. We took the bus limit, the frame buffer limit too, as big as physics could afford in time. We made the biggest chip that anybody had ever imagined building. We used the fastest memories. Basically, if we built that chip, there could be nothing that could be faster. And we also chose a cost point that is...

6:42substantially higher than the highest price that we think that any of our competitors would be willing to go. If we built it right, we accelerated everything, we implemented everything in DirectX that we knew of, and we built it as large as we possibly could, then obviously nobody can build something faster than that. Today, in a way, you kind of do that here at NVIDIA too. You were a consumer products company back then, right? There was end consumers who were going to have to pay the money to buy them. That's right. But we observed that there was a segment of the market where people were, because at the time, the PC industry was still coming up and it wasn't good enough. Everybody was clamoring for the next fastest thing. And so, if your performance was 10 times higher this year than what was available, there's a whole large market of enthusiasts who we believe would have gone after it. And we were absolutely right that the PC industry had a substantially large enthusiast market that would buy the best of everything. To this day, it kind of remains true.

7:42And for certain segments at a market where the technology is never good enough, like 3D graphics, when we chose the right technology, 3D graphics is never good enough. And we call it back there. 3D gives us sustainable technology opportunity because it's never good enough. And so your technology can keep getting better. We chose that. We also made the decision to use this technology called emulation. There was a company called ICOs. And on the day that I called them, they were just shutting the company down because they had no customers.

8:10And I said, hey, look, I'll buy what you have in the inventory and, you know, no promises are necessary. And the reason why we needed that emulator is because if you figure it out how much money that we have, if we taped out a chip and we got it back from the fab and we started working on our software, by the time that we found all the bugs because we did the software, then we taped out the chip again. Well, we would have been out of business already. Yeah. And so I knew your competitors would have.

8:40Caught up? Well, not to mention we would have been out of business. Who cares? Exactly. So if you're going to be out of business anyways, that plan obviously wasn't the plan. The plan that companies normally go through, which is, you know, build the chip, write the software, fix the bugs, tape out the new chip, so on and so forth, that method wasn't going to work. And so the question is, if we only had six months and you get to tape out just one time, then obviously you're going to tape out a perfect chip.

9:09So I remember having conversations with our leaders and they said, but Jensen, how do you know it's going to be perfect? I said, I know it's going to be perfect because if it's not, we'll be out of business. And so let's make it perfect. We get one shot. We essentially virtually prototype the chip by buying this emulator. And Dwight and the software team wrote our software the entire stack and ran it on this emulator and just sat in the lab waiting for Windows to paint.

9:36you know, and it was like 60 pounds per frame or something like that. I actually think that it was an hour per frame, something like that. And so we just sit there and watch a paint. And so on the day that we decided to tape out, I assumed that the chip was perfect. And everything that we could have tested, we tested in advance. And told everybody, this is it. We're going to tape out the chip. It's going to be perfect. Well, if you're going to tape out a chip and you know it's perfect, then what else would you do? That's actually the good question.

10:03If you knew that you hit enter, you taped out a chip and you knew it was gonna be perfect, then what else would you do? Well, the answer, obviously, go to production. And marketing blitz. Yeah, yeah. And developer. Kick everything off. Because you got a perfect chip. And so we got in our head that we have a perfect chip. How much of this was you and how much of this was like your co-founders, the rest of the company, and the board, was everybody telling you you were crazy? No, everybody was clear. We had no shot. Not doing it would be crazy.

10:33because otherwise you might as well go home. Yeah, you're going to be out of business anyways. So anything aside from that is crazy. So it seems like a fairly logical thing and quite frankly right now I'm describing it every, you're probably thinking, yeah, it's pretty sensible. Well it worked. Yeah. And so we take that out and went directly to production. So is the lesson for founders out there when you have conviction on something like the Revo 128 or CUDA go bet the company on it?

11:01And this keeps working for you. So it seems like you're less in learned from this is, yes, keep pushing all the chips in because so far it's worked every time. How do you think about that? No, no, no. When you push your chips in, I know it's going to work. Notice, we assume that we taped out a perfect chip. The reason why we taped out a perfect chip is because we emulated the whole chip before we taped it out. We developed the entire software stack.

11:27We ran QA on all the drivers and all the software. We ran all the games we had. We ran every VGA application we had. And so when you push your chips in, what you're really doing is when you bet the farm, you're saying, I'm going to take everything in the future, all the risky things, and I pull it in advance. And that is probably the lesson. And to this day, everything that we can pre-fetch, everything in the future that we can simulate today, we pre-fetch it.

11:54We talk about this a lot. We're just talking about this on our Costco episode. You want to push your chips in when you know it's going to work. So every time we see you make the company move, you've already simulated it. Do you feel like that was the case with CUDA? Yeah. In fact, before there was CUDA, there was CG. Right. And so we were already playing with the concept of how do we create an abstraction layer above our chip?

12:22that is expressable in a higher level language and higher level expression. And how can we use our GPU for things like CT reconstruction, image processing? We were already down that path. And so there were some positive feedback and some intuitive positive feedback that we think that the general purpose computing could be possible. And you just looked at the pipeline of a programmable shader. It is a processor and is a highly parallel.

12:48It is massively threaded, and it is the only processor in the world that does that. And so there are a lot of characteristics about programmable shading that would suggest that Cuda has a great opportunity to succeed. And that is true if...

13:02there was a large market of machine learning practitioners who would eventually show up and want to do all this great scientific computing and accelerated computing. But at the time when you were starting to invest, what is now something like 10,000 person years in building that platform. Did you ever feel like, oh man, we might have invested a head of the demand for machine learning since we're like a decade before the whole world is realizing it? I guess yes and no.

13:31You know, when we saw deep learning, when we saw Alex Net and realized it's incredible effectiveness and computer vision, we had the good sense, if you will, to go back to first principles and ask, you know, what is it about this thing that made it so successful? When a new software technology, a new algorithm comes along and somehow leapfrogs, 30 years of computer vision work, you have to take a step back and ask yourself, but why?

13:59And fundamentally, is it scalable? And if it's scalable, what are the problems can it solve? And there were several observations that we made. The first observation, of course, is that if you have a whole lot of example data, you could teach this function to make predictions. Well, what we've basically done is discovered a universal function approximator. Because the dimensionality could be as high as you wanted to be. And because each layer is trained one layer at a time, there's no reason why you can make very, very deep neural networks. Okay, so now you just reason your way through. Right. Okay, so now I go back to 12 years ago. You could just imagine the reasoning I'm going through in my head that we've discovered an universal function approximator. In fact, we might have discovered with a couple more technologies, a universal computer that you can bring attention to the ImageNet competition for your leading up to this. Yeah, yeah. And the reason for that is because we're already working on computer vision at the time, and we were trying to get CUDA to be a good computer vision system.

14:57or most of the algorithms that were creative for computer vision aren't good fit for kuda and so we're sitting there trying to figure it out all of a sudden Alex net shows up. And so that was incredibly intriguing. It's so effective that it makes you take us back and ask yourself why is it happening. So by the time that you reason your way through this you go well what are the kind of problems in the world where universal functional proximate or. Yeah, it's all right well we know that most of our algorithms start from.

15:27principled sciences. You want to understand the causality, and from the causality you create a simulation algorithm that allows us to scale. Well, for a lot of problems, we kind of don't care about the causality. We just care about the predictability of it. Like, do I really care for what reason you prefer this toothpaste over that? I don't really care the causality. I just want to know that this is the one you were to predict it. Do I really care the fundamental cause of somebody who buys a hot dog buys ketchup and mustard. It doesn't really matter. It only matters that I can predict it. It applies to predicting movies, predicting music. It applies to predicting, quite frankly, weather. We understand thermal dynamics. We understand radiation from the sun. We understand cloud effects. We understand oceanic effects. We understand all these different things. We just want to know whether we should work.

16:22Twitter or not, is that right? And so, causality for a lot of problems in the world doesn't matter. We just want to emulate the system and predict the outcome. And it can be an incredibly lucrative market. If you can predict what the next best performing feed item to serve into a social media feed, turns out that's a huge deal. This is where I was going to go with that. I love the examples you pull to eat two pastes, catch up, music, movies. And when you realize this, you realize, hang on a second, a universal functional approximator, a machine learning system.

16:52you know, something that learns from examples, could have tremendous opportunities because it's just the number of applications is quite enormous. And everything from obviously we just are talking about commerce all the way to science. And so you realize that maybe this could affect a very large part of the world's industries, almost every piece of software in the world would eventually be programmed this way. And if that's the case, then how you build a computer and how you build a chip in fact can be completely changed.

17:22realizing that the rest of it is just comes with, you know, do you have to courage to put your chips behind it. So that's where we are today. And that's where Nvidia is today. But I'm curious in that, you know, there's a couple years after Alex net. And this is when Ben and I were getting into the technology industry and the venture industry ourselves. I started at Microsoft in 2012. So right after Alex net, but before anyone was talking about machine learning and even the mainstream engineering community.

17:49There were those couple of years there where, to a lot of the rest of the world, these looked like science projects. The technology companies here in Silicon Valley, particularly the social media companies, they were just realizing huge economic value out of this, the Googles, the Facebooks, the Netflix, etc. And obviously that led to lots of things, including opening AI a couple of years later. But during those couple of years, when you saw just that huge economic value unlock here in Silicon Valley. How are you feeling during those times? The first thought was of course reasoning about how we should change our computing stack. The second thought is where can we find earliest possibilities of use? If we were to go build this computer, what would people use it to do? And we were fortunate that working with the world's universities and researchers was innate in our company because we were already working on CUDA and CUDA's

18:47early adopters were researchers, because we democratized supercomputing. You know, CUDA is not just used, as you know, for AI. CUDA is used for almost all fields of science. Everything from molecular dynamics to imaging, CT reconstruction to seismic processing to, you know, whether simulations, quantum chemistry, the list goes on, right? And so the number of applications of CUDA in research was very high. And so when the time came and we realized that deep learning could be really interesting, It was natural for us to go back to the researchers and find every single AI researcher on the planet and say, how can we help you advance your work? And that included Yanle Kahn and Andrew Aing and Jeff Hinton. And that's how I met all these people. And I used to go to all the AI conferences and that's where I met Ilya Suskerberg there for the first time. And so it was really about, at that point, what are the systems that we can build and the software stacks we can build to help you be more successful?

19:46to advance the research because at the time it looked like a toy. But we had confidence that even GAN, the first time I met Goodfellow, the GAN was like 32 by 32. And it was just a blurry image of a cat. But how far can it go? And so we believed in it. We believed that one, you could scale deep learning because obviously it's trained layer by layer.

20:09you could make the data sets larger and you could make the models larger. And we believe that if you made that larger and larger, it would get better and better. Kind of sensible. And I think the discussions and the engagements with the researchers was the exact positive feedback system that we needed. I would go back to research. That's where it all happened. When OpenAI was founded in 2015, yeah. I mean, that was such an important moment. That's obvious today now. But at the time, I think most people even people in tech were like, what is this? Were you involved in it at all? Because you were so connected to the researchers to Ilya taking that talent out of Google Facebook to be blunt, but receding the research community and opening it up was such an important moment. Were you involved in it at all?

21:00I wasn't involved in the founding of it but I knew a lot of the people there and Elon of course I knew and Peter Beale was there and Ilya was there and we have some great employees today that were there in the beginning and I knew that they needed some amazing computer that we were building and we're building the first version of the DGX which you know today when you see a hopper it's 70 pounds 35,000 parts 10,000 amps but DGX the first version that we built was used internally and I delivered the first one to open AI and that was a fun day but most of our success was aligned around in the beginning at just about helping the researchers get to the next level. I knew it wasn't very useful in its current state but I also believe that in a few clicks it could be really remarkable and that belief system came from

21:56the interactions with all these amazing researchers and it came from just seeing the incremental progress at first the papers were coming out every three months and then papers today are coming out every day, right? So you could just monitor the archive papers and I took an interest in learning about the progress of deep learning and to the best of my ability to read these papers and you could just see the progress happening in real time, exponentially in real time. It even seems like within the industry from some researchers we spoke with, it seemed like no one predicted how useful language models would become when you just increased the size of the models. They thought, oh, there has to be some algorithmic change that needs to happen. But once you cross that 10 billion parameter mark, and certainly once you cross the 100 billion, they just magically got much more accurate, much more useful, much more lifelike. Were you shocked by that the first time you saw a truly large language model? And do you remember that feeling?

22:54My first feeling about the language model was how clever it was to just mask out words and make it predict the next word. It's self-supervised learning at its best. We have all this text. You know, I know what the answer is. I was just making guess it. And so my first impression of Bert was really how clever it was and now the question is how can you scale that? You know, the first observation almost everything is interesting and then try to understand intuitively why it works and then the next step of course is from first principles, how would you extrapolate that? And so obviously we knew that Bert was going to be a lot larger. Now, one of the things about these language models is it's encoding information isn't that right? It's compressing information and so within the world's languages and text there's a fair amount of reasoning that's encoded in it. We describe a lot of reasoning things and so if you were to say that a few step reasoning is somehow learnable from just reading things.

23:51I wouldn't be surprised. You know, for a lot of us, we get our common sense and we get our reasoning ability by reading. And so why wouldn't a machine learning model also learn some of the reasoning capabilities from that? And from reasoning capabilities, you could have emergent capabilities, right? Emergent abilities are consistent with intuitively from reasoning. And so some of it could be predictable, but still, it's still amazing. The fact that it's sensible doesn't make it any less amazing. Right. I could visualize literally the entire computer and all the modules in a self-driving car. And the fact that it's still keeping lanes makes me insanely happy. And so... I even remember that for my first operating systems class in college when I finally figured out all the way from programming language to the electrical engineering classes bridged in the middle by that OS class. I'm like, oh, I think I understand how the Von Neumann computer works soup to nuts.

24:50And it's still a miracle. Yeah. Yeah. Yeah. Exactly. Yeah. Yeah. When you put it all together, it's still a miracle. Yeah. All right, listeners. Now is a great time to talk about a new partner of ours here on Acquired, LaGora, the agentic operating system that is redefining how the world's best legal teams work.

25:10Yup, it's sort of obvious that AI is going to completely change the legal industry. I bet most of you listening have dropped a contract into some sort of AI chatbot out there. LaGora took that insight and asked the question, what if you really built something with that power from the ground up for the legal industry? So the founders did exactly what great founders do, operate with obsessive customer focus. They embedded inside a massive law firm.

25:36for months. They sat with the lawyers just watching how the work really gets done. And that's how you get features that customers love, like tabular review, where you drop in a folder of hundreds of contracts and it pulls every key term into a grid a lawyer can actually work with. Lagores Bed here is interesting. Since it lets each lawyer handle more complexity, any given person can increase the quality of their work and do higher value work. And this means that the pie can grow even as each individual task takes less time.

26:05And they recently launched LaGora agent offering greater intelligence and performance. The agent lets lawyers set an objective. Then it can handle the planning and the execution and delivery of the final product. Legal teams get to maintain full control and transparency since they're still involved where judgment is required. And LaGora works where you already work. You can use it within Microsoft Word while redlining or drafting. The early LaGora numbers essentially speak for themselves. When they have a head-to-head pilot with their top competitor, they win 70% of the time. Legora now has over 100,000 lawyers on the platform from 1,200 legal teams in 50 countries. And crazily, they went from 1,000,000 to 100 million in ARR in about 18 months. Truly insane numbers. And that is the real test.

26:58Plenty of things demo well, but the question is whether a busy associate actually reaches for it during crunch time, or whether a partner trusts it before going into a conversation with a major client. If your legal team wants to check it out, whether you're a law firm or you're in house at a company, you can learn more at logora.com slash acquired and just tell them that Ben and David sent you. We have some questions we want to ask you. Some are cultural about Nvidia, but others are generalizable to company building broadly.

27:28And the first one that we wanted to ask is we've heard that you have 40 plus direct reports and that this org chart works a lot differently than a traditional company org chart. Do you think there's something special about NVIDIA that makes you able to have so many direct reports, not worry about coddling or focusing on career growth of your executives? And you're like, no, you're just here to do your frickin' best work. And the most important thing in the world now go.

27:57A is that correct, and B is there something special about NVIDIA that enables that? I don't think it's something special in NVIDIA. I think that we had the courage to build a system like this. NVIDIA is not built like a military. It's not built like the armed forces where you have generals and colonels. We're not set up like that. We're not set up in a command and control and information distribution system from the top down.

28:24We're really built much more like a computing stack and a computing stack the lowest layer is our architecture and then there's our chip and then there's our software and on top of it there are all these different modules and each one of these layers of modules are people and so the architecture of the company to me is a computer with a computing stack with people managing different parts of the system and who reports to whom your title is not related to anywhere you are in the stack. It just happens to be who is the best at running that module on that function on that layer. It is in charge, and that person is the pilot in command. And so that's one characteristic. And you always thought about the company this way, even from the earliest days. Yeah, pretty much. And the reason for that is because your organization should be the architecture of the machinery of building the product.

29:22Right, that's what a company is. And yet everybody's company looking exactly the same, but they all built different things. How does that make any sense? Do you see what I'm saying? How you make fried chicken versus how you flip burgers versus how you make Chinese fried rice, it's different. And so why would the machinery, why would the process be exactly the same? And so it's not sensible to me that if you look at the orchards of most companies, it all kind of looks like this.

29:48And then you have one group that's for your business and you have another for another business. You have another for another business and they're all kind of supposedly autonomous. And so none of that stuff makes any sense to me. It just depends on what is it that we're trying to build and what is the architecture of the company that best suits to go build it. So that's number one. In terms of information system and how do you enable collaboration, we kind of wired up like a neural network. And the way that we say is that there's a phrase in the company called mission is the boss.

30:16And so we figure out what is the mission of what is the mission? And we go wire up the best skills and the best teams and best resources to achieve that mission. And it cuts across the entire organization in a way that doesn't make any sense, but it looks like a little bit like a neural network. You know, when you say mission, do you mean mission like a video mission is? Yeah, okay. So it's not like further accelerated computing. It's like we're shipping DJX cloud.

30:44build hopper, or somebody else's build a system for hopper. Somebody has built kuda for hopper. Somebody's job is built kudiann for kuda for hopper. Somebody's job is the mission, right? So, you know, your mission is to do something. What are the trade-offs associated with that versus the traditional structure? The downside is the pressure on the leaders is fairly high. And the reason for that is because in a command and control system, the person who you reports to has more power than you.

31:13And the reason why they have more power than you is because they're closer to the source of information than you are. In our company, the information is disseminated fairly quickly to a lot of different people. It's usually at a team level. So for example, just now I was in our robotics meeting. And we're talking about certain things and we're making some decisions. And there are new college grads in the room. There's three vice presidents in the room. There's two e-stabs in the room. And at the moment that we decided together, we reasoned through some stuff. We made a decision.

31:43Everybody heard it's exactly the same time. So nobody has more power than anybody else. Does that make sense? The new college grad learned at exactly the same time as the e-staff. And so the executive staff and the leaders that work for me and myself, you earn the right to have your job based on your ability to reason through problems and helping other people succeed. And it's not because you have some privilege information that I knew the answer was 3.7 and only I knew.

32:12Everybody knew. When we did our most recent episode in video part three that we just released, we sort of did this thought exercise, especially over the last couple of years, your product shipping cycle has been very impressive, especially given the level of technology that you are working with and the difficulty of this all. We sort of said like, could you imagine Apple shipping two iPhones a year?

32:38And we said that for illustrative purposes. That's for illustrative purposes. Not to pick on Apple, but like a large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company. A large tech company.

33:05In the last 30 years, I've read my fair share of business books. And as in everything you read, you're supposed to, you're supposed to, first of all, enjoy it, right? Enjoy it, be inspired by it. But not to adopt it. That's not the whole point of these books. The whole point of these books is to share their experiences. And you're supposed to ask, you know, what does it mean to me in my world? And what does it mean to me in the context of what I'm going through?

33:33What does this mean to me and the environment that I'm in and what does this mean to me and what I'm trying to achieve and what does this mean to a video and the age of our company and the capability of our company. And so you're supposed to ask yourself, what does it mean to you? And then from that point being informed by all these different things that we're learning, we're supposed to come up with our own strategies. You know, what I just described is kind of how I go about everything. You're supposed to be inspired and learned from everybody else. And the education's free, you know?

34:00When somebody talks about a new product, you're supposed to go listen to it. You're not supposed to ignore it. You're supposed to go learn from it. And it could be a competitor. It could be a Jason industry. It could be nothing to do with us. The more where we learn from what's happening on the world, the better. But then you're supposed to come back and ask yourself, what does this mean to us? Yeah, you don't just want to imitate them. That's right. Yeah. I love this tee up of learning but not imitating and learning from a wide array of sources.

34:29There's this sort of unbelievable third element, I think, to what NVIDIA has become today, and that's the data center. It's certainly not obvious. I can't reason from Alex Net and your engagement with the research community and social media, if we recommend this to you deciding and the company deciding. We're going to go in a five-year all-in journey on the data center. How did that happen?

34:57Our journey to the data center happened almost 17 years ago. I'm always being asked what are the challenges that the company could see someday. And I've always felt that the fact that NVIDIA's technology is plugged into a computer and that computer has to sit next to you because it has to be connected to a monitor that will limit our opportunities someday because there are only so many desktop PCs that plug a GPU into. And there's only so many CRTs in the time LCDs that we could possibly drive. So the question is, when it be amazing, if our computer doesn't have to be connected to the viewing device, that the separation of it made it possible for us to compute somewhere else. And one of our engineers came and showed it to me one day, and it was really capturing the frame buffer and coding it into video and streaming it.

35:56to a receiver device, separating computing from the viewing. In many ways, that's cloud gaming. In fact, that was when we started GFN. We knew that GFN was going to be a journey that would take a long time because you're fighting all kinds of problems, including the speed of light.

36:17and latency everywhere you look. That's right. For instance, TFN, GeForce now. Yeah, yeah, GeForce now. And we've been working on GeForce now. That's your first cloud product. That's right. And look at GeForce now was in video's first data center product. And our second data center product was remote graphics, putting our GPUs in the world's enterprise data centers, which then led us to our third product, which combined CUDA plus our GPU, which became a super computer, which then worked towards more and more and more.

36:47And the reason why it's so important is because the disconnection between where Nvidia's computing is done versus where it's enjoyed, if you can separate that, your market opportunity explodes. And it was completely true. And so we're no longer limited by the physical constraints of the desktop PC sitting by your desk. And we're not limited by one GPU per person.

37:13It doesn't matter where it is anymore. That was really the great observation. It's a good reminder. The data center's segment of NVIDIA's business to me has become synonymous with how is AI going? That's a false equivalence. It's interesting that you were only this ready to explode in AI in the data center because you had three-plus previous products where you learned how to build data center computers. Exactly. Even though those markets weren't these gigantic world changing technology shifts the way that AI is. That's how you learn. Yeah, that's right. You want to pave the way to future opportunities. You can't wait until the opportunity is sitting in front of you for you to reach out for it. And so you have to anticipate, you know, our job is CEOs to look around corners and anticipate where will opportunities be someday? And even if I'm not exactly sure what and when, how do I position the company to be near it?

38:11to be just standing kind of near under the tree, and we can do a diving catch when Apple falls, you guys know what I'm saying? But you've got to be close enough to do the diving catch. Yeah, rewind to 2015 and open AI. If you hadn't been laying this groundwork in the data center, you wouldn't be powering open AI right now. But the idea that computing will be mostly done away from the viewing device.

38:37that the vast majority of computing will be done away from the computer itself. That insight was good. In fact, cloud computing, everything about today's computing is about separation of that. And by putting it in a data center, we can overcome this latency problem, meaning you're not going to overcome speed of light. Speed of light end to end is only 120 milliseconds or something like that. It's not that long.

38:58from a data center to a- Anywhere- Anywhere- To plan it, yeah. And so- Oh, I see. Literally across the planet. Yeah, right. So if you could solve that problem, approximately, something like that. I don't forget the number, but it's 70 milliseconds, 100 milliseconds. But it's not that long. And so my point is, if you could remove the obstacles everywhere else, then speed of light should be, you know, perfectly fine. And you could build data centers as large a like, and you could do amazing things.

39:26And this little tiny device that we use as a computer, or your TV, as a computer, whatever a computer, they can all instantly become amazing. And so that insight, 15 years ago was a good one. So speaking of the speed of light in Finaband, David's like begging me to go here, I can feel it. You totally saw that in Finaband would be way more useful, way sooner than anyone else realized. Requiring Melanox, I think, You uniquely saw that this was required to train large language models and you were super aggressive in acquiring that company. Why did you see that when no one else saw that? Well, there were several reasons for that. First, if you want to be a data center company, building the processing chip is in the way to do it. A data center is distinguished from a desktop computer versus a cell phone, not by the processor in it.

40:20Yeah, that's a computer in the data center uses the same CPUs use the same GPUs apparently right very close and so it's not the chip It's not the processing should but this the scribes it but it's the networking of it is the infrastructure of it It's the you know how the computing is distributed how securities provided how networking is done, you know, so on so forth And so so it those characteristics are associated with melanox not in video and so the day that I concluded that really Nvidia wants to build computers of the future and computers of the future are going to be data centers and body to data centers. And then we want to be data center oriented company that we really need to get into networking. And so that was one. The second thing is observation that whereas cloud computing started in hyperscale, which is about taking commodity components, a lot of users, and virtualizing many users on top of one computer,

41:17AI is really about distributed computing where one job, one training job is orchestrated across millions of processors. And so it's the inverse of hyperscale almost. And the way that you design a hyperscale computer with off-to-shelf commodity Ethernet, which is just fine for Hadoop, it's just fine for search queries, it's just fine for all of those things. But now when you're shorting a model across, not when you're shorting a model across, right?

41:44That observation says that the type of networking you want to do is not exactly Ethernet and the way that we do networking for supercomputing is really quite ideal. And so the combination of those two ideas convinced me that Melanox is absolutely the right company because they were the world's leading high performance networking company and we worked with them in so many different areas in high performance computing already. Plus, I really like the people.

42:12The Israel team is a world class. We have some 3,200 people there now, and it was one of the best strategic decisions I've ever made. When we were researching, particularly part three of our NVIDIA series, we talked to a lot of people, and many people told us the melanox acquisition is one of if not the best of all-time band technology company. Yeah, I think so too. And it's so disconnected from the work that we normally do. It was surprising to everybody.

42:41But frame this way, you were standing near where the action was, so you could figure out as soon as that apple sort of becomes available to purchase. Like, oh, LLMs are about to blow up. I'm going to need that. Everyone's going to need that. I think I know that before anyone else does. You want to position yourself near opportunities. You don't have to be that perfect. You want to position yourself near to tree. And even if you don't catch the apple, before it hits the ground so long as you're the first one to pick it up. You want to position yourself close to the opportunities. And so that's kind of a lot of my work, is positioning the company near opportunities and having the company having the skills to monetize each one of the steps along the way so that we can be sustainable.

43:35What you just had reminds me of a great aphorism from Buffett and Munger, which is it's better to be approximately right than exactly wrong. Yeah, there you go. Yeah, that's a good one. It's a good one. Yeah. Yeah. All right, listeners. Now is a great time to tell you about a long time friend of the show, Vanta. AI has scrambled the whole security picture. It used to be that you proved that you were secure once a year on audit or a static PDF, then everyone would nod and you're done.

44:03But in an AI first world, that doesn't hold up anymore. Yup, your risk surface changes every week now. A vendor turns on an AI feature or someone writes in a new model without telling IT, and your posture is different than it was last week, let alone at your last audit. Vanta's own research found that around 70% of companies have this, quote unquote, shadow AI running with no security review at all. Right.

44:28And that's where Vanta comes in. They're the leading-agentic trust platform, meaning they've built the thing that closes the gap. And the way that they close that gap is Vanta agent. Think of it as a GRC engineer, that's governance risk and compliance, except that it's software and it doesn't sleep. It finds the issues drafts the fixes and cuts the time that you'd spend on vendor assessments in half. In half!

44:51which is exactly why more than 16,000 companies today run on Vanta. Companies like ramp, cursor, and snowflake all stay audit-ready and catch the risks that crop up between audits across every vendor, every AI tool, the whole environment. And that's the real value. Trust has to be continuous now, which is why Vanta automates your security, your compliance, and the work to earn and prove trust.

45:16We're huge fans of Vanta over here and literally hundreds of acquired listeners have become Vanta customers at their companies over the years. So you can get $1,000 off Vanta at Vanta.com slash acquired. That's V-A-N-T-A dot com slash acquired for $1,000 off and just tell them that Ben and David sent you. I want to move away from Nvidia if you're okay with it and ask you some questions since we have a lot of founders that listen to this show sort of advice for company building. The first one is When you're starting a startup in the earliest days, your biggest competitor is you don't make anything people want. Your company's likely to die just because people don't actually care as much as you do about what they're doing. In the later days, you actually have to be very thoughtful about competitive strategy. I'm curious, what would be your advice to companies that have product market fit that are starting to grow? They're in interesting growing markets. Where should they look for competition and how should they handle it?

46:16Well, there are all kinds of ways to think about competition. We prefer to position ourselves in a way that serves a need that usually hasn't emerged. I've heard you or others in the video, I think, use the phrase zero billion dollar markets. Yeah, that's exactly right. It's our way of saying there's no market yet, but we believe there will be one. And usually, when you're positioned there, everybody's trying to figure out why are you here.

46:45Right, because when we first got into automotive, because we believe that in the future, the car is going to be largely software. And if it's going to be largely software, a really incredible computer is necessary. And so when we positioned ourselves there, most people, I still remember one of the, one of the CTOs told me, you know what, cars cannot tolerate the blue screen of death.

47:07I don't think anybody can tolerate that, but it doesn't change the fact that someday, every car will be a software-defined car. I think 15 years later, we're largely right. Oftentimes, there's non-consumption, and we like to navigate our company there. By doing that, by the time that the market emerges, it's very likely there aren't that many competitors shape that way.

47:37We were early in PC gaming and today Nvidia is very large in PC gaming. We reimagined what a design workstation would be like and today just by every workstation on the planet uses Nvidia's technology. We reimagined how supercomputing ought to be done and who should benefit from supercomputing that we would democratize it and look today in Nvidia's and accelerated computing is quite large and we reimagined how software would be done.

48:06And today it's called Machine Learning and how computer we'd be doing, we call it AI. And so, we re-imagined these kind of things, try to do that about a decade in advance. And so, we spend about a decade in zero billion dollar markets. And today, I spent a lot of time on Omniverse. And Omniverse is a classic example of a zero billion dollar business.

48:28And there's like 40 customers now. Yeah, it was on BMW. Yeah, that's cool. It's cool. So let's say you do get this great 10-year lead, but then other people figure it out and you've got people nipping at your heels. What are some structural things that someone who's building a business can do to sort of stay ahead? And you can just keep your pedal to the metal and say, we're going to out work on it. We're going to be smarter. And like that works to some extent, but those are tactics. What strategically can you do to sort of make sure that you can maintain that lead?

48:56Oftentimes, if you created the market, you ended up having what people describe as moats. Because if you build your product right, and it's enabled an entire ecosystem around you to help serve that end market, you've essentially created a platform. Sometimes it's a product-based platform. Sometimes it's a service-based platform. Sometimes it's a technology-based platform. But if you were early there and you you were mindful about helping the ecosystem succeed with you. You ended up having this network of networks and all these developers and all these customers who are built around you. That network is essentially your moat. I don't love thinking about it in the context of a moat. The reason for that is because you're now focused on building stuff around your castle.

49:51I tend to like thinking about things in the context of building a network and that network is about enabling other people to enjoy the success of the final market. You know, that you're not the only company that enjoys it, but you're enjoying it with a whole bunch of other people, including me. I'm so glad you brought this up because I wanted to ask you. In my mind, at least, and it sounds like in years two, Nvidia is absolutely a platform company of which there are very few meaningful platform companies in the world. I think it's also fair to say that when you started for the first few years, you were a technology company and not a platform company. Every example I can think of of a company that tried to start as a platform company fails. You got to start as a technology first. When did you think about making that transition to being a platform? Like, your first graphics cards were technology. There was no code, there was no platform. What you observed is not wrong.

50:47However, inside our company, we were always a platform company. And the reason for that is because from the very first day of our company, we had this architecture called UDA. It's the UDA of CUDA. CUDA is compute unified device architecture. That's right. And the reason for that is because what we've done, what we essentially did in the beginning, even though Reva 128 only had computer graphics, the architecture described accelerators of all kinds.

51:16And we would take that architecture and developers would program to it. In fact, NVIDIA's first strategy, business strategy, was we were going to be a game console inside the PC. And a game console needs developers, which is the reason why NVIDIA, a long time ago, one of our first employees was a developer relations person.

51:40And so it's the reason why we knew all the game developers and all the 3D developers and we knew whatever. So was the original business plan to like... Sort of like to build direct apps? Yeah, compete with Nintendo and Sega as like, in good PCs. Original Nvidia architecture was called Direct NV. Direct NVIDIA. Yeah. And DirectX was an API that made it possible for operating system to directly connect hardware. Yeah, hardware.

52:07Yeah, but directly before it existed, you started a video, right? And that's when it made your strategy run for the first company. In 1993, we had DirectNVIDIA. And which in 1995 became, you know, well, DirectX came out. So this is an important lesson. We were always a developer oriented company. The initial attempt was we will get the developers to build on DirectNV and then they'll build for our chips and then we'll have a platform.

52:33And yeah, exactly. What played out is Microsoft already had all these developer relationships. So you learn the lesson the hard way of like, yeah, yeah, we just got a lot of that. Microsoft did back in the day. They're like, oh, that could be a developer platform. We'll take that. Thank you. No, but they had a lot. They did it very differently. And they did a lot of things, right? We did a lot of things wrong. But you were competing against Microsoft in the 90s. I mean, that's, yeah, it's like having against Nvidia today. No, it's a lot different. But I appreciate that. But but we were nowhere near competing with them. If you look now, when CUDA came along and there was OpenGL, there was Duartex, but there's still another extension, if you will, and that extension is CUDA. And that CUDA extension allows a chip that got paid for running Duartex and OpenGL to create an install base for CUDA. And so that's the end of the strategy. And it is why you were so militant. And I think from our research, it really was you.

53:30being militant that every Nvidia chip will run CUDA? Yeah, if you're a computing platform, everything's got to be compatible. We are the only accelerator on the planet where every single accelerator is architecturally compatible with the others. Nana has ever existed. There are literally a couple of hundred million, right? 250 million, 300 million installed base of active CUDA GPUs being used in the world today. And they're all architecturally compatible.

54:00How would you have a computing platform if you know MV 30 and MV 35 and 39 and MV 40 they're all different Right at 30 years. It's all completely compatible And so that's the only unnegotiable rule in our company everything else is negotiable. I mean, I guess Cuda was a rebirth of UDA, but understanding this now UDA going all the way back It really is all the way back to all the chips you've had. Yeah, yeah, yeah. In fact, UDA goes all the way back to all of our chips today. Wow. For the record, I didn't help any of the founding CEOs that are listening. I gotta tell you, while you were asking that question, what lessons would I impart, I don't know. I mean, the characteristics of successful companies and successful CEOs, I think, are fairly well described, a whole bunch of them. I just think starting successful companies are insanely hard.

54:54It's just insanely hard. And when I see these amazing companies getting built, I have nothing but admiration and respect because I just know that it's insanely hard. And I think that everybody did many similar things. There are some good smart things that people do. There are some dumb things that you can do. But you could do all the right smart things and still fail. You could do a whole bunch of dumb things and I did many of them and still succeed.

55:23So obviously that's not exactly right. I think skills are the things that you can learn along the way. But an important moment certain circumstances have to come together. And I do think that the market has to be one of the agents to help you succeed. It's not enough, obviously, because a lot of people still fail. Do you remember any moments in Nvidia's history where you're like, we made a bunch of wrong decisions, but somehow we got saved because You know, it takes the sum of all the luck and all the skill in order to succeed. Do you remember any moments where you're like? I should have thought that you started with River 120 and was spot on. River 128, as I mentioned, the number of smart decisions we made which are smart to this day. How we design chips is exactly the same to this day because gosh, you know, nobody's ever done it back then. And we pulled every trick in the book in a desperation because we had no other choice.

56:23Well, guess what? That's the way things ought to be done. And now everybody does it that way. Everybody does it because why should you do things twice if you can do it once? Why tape out a chip seven times if you can tape it out one time? And so the most efficient, the most cost effective, the most competitive speed is technology, speed is performance, time to market is performance, all of those things apply. So why do things twice if you can do it once?

56:51River 128 made a lot of great decisions and how we spec products, how we think about market needs and lack of, and how do we judge markets, and all of this. We made some amazing, amazingly good decisions. Yeah, we were back against the wall, we only had one more shot to do it, but... Once you pull out of the stops and you see what you're capable of, why would you put stops in next time? Exactly. You know, it goes to keep stops out all the time. That's right. Every time. That's right. Is it fair to say, though, maybe on the left side of the equation, thinking back to 1997, that that was the moment where consumers tip to really, really valuing 3D graphical performance in games. Oh, yeah. So, for example, luck. Let's have luck. If Carmack had decided to use acceleration, because remember, Doom was completely software-rendered, and the NVIDIA philosophy was that although general purpose computing is a fabulous thing, it's going to enable software and IT and everything,

57:50We felt that there were there were applications that wouldn't be possible or it would be costly if it wasn't accelerated. It should be accelerated and 3D graphics was one of them, but it wasn't the only one. And it was just happens to be the first one and a really great one. And I still remember the first time we met John, he was quite emphatic about using CPUs and and the software render was really good. I mean, quite frankly, if you look at look at doom, the performance of doom was really hard to achieve even with accelerators at the time.

58:19If you didn't filter, if you didn't have to do bilinear filtering, it did a pretty good job. The problem with Doom though was you needed Carmack to program it. Yeah, you needed Carmack to program it. Exactly. It was a genius piece of code, but nonetheless software renders did a really good job. If he hadn't decided to go to OpenGL and accelerate for Quake, frankly, what would be the killer app that put us here?

58:47Carmack and Swini both between Unreal and Quake created the first two killer applications for consumer 3D. Yeah, and so I owe them a great deal. I want to come back real quick, too. You know, you said you told these stories and you're like, well, I don't know what founders can take from that. I actually do think, you know, if you look at all the big tech companies today, perhaps with the exception of Google, they did all start and understanding this now about you by addressing developers, planning to build a platform and tools for developers. You know, all of them, Apple. That is fun. Well, I guess waiting with AWS is how AWS started. So I think that actually is a lesson to your point of like, that won't guarantee success by any means. Right. But that'll get you hanging around a tree if the Apple falls. Yeah. As many good ideas as we have, you don't have all the world's good ideas. And the benefit of having developers is you get to see a lot of good ideas. Yeah. Yeah.

59:44Well, as we start to drift toward the end here, we spend a lot of time on the past. And I want to think about the future a little bit. I'm sure you spend a lot of time on this being on the cutting edge of AI. We're moving into an era where the productivity that software can accomplish when a person is using software can massively amplify the impact and the value that they're creating, which has to be amazing for humanity in the long run. In the short term, it's going to be inevitably bumpy as we sort of figure out what that means.

1:00:13What do you think some of the solutions are as AI gets more and more powerful and better at accelerating productivity for all the displaced jobs that are going to come from it? Well, first of all, we have to keep AI safe. And there's a couple of different areas of AI safety that's really important, obviously, in robotics and self-driving car.

1:00:36There's a whole field of AI safety and we've dedicated ourselves to functional safety and active safety and all kinds of different areas of safety. When to apply human and gloop, when is it okay for human not to be in the loop? How do you get to a point where where increasingly human doesn't have to be in the loop, but human largely in the loop?

1:00:55In the case of information safety, obviously bias, false information, and appreciating the rights of artists and creators, that whole area deserves a lot of attention. And you've seen some of the work that we've done. Instead of scraping the internet, we partnered with Getty and Shutterstock to create commercially fair way of applying artificial intelligence to the AI.

1:01:20In the area of large language models and the future of increasingly greater agency, AI clearly the answer is for as long as it's sensible and I think it's going to be sensible for a long time is human in the loop. The ability for an AI to self-learn and improve and change out in the wild in the digital form should be avoided.

1:01:45and we should collect data, we should carry the data, we should train the model, we should test the model, validate the model before we release it on the wild again, so humanism and loop. There are a lot of different industries that have already demonstrated how to build systems that are safe and good for humanity and obviously the way autopilot works for a plane and two pilot system and an air traffic control and redundancy and diversity and and all of the basic philosophies of designing safe systems apply as well in self-driving cars and so on and so forth. And so I think there's a lot of models of creating safe AI, and I think we need to apply them. With respect to automation, my feeling is that, and we'll see, but it is more likely that AI is going to create more jobs. And in the near term, the question is what's the definition in near term? And the reason for that is,

1:02:41The first thing that happens with productivity is prosperity. And prosperity when the companies get more successful, they hire more people because they want to expand into more areas. And so the question is, if you think about a company and say, okay, if we improve the productivity, they need fewer people. Well, that's because the company has no more ideas, but that's not true. If you become more productive and the company becomes more profitable, usually, they hire more people to expand into new areas. And so long as we believe that there are more areas to expand into, that there are more ideas and drugs, this drug discovery, there are more ideas in transportation, there are more ideas in retail, there are more ideas in entertainment, there are more ideas in technology. So long as we believe that there are more ideas, the prosperity of the industry, which comes from improved productivity, results in hiring more people, more ideas.

1:03:38Now, you go back in history, we can fairly say that today's industry is larger than the world's industries a thousand years ago. And the reason for that is because obviously humans have a lot of ideas. And I think that there's plenty of ideas yet for prosperity and plenty of ideas that can be get from productivity improvements. But my sense is that it's likely to generate jobs. Now, obviously, net generation of jobs doesn't guarantee that anyone human doesn't get fired. That's obviously true. It's more likely that someone will lose a job to someone else, some other human that uses an AI. Not likely to an AI, but some other human that uses an AI. I think the first thing that everybody should do is learn how to use AI so that they can augment their own productivity.

1:04:31And every company should augment their own productivity to be more productive so that they can have more prosperity, hire more people. And so I think jobs will change. My guess is that we'll actually have higher employment, we'll create more jobs. I think industries will be more productive. And many of the industries that are currently suffering from lack of labor, workforce is likely to use AI to get themselves off the free and get back to growth and prosperity.

1:05:02So I see it a little bit differently, but I do think that jobs will be affected. And I'd encourage everybody just to learn AI. This is appropriate. There's a version of something we talk about a lot on acquired. We call it the Moritz Corollary to Moore's Law after Mike Moritz from Sequoia. Sequoia was the first investor in our company. Yeah, of course. Yeah. The great story behind it is that when Mike was taking over for Don Valentine with Doug. He was sitting and looking at Sequoia's returns and he was looking at fun three or four. I think it was four maybe that had Cisco and he was like, how are we ever going to top that? I can't. Don's going to have us beat. We're never going to beat that. They thought about it and he realized that, well, as compute gets cheaper, and it can access more areas of the economy because it gets cheaper and can get adopted more widely, well then the markets that we can address should get bigger.

1:05:57And AI, your argument is basically AI will do the same thing. Exactly. I just gave you exactly the same example that in fact productivity doesn't result in us doing less. Productivity usually results in us doing more. Everything we do will be easier, but we'll end up doing more. Yep. Because we have infinite ambition. The world has infinite ambition. And so if a company is more profitable, they tend to hire more people to do more. Yep.

1:06:25Yeah, that's true. Technology is a lever, and the place where the idea kind of falls down is that we would be satisfied. Humans have never ending ambition. No, humans will always expand and consume more energy and attempt to pursue more ideas. That has always been true of every version of our species over time. All right, listeners. Now is a great time to thank our longtime friend of the show, ServiceNow.

1:06:52If you are running a large enterprise, AI agents are likely spread across every team, and deploying them is no longer the hard part. Yeah. The hard part is knowing what permissions they have, what employees are using them for, or what decisions AI is making. AI security for an enterprise at scale is not a small concern. Like the risks are real.

1:07:14Exactly. And the challenge with AI is governing it, securing it, measuring it, and making sure that it actually delivers value. That is why ServiceNow built the AI Control Tower. Yep. AI Control Tower gives enterprises a single place to see, manage, govern, and optimize AI across the entire business. And it works with any AI, not just theirs. Every device on your network, every permission across every system, every AI agent, visible and secure in one place. And ServiceNow can do this.

1:07:43because they've spent more than 20 years building the operational backbone of the enterprise. The workflows, governance, approval, security controls, and institutional knowledge that power how work actually gets done across IT, HR, customer service, finance, and security. Service now already runs more than 100 billion.

1:08:02workflows annually and trillions of transactions for more than 85% of the Fortune 500. So when companies need a place to govern AI at enterprise scale, they're building on a platform at the center of how their business already operates. And in a future that isn't going to be one AI, it's going to be thousands of AI agents working across every function of the company. But the question is, who's managing them all?

1:08:24So if you're trying to turn AI Ambition into real business outcomes and make it work safely, securely at scale, go check out ServiceNow.com slash acquired and tell them that Ben and David sent you. We have a few lighting round questions. We want to ask you. And then we have a very fun. I think that felt okay. We'll open with an easy one based on all these conference rooms. We see a name around here. Favorite sci-fi book. I've never read a sci-fi book before. No, come on. Yeah.

1:08:53You're missing out. You're missing out. The obsession with Star Trek and... Well, just watch the TV show. Okay. Favorite sci-fi TV show. Favorite sci-fi TV show. Star Trek's my favorite. Yeah. Star Trek's my favorite. It's a V-Jer. Now, they're on the way in. It's a good, it's a good comment to remain. V-Jer is an excellent one, yeah. Yeah. What car is your daily driver these days? And related questions, do you still have the Supra? These days? Oh, it's one of my favorite cars. And also favorite memories. You guys might not know this, but...

1:09:23Laurie and I got engaged. Christmas one year and we drove back in my brand new Supra and we totaled it. We were this close to the end. I think I didn't. But nonetheless, it wasn't my fault. It wasn't the Supras fault. But it's a mark. The one time when it wasn't the Supras fault. Yeah, I love that car. I'm driven these days for first-carry reasons and others.

1:09:50I'm driven in the Mercedes EQS, it's great car. Yeah, great car. Thanks. Using Nvidia technology? Yeah, we're in the central computer. Sweet. I know we already talked a little bit about business books, but one or two favorites that you've taken something from. Clay Christianson, I think, has the series is the best. I mean, there's just no two ways about it.

1:10:18And the reason for that is because it's so intuitive and so sensible. It's approachable. But I read a whole bunch of them and I read just about all of them. I really enjoyed Andy Groves' books. They're all really good. Awesome. Favorite characteristic of Don Valentine? Grumpy, but enduring. And what he said to me the last time as he...

1:10:44decide to invest in our company says, if you lose my money, I'll kill you. And then, over the course of the decades, the years have followed. When something is nice written about us in Mercury News, it seems like he wrote it in a crayon. You know, you'll say, you'll say, good job, Don, you know, just write right over the newspaper and just good job, Don, and he's mails it to me.

1:11:10And I hope I'd kept them, but anyways, you could tell he's a real sweetheart. But he cares about the companies. He's a special character. Yeah, he's in trouble. What is something that you believe today that 40-year-old Jensen would have pushed back on and said, no, I disagree? There's plenty of time. Yeah, there's plenty of time.

1:11:37If you prioritize yourself properly and you make sure that you don't let outlook be the controller of your time, there's plenty of time. Plenty of time. In the day, plenty of time. Do anything to achieve this thing. Just don't do everything. Prioritize your life. Make sacrifices. Don't let outlook control what you do every day. Notice I was late to our meeting. And the reason for that, but the time I looked up, I, oh my gosh.

1:12:06You know, Ben and Dave are waiting, you know. That's already. We got time. Yeah, exactly. That's a... Didn't stop just from being a great chap. No, but you have to prioritize your time really carefully. And don't let outlook that determine that. Love that. What are you afraid of if anything? I'm afraid of the same things today that I was in the very beginning of this company, which is letting the employees down. You know, you have a lot of people who joined your company because they believe in your hopes and dreams.

1:12:36And they've adopted it as their hopes and dreams. And you want to be right for them. You want to be successful for them. You want them to be able to build a great life as well as help you build a great company and be able to build a great career. You want them to have to enjoy all of that. And these days, I want them to be able to enjoy the things I've had the benefit of enjoying and all the great success I've enjoyed. I want them to be able to enjoy all of that.

1:13:02So I think the greatest fear is that you let them down. What point did you realize that you weren't going to have another job that like this was it? I just, I don't change jobs. You know, if it wasn't because of Chris and Curtis convincing me to do Nvidia, I would still be a Ellis I logic today. I'm certain of it. Wow. Really? Yeah, yeah. I'm certain of it.

1:13:33I would keep doing what I'm doing. And at the time that I was there, I was completely dedicated and focused on helping LSI Logic be the best company could be. And I was LSI Logic's best ambassador. I've got great friends to this day that I've known from LSI Logic. It's a company I loved then. I loved dearly today. I know exactly why I went. The revolutionary impact it had on chip design and system design and computer design.

1:14:01In my estimation, one of the most important companies that ever came to Silicon Valley and changed everything about how computers were made. It put me in the epicenter of some of the most important events in computer industry. It led me to meeting Chris and Curtis and Andy Bechtoschein and John Rubinstein and some of the most important people in the world. And Frank that I was with the other day, I mean the list goes on.

1:14:27Ellis I logic was really important to me, and I would still be there. I would, you know, who knows what Ellis I logic would have become if I were still there, right? And so that's kind of how my mind works. Powering the AI of the world. Yeah, exactly. I mean, I might be doing the same thing I'm doing today. I got the sense from remembering back to part one of our series on Nvidia, but until until I'm fired. This is my last job. I got the sense that I'm.

1:14:55LSI logic might have also changed your perspective and philosophy about computing too. The sense we got from the research was that when right out of school, when you first went to AMD first, right? You believed that kind of a version of that was that the Jerry Sanders real men have fabs. You need to do the whole stack. You got to do everything and that LSI logic changed you. What LSI logic did was realized that you can express transistors and logical gates and chip functionality in high-level languages. That by raising the level of abstraction in what it's now called high-level design, it was coined by Harvey Jones, who's on an Nvidia's board, and I met him way back in the early days of synopsis. But during that time, there was this belief that you can express chip design in high-level languages. By doing so, you could

1:15:53take advantage of optimizing compilers and optimization logic and tools and be a lot more productive. That logic was so sensible to me, and I was 21 years old at the time, and I wanted to pursue that vision. Now frankly, that idea happened in machine learning. It happened in software programming. I want to see it happen in digital biology so that we can think about biology in a much higher level language, probably a large language model would be the way to make it representable. That transition was so revolutionary. I thought that was the best thing I ever happened to the industry, and I was really happy to be part of it. And I was at ground zero. And so I saw one industry change, revolutionize another industry. And if not for LSI logic doing the work that it did,

1:16:49it synopses shortly after, then why would the computer industry be where it is today? Yeah. It's really, really terrific. I was at the right place at the right time to see all that. That was super cool. Yeah. And it sounded like the CEO of LSL Logic. Put a good word in for you. Yeah, well, I didn't know how to write a business plan. Which it turns out is not actually important. No, no, no. It turns out that making a financial forecast that nobody knows is going to be right or wrong, turns out not to be that important. But the important things at a business plan probably could have teased out. I think that the art of writing a business plan ought to be much, much shorter. And it forces you to condense. What is the true problem you're sworn to solve? What is the unmet need that you believe will emerge? And what is it that you're going to do that is sufficiently hard that when everybody else finds out it's a good idea, they're not going to swarm it.

1:17:47you know, make you obsolete. And so, it has to be sufficiently hard to do. There are a whole bunch of other skills that are involved in just, you know, product and positioning and pricing and go to market and, you know, all that kind of stuff. But those are skills and you can learn those things easily. The stuff that is really, really hard is the essence of what I described. And I did that. Okay. But I had no idea how to ride the business plan. And I was fortunate that Wolf Corrigan.

1:18:14was so pleased with me and the work that I did when I was at Ellis Logic. He called up, gone Valentine and told Don, you know, invest in this kid and he's going to come your way. And so I was, you know, I was, I was set up for success from that moment and got it, got a song. As long as he didn't lose the money.

1:18:34I think Sequoia did okay. I think we probably are one of the best investments they've ever made. Have they held through today? The VC partner is still on the board, Mark Stevens. Yeah. Yeah. Yeah. All these years, the two founding VCs are still on the board. Sutter, hell, and Sequoia? Yeah. Tension, coax and Mark Stevens. I don't think that ever happens. Yeah. We are singular in that circumstance, I believe. They've added value this whole time.

1:19:03I've been inspiring this whole time. I gave great wisdom and great support. But they also. They've been entertained, you know, by the company, inspired by the company and enriched by the company. And so they stayed with it. And I'm really grateful. Well, in that vein, our final question for you. It's 2023, 30 years anniversary of the founding of Indonesia. If you were magically 30 years old again today in 2023. And you were going to Denny's with your two best friends who are the two smartest people you know. And you're talking about starting a company. What are you talking about starting? I wouldn't do it. I know. And the reason for that is really quite simple. Ignoring the company that we would start. First of all, I'm not exactly sure. The reason why I wouldn't do it, and it goes back to why it's so hard, is

1:20:00Building a company and building a video turned out to have been a million times harder than I expected it to be, any of us expected it to be. And at that time, if we realized the pain and suffering and just a vulnerable you, you're going to feel and the challenges that you're going to endure, the embarrassment and the shame and the list of all the things that go wrong, I don't think anybody would start a company. Nobody in their right mind would do it.

1:20:28I think that that's kind of the super power of a entrepreneur. They don't know how hard it is. And they only ask themselves how hard can it be. And to this day, I trick my brain into thinking how hard can it be because you have to. Still. Yeah. How hard can it be? Everything that we're doing, how hard can it be? On the verse, how hard can it be?

1:20:55Playing to retire anytime soon. No, you're still a good guy. You could choose to say, whoa, this is too hard. The trick is still working. I'm still enjoying myself immensely and I'm adding a little bit of value, but that's really the trick of an entrepreneur. You have to get yourself to believe that it's not that hard because it's way harder than you think. If I go taking all of my knowledge now and I go back and I said, I'm going to endure that whole journey again. I think it's too much. It is just too much. Do you have any suggestions on any kind of support system or a way to get through the emotional trauma that comes with building something like this? I have family and friends and all the colleagues we have here. I'm surrounded by people who've been here for 30 years. Chris has been here for 30 years. Jeff Fisher has been here 30 years. Dwight's been here 30 years. Jonah and Brian have been here 25 some years.

1:21:54Probably longer than that and you know Joe Greco's been here 30 years I'm surrounded by these people that never one time gave up and they never one time gave up on me and that's the entire ball of wax, you know and and to be able to go home and and Have your family be fully committed to everything that you're trying to do and Thick worth then they're they're proud of you and proud of the company and You kind of need that. You need the unwavering support of people around you. You know, Jim Gafers and the, you know, the, the, the 10th Coxes and Mark Stevens and, you know, Harvey Jones and all the, the early people of our company, the Bill Miller's. They, uh, uh, not one time gave up on the company and us and, and you kind of, you need that, you know, not kind of need that. You need that. And I'm pretty sure that almost every successful company and entrepreneurs that, that have gone through some difficult challenges.

1:22:48They had that support system around them. I can only imagine how meaningful that, I mean, I know how meaningful that is in any company, but for you, I feel like the NVIDIA journey is particularly amplified on these dimensions, right? It's not normal. You know, you went through two, two if not three 80% plus drawdowns in the public markets to have investors who've stuck with you from day one through that must be just like...

1:23:17so much support yeah, yeah, it is incredible and You hate that any of that stuff happened and and most of you you know most of it is is out of your control, but you know 80% fall it it's an extraordinary thing don't know how you look at it and I forget exactly but I mean we traded down at about a couple of two three billion dollars in market value for a while because of the decision we made in going into Kudan, all that work, and your belief system has to be really, really strong. You have to really, really believe it and really, really want it. Otherwise, it's just too much to endure. I mean, because everybody's questioning you and employees aren't questioning you, but employees have questions. People outside are questioning you. And it's a little embarrassing.

1:24:11And it's like, you know, when your stock price gets hit, it's embarrassing no matter how you think about it. And it's hard to explain, you know? And so there's no good answer to any of that stuff. You know, CEOs are human and companies are built of humans. And these challenges are hard to endure. And so... And it had an appropriate comment on our most recent episode on you all, where we were talking about, you know, the current situation in the video. I think you said, for any other company, this would be a precarious spot to be in.

1:24:40But for Nvidia. This is kind of old hat. You guys are familiar with these large swings and amplitude. The thing that to keep in mind is at all times, what is the market opportunity that you're engaging? And that informs your size. I was told a long time ago that Nvidia can never be larger than a billion dollars. Obviously it's an underestimation under imagination of the size of the opportunity.

1:25:10It is the case that no chip company can ever be so big. But if you're not a chip company, then why is that applied to you? This is the extraordinary thing about technology right now. Technology is a tool, and it's only so large. What's unique about our current circumstance today is that we're in the manufacturing of intelligence. We're in the manufacturing of work world. That's AI.

1:25:40The world of tasks, doing work, productive, generative AI work, generative, intelligent work, that market size is enormous, is measuring trillions. One way to think about that is, if you build a chip for a car, how many cars are there and how many chips would they consume? That's one way to think about that. However, if you build a system that, whenever needed, assisted in the driving of the car. What's the value of a autonomous chauffeur, every now and then? Now the market, obviously the problem becomes much larger, the opportunity becomes larger. What would it be like if we were to magically conjure up a chauffeur for everybody who has a car? How big is that market? Obviously, that's a much, much larger market.

1:26:37The technology industry is at the, you know, where what we've discovered, what NVIDIA has discovered and what some of the discovered, is that by separating ourselves from being a chip company, but building on top of the chip and you're not in the AI company, the market opportunity has grown by probably a thousand times. You know, don't be surprised if technology companies become much larger in the future because what you produce is something very different. And that's the kind of the the way to think about how large can your opportunity, how large can you be. That is everything to do with the size of the opportunity. Yep. Well, Jensen, thank you so much. Thank you. All right, listeners. Now is a great time to talk about one of our...

1:27:25favorite companies, Statsig. Yes, there is a reason why the best product teams rely on Statsig, whether they are iterating on their core product features or shipping AI-powered experiences at scale. Yep. In the crazy speed of today's AI world, shipping fast is just table stakes now. It's basically trivial to build and deploy your app constantly. The real advantage is how quickly you learn what changes actually created value for customers, and how fast you can use that signal to guide what you shipped next. This is where Statsig comes in. It brings experimentation, feature flags, and product analytics into one unified system so teams can ship safely, test rigorously, and directly link what they changed to how users actually behaved. So if you want to make learning your competitive advantage, whether you're building new AI experiences, or just evolving your existing core product, go to Statsig.com slash acquired to get started.

1:28:22Ooh, David, that was awesome. So fun. Well, listeners, we want to tell you that you should totally sign up for our email list. Of course, it is notifications when we drop a new email, but we've added something new. We're including little tidbits that we learn after releasing the episode, including listener corrections. And we also have been sort of teasing what the next episode will be. So if you want to play the little guessing game along with the rest of the acquired community, sign up at acquired.fm slash email. You should check out ACQ, too, which is available at any podcast player. As these main acquired episodes get longer and come out, you know, once a month instead of once every couple weeks, it's a little bit more of a rarity these days. We've been up leveling our production process. And that takes time. Yes.

1:29:08ACQ-2 has become the place to get more from David and I, and we've just got some awesome episodes coming up that we are excited about. If you want to come deeper into the acquired kitchen, become an LP, acquired.fm-lp. Once every couple months or so, we'll be doing a call with all of you on Zoom just for LPs to get the inside scoop of what's going on in acquired land and get to know David and I a little bit better. And once a season, you'll get to help us pick a future episode. So that's acquired.fm-lp.

1:29:36Anyone should join the Slack, acquire.fm-slash-slack. God, we've got a lot of things now, David. I know what the hamburger bar on our website is. Expanding. Expanding. I know. That's how you know we're becoming enterprise. Which we have a mega menu, a menu of menus, if you will. What is the acquired solution that we can sell? That's true. We got to find that. All right. With that, listeners, acquire.fm-slash-slack to join the Slack and discuss this episode, acquire.fm-slash-store.

1:30:01to get some of that sweet merch that everyone is talking about, and without listeners, we will see you next time. We'll see you next time.