Learning Library

← Back to Library

AI Boom: Mary Maker's Report

Key Points

  • Mary Maker, famed internet trends analyst, released her first AI report in five years—a 340‑slide deep dive that the speaker highlights as a must‑read (full summary available on their Substack).
  • The report shows AI adoption soaring “up and to the right,” with ChatGPT user growth rising 8× in 17 months, reaching 800 million users and generating roughly $4 billion in revenue with 20 million subscribers.
  • ChatGPT achieved 365 billion annual searches in just two years—5.5 times faster than Google’s eleven‑year trajectory—demonstrating unprecedented speed of market penetration.
  • Infrastructure spending is exploding: Nvidia’s GPU compute capacity grew 100× over six years, cloud‑provider capex has surged, and data‑center buildout has risen 49 % annually since 2023.
  • Efficiency gains are dramatic, with energy required per LLM token dropping by a factor of 105,000 over the past decade, making today’s AI capabilities feasible.

Full Transcript

# AI Boom: Mary Maker's Report **Source:** [https://www.youtube.com/watch?v=SykH1k65Dy4](https://www.youtube.com/watch?v=SykH1k65Dy4) **Duration:** 00:13:00 ## Summary - Mary Maker, famed internet trends analyst, released her first AI report in five years—a 340‑slide deep dive that the speaker highlights as a must‑read (full summary available on their Substack). - The report shows AI adoption soaring “up and to the right,” with ChatGPT user growth rising 8× in 17 months, reaching 800 million users and generating roughly $4 billion in revenue with 20 million subscribers. - ChatGPT achieved 365 billion annual searches in just two years—5.5 times faster than Google’s eleven‑year trajectory—demonstrating unprecedented speed of market penetration. - Infrastructure spending is exploding: Nvidia’s GPU compute capacity grew 100× over six years, cloud‑provider capex has surged, and data‑center buildout has risen 49 % annually since 2023. - Efficiency gains are dramatic, with energy required per LLM token dropping by a factor of 105,000 over the past decade, making today’s AI capabilities feasible. ## Sections - [00:00:00](https://www.youtube.com/watch?v=SykH1k65Dy4&t=0s) **Mary Maker's AI Report Highlights** - The speaker summarizes Mary Maker's first AI report in five years, emphasizing unprecedented user and revenue growth metrics for ChatGPT and the broader AI market. - [00:03:06](https://www.youtube.com/watch?v=SykH1k65Dy4&t=186s) **AI Efficiency Revolution Cuts Costs** - The speaker explains that the surge in AI usage has triggered an unprecedented drop in energy and inference expenses—over a 105,000‑fold reduction in energy per token and a 99.7% cost cut for serving models in just two years—making today’s rapid advancements feasible. - [00:07:04](https://www.youtube.com/watch?v=SykH1k65Dy4&t=424s) **AI Model Funding vs Revenue Gap** - The speaker outlines how AI model companies have raised nearly a hundred billion dollars while generating far less revenue, creating a capital overhang that raises serious sustainability and profitability questions for firms like Anthropic, OpenAI, and Google. - [00:10:28](https://www.youtube.com/watch?v=SykH1k65Dy4&t=628s) **AI Gold Rush Monetization** - The speaker outlines a presentation likening the booming NVIDIA AI ecosystem to a gold rush, emphasizing high‑margin chip sales over low‑margin token sales and directing viewers to a Substack for a deeper dive. ## Full Transcript
0:00So, Mary Maker wrecked my weekend, and I 0:02mean that in the best sense. She's known 0:05as the queen of the internet. Uh, and 0:07she was famous for her internet trends 0:09reports that came out annually and were 0:11particularly insightful from the 1990s 0:13to 2019. She was early on Google, she 0:16was early on Amazon. She has a sterling 0:18reputation for her analysis in the 0:20space. This is the first report she has 0:24dropped in five years and it's on AI. 0:27340 slides. I'm guessing you don't want 0:31me to go slide by slide, so I want to 0:33call out to you some of the highlights. 0:35There is a completely free article over 0:37on my Substack if you'd like a full 0:39takedown. Uh it was a lot of fun for me 0:41to go through this weekend. I I it's 0:43it's incredible to see the amount of due 0:46diligence in this deck to be very honest 0:47with you. All right, let's get right to 0:50it. First up, we have what I call the up 0:52into the right section. uh where Mary is 0:55basically laying out the case that AI is 0:58absolutely 1:00unprecedented in the rate of growth that 1:03it is demonstrating across all of the 1:05traditional metrics and 1:07software. So she calls out AI user 1:10growth chat GPT as an indicator up 8x in 1:1417 months which is just wild. uh so up 1:17to 800 million and then talks about how 1:20that translates into 1:22revenue and these are already given the 1:24pace of change these are already 1:26somewhat out of date um and revenue is 1:29up toward 4 billion now for chat GPT 1:31subscribers are up toward uh 20 million 1:35uh from virtually zero uh in 2022 and so 1:38it's just again been up and to the right 1:40and continuing to accelerate even in 1:422025. 1:44Uh, and then this one is my 1:46surprise. The time to 365 billion annual 1:51searches or a billion searches a day. 1:54Chat GPT got to that 5 and a half times 1:58faster than Google got to it. And so 2:01Mary calls out that Chat GPT hit 365 2:04billion annual searches in 2 years 2:07versus Google's 11 years, which is just 2:11wild. 2:13And now I know there's differences in 2:15internet penetration and other things 2:16that affect that but still the speed is 2:21astonishing. Mary also calls out uh some 2:24up and to the right trends in capital 2:26expenditure and internet infrastructure. 2:28Nvidia installed GPU computing power has 2:32gone up 100x in six years. 100x. That 2:37one also got me to do a double take. 2:39There were a lot of double takes in 2:40these slides because I knew the numbers 2:42were big, but it was just wild. Capex 2:45spend at the big six, I knew that was 2:47inflecting. It's really astonishing how 2:50much it has scaled up as a growth rate 2:55since 2020. Like we can see the 2:58beginning of the AI buildout in big 3:00cloud providers in 2020. 3:03Data center buildout also had a major 3:06inflection point but came a little bit 3:08later in 2023 as AI start to hit. It's 3:11been up 49% a year since 2023 which is 3:17insane. At the same time, there are a 3:19few charts that are down and to the 3:21right. So energy required per LLM token. 3:25I I am not kidding you. 3:32105,000x decline in energy required to 3:36generate a token over the last decade. 3:38If you want to look for a reason why 3:40some of what we're experiencing today is 3:42possible. That's it. 3:45105,000 times cheaper to generate a 3:48token in the last 10 years. This is off 3:52the NVIDIA GPU set. Similarly, AI 3:55inference costs are dropping through the 3:57floor. 3:59So uh the cost to serve a model is 4:0299.7% lower over two 4:07years. AI cost efficiency gains look 4:10like a cliff as you would expect. And 4:13Mary does an interesting job here on 4:15this slide. She talks about the 4:18difference between the light bulb and 4:21the computer 4:22chip and or computer memory chips in 4:25particular and then uh the cost to 4:28generate like a 75word response in chat 4:31GPT and you don't have to like know the 4:34exact number to get the general idea 4:36that the light bulb took something close 4:38to 75 years to drop as far in cost as 4:42chat GPT has dropped in two years. 4:47And that's just wild to 4:49me. And because cost is lower, model 4:52performance is converging. And this is 4:55why Deep Seek's gains are not that 4:57surprising. And so if you look at the 4:59overall arena scores, which I know are 5:02not perfect, but at least they're a 5:04head-to-head comparison. Google, Open 5:06AAI, Deepseek, they've all converged, 5:10and they were very, very different just 5:13a year plus ago. 5:15And so seeing that convergence 5:17highlights what Sam has called out which 5:19is that we don't live in a world where 5:20we're going to have one winner in AI. We 5:22live in a world where there are multiple 5:24winners in AI. There's fierce 5:25competition. And this calls out one of 5:28the areas where Mary and I diverge a 5:32little bit. Mary views this fierce 5:34competition in classically economics 5:36terms. She thinks of it as competition 5:38that's good for consumers. What I notice 5:41is that consumers seem to have already 5:43anointed a winner in chat GPT and to a 5:45lesser extent 5:46Gemini and I don't see a proliferation 5:50of apps powered by these foundation 5:52models that I would expect in a true 5:54consumer revolution. People seem to be 5:57leaning into the habit stack they 5:58already have with Chad GPT. 6:02I do think this sort of vicious 6:05competition is going to be very good for 6:07businessto business use cases where we 6:09see much wider adoption across different 6:13business use cases and lanes of these 6:16different 6:17models. And so I think the thing that 6:20stands out to me that Mary doesn't 6:21really get into in the deck is that 6:22there's a very different future 6:23unfolding empirically for B2B than there 6:26is for B TOC. B TOC seems like a lottery 6:29where you're competing with shed GPT 6:30right now and B2B looks a lot more like 6:34we have these individuated use cases 6:36foundation models won't necessarily ever 6:37cover them we need to build a particular 6:39tool for this particular use case and 6:41you can have a lot of winners in the in 6:43the niches and the margins there and in 6:45that world having lower overall model 6:48cost and cost to serve makes a big 6:50difference from a unit economics 6:53perspective. Now, that gets at one of 6:56the things that Mary calls out that 6:57isn't 6:58really it's not clear how this gap gets 7:01fixed. 7:02Fundamentally, AI model companies have 7:04raised something close to hundred 7:06billion. Mary pegs it at 95 billion and 7:09they only cleared about 11 billion in 7:11annualized revenue. Now, that number is 7:14rising really fast as these model makers 7:16start to scale. I think Anthropic 7:18literally is off the charts right now 7:19because Mary pegs them at 2 billion and 7:21I recently heard three billion as an 7:22annualized rate. So they're really 7:24exploding, particularly since the Claude 7:264 launch a couple of weeks ago, but the 7:30overall picture remains the same. 7:33They've raised about 10 times more than 7:35they've delivered in annualized revenue. 7:36And there's a tremendous capital 7:39overhang there. And that 7:42means that means a big question mark 7:45around how we resolve that funding 7:47discrepancy. Because if you have a 7:49capital overhang, you have vicious 7:51competition, you have cost to serve 7:53going down, there's tremendous margin 7:55pressure on uh token utility and cost 7:58per token. At the end of the day, you've 8:00got something that you are selling 8:02that's depreciating really fast. That's 8:05tokens. And it costs a lot to make a new 8:09model. And I don't know how you clear 8:11money on that long term. And I think 8:13that's one of the interesting question 8:14marks for Anthropic, for OpenAI, for 8:17Google. And of those, Google obviously 8:19has the deepest pockets and can sustain 8:20this the longest. And that may be part 8:22of their 8:23strategy. But at the end of the day, 8:26this is a real discrepancy. And and the 8:28bill is going to have to be paid at some 8:30point. I remember when Uber was dirt 8:33cheap and everyone was taking $2 rides 8:35here and there. Well, now they're $20. 8:37Now they're $25 rides. And so part of 8:39how Uber closed their profitability gap 8:40was they started charging the economic 8:42price. And I do wonder if at some point 8:46model makers are going to close this 8:47revenue gap by substantially raising 8:50prices and we will have to see if 8:53they're able to retain users in that 8:57scenario. All right, moving along a 8:59little bit. I think one of the other 9:01takeaways I had is that AI agent 9:04interest is up as much as people think. 9:07It's up 9:09a,088% over the last 16 months if you 9:12look at Google search trends. But, and 9:15this is again where I would sort of add 9:17a little nuance to Mary's 9:19take, I do not think that we are seeing 9:23very many practical use cases of agents 9:26outside of very large companies that 9:28have strong LLM engineering teams or 9:31very tidy pre-built agents that do very 9:33narrow things. Those are the two use 9:35cases where I see wins. And there's a 9:37big messy middle in the mid-market where 9:41companies have custom needs, but they 9:42don't have the capital to get strong AI 9:45engineering talent. And their needs are 9:48too custom for the pre-built stuff. And 9:50what do they do? There's not really a 9:51great answer to that right now. Uh, and 9:53I think that that's an area where a 9:55little bit more nuance is helpful in 9:57terms of understanding what's really 9:58going 9:59on. All right, we're going to skip over 10:01some of this. I know we've already gone 10:03on a long way. One thing I do want to 10:05call out is that it's not just you 10:07imagining everyone talking about the AI 10:09hype. Uh the proportion of S&P 500 firms 10:12mentioning AI during their quarterly 10:14earnings calls is now over 50%. It has 10:19skyrocketed from 10% in just a year, 10:22year and a half maybe. Absolutely wild. 10:26And there has been a doubling in 10:28developers and startups and apps in the 10:30NVIDIA AI ecosystem to 10:33serve all of those companies. And so in 10:36a sense, we're in the middle of a gold 10:37rush. And she actually names it. Mary 10:39Mary calls out sort of that famous 10:42venture capital analogy of selling picks 10:44and shovels in the gold rush. And uh 10:46there's a whole run of about 10 or 15 10:49slides where she does nothing but talk 10:50about like the companies that are 10:51selling chips and monetizing really 10:53effectively. a lot of her case is that 10:55selling tokens has it's a low margin 10:58business but selling chips is a high 10:59margin business so she likes Google for 11:01their TPUs she likes uh obviously Nvidia 11:05and kind of how they've been able to 11:06manage their business and we will have 11:09to see how the major model makers handle 11:11their monetization strategy okay we've 11:15gone through a lot of the deck but I've 11:17gone through it at a very high level and 11:19I know this may seem like a long video 11:20but I promise you reading 340 slides is 11:25longer. If you want to dive deeper on 11:27this, uh, feel free to grab my Substack. 11:30I'll link it here. It is a full readout. 11:33Still much shorter than the deck, but 11:34you get a sense of what she did. You can 11:36check out all of those charts. I chose 11:38not to scroll through it because 11:39whenever I do that, I never get views on 11:42those videos. So, you guys seem to like 11:44my face, which is kind of weird, but 11:45here we are. And you can also see my 11:48take on the deck. And you can see a 11:50little bit more about the taker on the 11:51internet. I include sort of perspectives 11:52from Axios, perspectives from other 11:54places where Mary has given interviews. 11:56Uh, and we sort of get an overall 11:58picture of this deck. Is it worth it? 12:00Yes. This is probably the deck that will 12:03be most influential to how capital 12:05allocators, VCs, investors think about 12:08AI for the rest of this year. It is 12:10absolutely worth this degree of 12:12attention. And if you're not an 12:13investor, it's worth it to you because 12:15this shapes how the investors who drive 12:18companies, drive job 12:20creation are going to be thinking about 12:22this stuff. And that affects all of us. 12:25Whether the job opens up or not is the 12:27function of whether the startup funding 12:28is there. And if the startup funding is 12:30there, it might be because Mary Mer made 12:33a recommendation in this deck very 12:34bluntly. And so I want to make sure 12:38everybody is aware of this. I've made 12:40this completely free so that everybody 12:42can dive in and look at it. Uh, and I've 12:44obviously linked to the deck so that you 12:46can sort of see the full thing if you 12:47want to. And that's where I'll leave it. 12:50It was a lot of fun for me to go through 12:52all 340 pages of the deck. I know it's 12:55not fun for everybody, but I'm a nerd 12:57like that. Hope you enjoy this summer.