Is Google Getting Worse? (Update)

Episode Summary

In the episode titled "Is Google Getting Worse (Update)" from Freakonomics Radio, the discussion revolves around the evolution of Google's search engine and the emergence of new competitors in the search engine market. Initially, Google revolutionized internet search with its PageRank algorithm, making information accessible and useful. However, over the years, there have been growing concerns about the quality of Google's search results, with users feeling that results are more geared towards advertisements and less towards providing useful information. This has led to questions about whether Google's near-monopoly over internet search is leading to a degradation in the quality of search results. The episode introduces Perplexity, a new search engine powered by artificial intelligence, as a potential competitor to Google. Perplexity aims to provide conversational answer engines that give users direct answers to their queries, pulling relevant information from the internet, thus saving users the time they would otherwise spend browsing through multiple tabs. This approach contrasts with Google's model, which has increasingly integrated ads into search results. Perplexity's co-founder and CEO, Aravind Srinivas, discusses the differences between Perplexity and other AI-driven search engines like ChatGPT, emphasizing Perplexity's focus on accuracy and up-to-date information. Despite the emergence of AI-driven search engines, the episode suggests that it is unlikely that Google will be put out of business within the next decade. The infrastructure Google has built for traditional ranking-based search interfaces will still hold value, even as the next generation of interfaces becomes more AI-centric. However, the new sector of AI chatbots and answerbots is expected to be more competitive, with multiple players in the market, including OpenAI, Meta, Microsoft, and potentially Apple. This competition could challenge Google's dominance in the search engine market. The episode also revisits the original question of whether Google is getting worse by examining the changes in Google's search results and the web's overall quality. Marissa Meyer, a former Google engineer, suggests that the decline in search result quality may be more reflective of the web's overall decline in quality due to economic incentives for misinformation and fraud. Google has attempted to address this by providing selected content and featured snippets directly in search results, but this approach has received mixed reactions from users. In conclusion, while Google's search engine has faced criticism for declining quality and increased advertisement integration, the emergence of AI-driven search engines like Perplexity presents a new challenge to Google's dominance. However, the future of internet search is likely to be more competitive, with multiple players contributing to the ecosystem. The episode underscores the ongoing evolution of search technology and the need for continued innovation to meet users' information needs.

Episode Show Notes

It used to feel like magic. Now it can feel like a set of cheap tricks. Is the problem with Google — or with us? And is Google Search finally facing a real rival, in the form of A.I.-powered “answer engines”?

Episode Transcript

SPEAKER_04: Freakonomics Radio is sponsored by Marriott.Town Place Suites by Marriott has all the comforts of home.Cook up a meal in a full kitchen, unpack and stay organized with the in-room alpha closet system, plus bring your pet and have your best friend by your side.Town Place Suites by Marriott has all the amenities you need to feel at home during your stay.Find the comforts of home at Town Place Suites.Go there with Marriott Bonvoy. Freakonomics Radio is sponsored by Capital One.Capital One offers commercial solutions you can bank on.Now more than ever, your business faces specific challenges and unique opportunities.That's why Capital One offers a comprehensive suite of financial services, custom tailored to your short and long-term goals. Backed by the expertise, strategy, and resources of a top 10 commercial bank, A dedicated team works with you to support your success and help achieve your goals.Explore the possibilities at CapitalOne.com slash commercial. Hey there, it's Stephen Dubner.About a year and a half ago, we published an episode called Is Google Getting Worse?We talked about Google's near-monopoly over internet search, and we looked at a startup called Neva that was trying to compete against Google.Well, Neva has already shut down, so maybe it will be impossible to dislodge Google.Or... Maybe not.Since we put out that episode, a new kind of competitor has emerged, search engines powered by artificial intelligence. You've probably already heard about ChatGPT, but the one I was interested in hearing more about is called Perplexity.So today, we are going to replay that earlier Google episode.But first, I'd like you to hear a new conversation we just recorded with this would-be rival. SPEAKER_07: GUSTAVO AMBROSIO- Google created the greatest business model on the internet.It just has to be rethought. That is Aravind Srinivas.I'm the co-founder and CEO of Perplexity. SPEAKER_04: Perplexity is what?Describe it to someone who, like a grandmother, an uncle, someone who doesn't know a whole lot about how this works. SPEAKER_07: Perplexity is a conversational answer engine.So you ask it a question and it just gives you the answers.And it also tells you where it pulled the relevant information for the answer from the sources. So it's saving you all the time that you otherwise would have spent browsing the internet and opening these different tabs and reading all of them for yourself and being pretty confused about what you should take away. SPEAKER_04: Now, if I didn't know that you were the CEO of Perplexity, I might think you were the CEO of ChatGPT, because what you're describing sounds the way that ChatGPT works to a large degree.Are you simply a later, slightly more up-to-date version than ChatGPT, or are you substantially different? SPEAKER_07: When we came out, the primary difference was the fact that ChatGPT hallucinated and gave incorrect information for queries that actually needed factual grounding.And we could do it because we always pull up relevant facts from the internet and only use those facts to answer your query.So accuracy is about two things.One is up-to-date information. The second thing is the speed.When ChatGPT browses, it almost takes like an eternity to get the answer back, six or seven seconds to be more precise.But in the parlance of computer interaction and user experience, closest to 10 seconds for a response is pretty bad. SPEAKER_04: What do you think are the odds that Perplexity and ChatGPT or OpenAI and maybe five other AI-driven search or answer engines, as you call them, what do you think are the odds that all of those collectively will essentially put Google out of business within 10 years? SPEAKER_07: I don't think Google is going out of business.All the infrastructure they've built for the traditional ranking-based search interface is still going to be valuable even for the next generation of interfaces that are going to be more AI chatbots-like.All I can say for sure is that this new sector of AI chatbots and answerbots, and potentially agents too, will not be a monopoly.And why do you say that?Because it already is not. first of all, leave perplexity.Maybe you can be skeptical if perplexity can make it that far to be considered a Google competitor.But already OpenAI is not letting Google be a monopoly there. Meta won't let Google be a monopoly.Microsoft was there. So there are just going to be more players in this ecosystem of answer bots and chat bots and agents and more devices in the market that power these.And Apple is also not going to be quiet here.So Google could have been the monopoly here for what it's worth.They could have built ChatGPT in 2020 or 21 and had the whole, you know, profits from this new sector largely driven for themselves. But they were just too lethargic and other people have the first mover advantage. SPEAKER_04: But with a few billion people used to having search for free, how would you approach the notion of training people to pay for something that they used to get for free? SPEAKER_07: We're still always going to have a free version of the product.They would pay for a better service.And once people do realize that they have been cheated all along, where all their time has been taken away and all their data has been marketed to the advertiser who's making the money, They're going to realize that this is worth at least a few lotties a month, you know? SPEAKER_04: Let's pretend that three years from now, Perplexity is acquired by a much bigger firm.What's most likely, that that firm is Google or the rest of the field?The rest of the field will say Microsoft, Apple, Meta, etc. ? SPEAKER_07: I hope not Google because, you know, the whole point is the world needs alternatives, right?If you just want one company to forever be the de facto source of information and knowledge on the internet, then that doesn't seem like a good future.Do you see a company out there that you think, if we were to be acquired, that would be a fantastic fit?Firstly, I just want to caveat by saying I am interested in being that company myself.Like, perplexity to be one of the providers of information on its own and building a sustainable business. But since you asked a hypothetical question, I think it'll be very interesting to work with Apple because Apple is such an amazing stronghold in terms of access to American users who are like what advertisers are really trying to target and the ability to have like native integration across the Apple ecosystem of devices. Siri will finally be able to ground itself in real information and answer questions.And that's like one company Google fears, right?What about privacy?How Apple treats customer data versus Google and Meta and others? Even there, yeah, we've been very transparent about, you know, if you want to turn off your data usage... Just go to the settings and turn it off.We're not going to use that information, which is actually way better implemented than ChatGPT.In ChatGPT, if you turn it off, you lose your history too.Whereas in Perplexity, you can still retain your history. and we would not use that data for training.In fact, there was a recent incident where Google, by default, indexed all people's barred chats without telling them.Whereas in Perplexity, by default, every query is private unless you choose to share it, only then it becomes publicly indexable. SPEAKER_04: That, again, was Aravind Srinivas, the CEO of Perplexity.He tells us they now have about 10 million active monthly users, with 70 to 100,000 of them paying $20 a month for the premium service.ChatGPT is much, much bigger, and Google recently introduced its own AI model called Gemini, so this is only getting started. Okay, now it is time to hear the original episode called Is Google Getting Worse?We have updated facts and figures where necessary, and we've also cut out the section about Neva, since they're already dead.As always, thanks for listening. Do you remember when using Google to search for something online felt like magic? SPEAKER_03: I'm old enough to remember before Google, and it was really hard to find anything on the internet.That is Ryan McDevitt.He is an economist at Duke.Google was a revelation because it made this information accessible and it was so useful. SPEAKER_04: The power of that revelation faded, as revelations do, and we all began to take Google for granted.When you needed some information, you just typed a few words into the search box.Very quickly, you got the answer you were looking for, usually from an authoritative source. But today, to me at least, it doesn't feel the same.My search results just don't seem as useful.I feel like I'm seeing more ads, more links that might as well be ads, more links to spammy web pages.Do you also feel like Google isn't what it used to be?Today on Freakonomics Radio, how did Google come to dominate web search in the first place? SPEAKER_06: People would be like, your search engine is so good and you're not making any money and we just wanted to pay you. SPEAKER_04: What happened when Google essentially became a monopoly? SPEAKER_02: The problem with monopoly power is that you can degrade the experience because you've locked in that user.And we will hear Google's defense. SPEAKER_04: Or is it more of a threat? SPEAKER_05: If I took Google away, you would go nuts. SPEAKER_04: Is Google getting worse?Or is it just that, as Milton Friedman might have said, there's no such thing as a free search? SPEAKER_08: This is Freakonomics Radio, the podcast that explores the hidden side of everything with your host, Stephen Dubner.Whoa! SPEAKER_04: In the beginning, computer scientists created the World Wide Web.And the web was without form and void.Darkness was upon the face of the internet.And someone said, let there be search.And behold, there was search.And in time, the search engine started. SPEAKER_06: There was AltaVista.There was one called All the Web or Fast that was working out of Norway.There was one called Dogpile that was actually a meta search and hit many of the other searches. SPEAKER_04: That's Marissa Meyer.She runs a tech startup called Sunshine.Before that, she was CEO of Yahoo.And before that, she worked at Google for 13 years.She was the 20th employee at Google and their first female engineer.She joined right after getting her master's degree from Stanford in computer science. SPEAKER_06: I was very attached to a search engine called Infoseek.I just felt like it had really helped me on my papers.And so when I even started working at Google, for about the first month, I would do every search on both.It took me a while to convince myself I wasn't going to miss out on anything by not doing the search on Infoseek. SPEAKER_04: Infoseek and other search engines were okay at crawling the web and finding pages that contained the words you searched for, but they weren't great at figuring out which of those pages you'd actually want to see.A search query produced a long list of sites in seemingly random order, and you would have to page through hundreds or thousands of links to find what you needed. Sergey Brin and Larry Page thought they could do better.In 1996, when they were grad students at Stanford, they created a search engine built upon a clever algorithm called PageRank, as in Larry Page, but also as in ranking your search results by page. Theoretically, the most useful result would be at the top of the first page of results.Think about a newspaper, if you can remember back that far.The important stories of the day were on the front page, A1.The less important stuff was tucked inside.That's what PageRank was going for.And how did it do that? Brin and Page had applied an insight from the world of academic research, where the most important research papers are the ones that are most often cited in the bibliographies of other papers.The Web didn't have bibliographic citations, but it did have links.So when PageRank looked at a given Web page, it would see how many other pages linked to it. The most important pages, they theorized, would have lots of links pointing to them from other pages.And then the algorithm looked at how important those pages were based on incoming links.Their mission, they said, was to organize the world's information and make it universally accessible and useful. SPEAKER_06: Even when I was deciding to go to Google, the refrain I heard most often from people who knew I was thinking about working there was, why does the world need another search engine?There's already a dozen or so that are good enough.And I think it was Larry and Sergey rejecting that premise that good enough isn't good enough for search.You can be great.And the one that's great will make a marked difference is really what led to Google's success. SPEAKER_04: Brin and Page were not the only researchers who thought about ranking search results this way, but they did get their version to market first.And people really liked it. SPEAKER_06: Every now and then we would get fan mail that would have like a check or cash in it.People would be like, your search engine is so good and you're not making any money and we just wanted to pay you. SPEAKER_04: So how would they make money? In 1999, some big venture capital firms invested $25 million in Google in a deal that valued the company at $75 million.They considered or attempted a variety of money-making strategies, licensing their search technology to other websites, selling a hardware product that would let companies search their own internal files.If you had read Brin and Page's original research paper about their search engine, You might have thought there was one source of revenue they wouldn't pursue.Advertising.In a section of their paper called Advertising and Mixed Motives, they wrote, advertising income often provides an incentive to provide poor quality search results.So which revenue model did they pursue? Yes, it was the ads. SPEAKER_11: One of the things that Google really innovated early on and was really successful in was getting ads to scale on search engines. SPEAKER_04: That is Tim Wong, who used to work at Google on technology policy.Now he is a media researcher and the author of a book about digital advertising called Subprime Attention Crisis. SPEAKER_11: And what that basically meant is that Google as a search engine became a lot more profitable than a lot of its competitors.And what made them so profitable? SPEAKER_04: As it turns out, the mechanics of the Google ad tech system were just as innovative as their search engine. SPEAKER_11: The way the Google ad tech system works is that there is essentially a marketplace where people are bidding for the right to show me the search ad. SPEAKER_03: Google was one of the first to auction off the first few listings on the search results.Ryan McDevitt again.Their position auctions, they call them.That's how Google made all their billions of dollars. SPEAKER_11: Now, one of the innovations that Google has is that that auction is based not only on how much money you're offering, but also on a number of characteristics around the quality of the ad.And in some ways, this is kind of Google's genius, that they were able to set up a market where people bid for the right to show ads, but then there's also an incentive for those ads to be ones that are not automatically annoying ads.So when you click the search button, SPEAKER_04: Google finds relevant ads and chooses which ones to display above the search results based on several factors.How much the advertiser bid, how relevant Google thinks the ad will be to the user's search, as well as what Google calls context and expected impact. Google says that 80% of searches result in no ads being shown along with the results.But how important is that 20% to Google's bottom line? SPEAKER_11: It's huge.About 81% of Google's revenue comes from advertising on its properties and in search. which is really remarkable if you think about it, right?It still remains their core driver of revenue, despite all the other things Google has done in that time, the kinds of things that Google is known for, like artificial intelligence and self-driving cars and all this kind of stuff.They all pale in comparison to the continued dominance of ads as the thing that funds the company. SPEAKER_04: The company is actually called Alphabet these days.That's the conglomerate that includes Google and a bunch of other properties, including YouTube.But most people still call it Google. And considering the financial strength of Google itself, this makes sense.But mixing search and advertising, as Google founders Brin and Page had themselves argued, could create mixed motives.Think about what happens when you do a Google search.You are looking for the answer to a question. The advertiser, meanwhile, wants the user to see information that promotes the advertiser's interests.Those two motives might overlap, but they very well might not.Marissa Meyer says that in its early days, Google did consider a subscription model versus an ad sales model. SPEAKER_06: As we started to do a sort of thought experiment around how to monetize, we're like, should we just have people pay us to run this search service online? You know, we looked at it and we were like, OK, $20 a year, that seems like a reasonable price point for that time.And then we were like, theoretically, what if we could make a penny a search?And by the way, search ads are sold by the thousands.They use milla in Roman numerals, CPMs. SPEAKER_04: CPM meaning cost per thousand. SPEAKER_06: So we were like a $10 CPM, a penny per page.And we were like, well, we think people are going to start doing more search, not less.And as people start doing searches, let's assume they do 20 searches a day, five days a week.They take weekends off.That's 100 searches a week.And there's 52 weeks in a year.So that's 5,200 searches, which means if we could do a $10 CPM, we could make $52. So then you're like, well, wait, that means with ads, we could probably make $52, where consumers are really putting a value on this is closer to $20. right?So it's two and a half times as lucrative to do it as ads as monetizing the consumer directly. And by the way, in Q4, in the retail quarter, in the run-up to Christmas, the CPM that Google sees in North America today, I would guess is well north of $100 CPM.So it's not a penny per page, it's a dime per page.So then you're saying, well, now it's the difference between like the user might pay us $20 or maybe because of inflation and time, Maybe now they'd pay us $100 a year, but Google can make $500 a year on those same searchers with that same set of assumptions. SPEAKER_04: So in the end, it was not a hard decision. SPEAKER_06: It wasn't a hard decision. SPEAKER_04: But Meyer and others at Google were concerned that showing ads with search results would degrade the experience for users.So she helped design an experiment to see how true that might be. SPEAKER_06: We said, okay, 99% of users will get ads and we're going to hold 1% not getting ads just to make sure that if we start to see in various search health metrics a degradation in how the searchers were feeling and using the search engine, we could pick up on it. SPEAKER_04: This was back in 2000.The experiment was put in place.99% of Google users getting ads and a small group of users getting no ads at all.But then Google sort of forgot about the experiment. SPEAKER_06: I think it was 2008, one of my colleagues came to me and said, we have this issue, we have advertisers who call our customer support line, and they're very upset because they pay for ads, and then they get assigned into this experiment group called No Ads At All, and they can't see their ads and verify that they're running. And I remember feeling like I turned kind of white at my desk as I heard this because I said, do you mean that experiment that I coded in 2000 is still running?And they were like, apparently.But I was like, you know, before we turn that off, this is the longest running split A-B experiment in the history of the Internet.And it is on this fundamental question about our company and our business.So before we turn it off, let's analyze it. SPEAKER_04: And what did the analysis show? SPEAKER_06: What we saw was 3% more searches from people who had ads than didn't.So basically, there was an appreciable difference over a long period of time that people actually liked Google search results more and did more searches when they had ads than when they didn't, which I thought was really validating.And then we turned the experiment off. SPEAKER_04: When you consider that users who got ads did more searching, you realize this is probably the most expensive experiment Google ever ran.Think of all that lost ad revenue.But there's a bigger question.Why would ads improve the search experience? SPEAKER_06: Because you often get a higher quality result experience from someone who's willing to pay for it.I will say now as an entrepreneur, there's a point when you're building an app that you're like, I'm willing to put an ad out for our app.I think it's that good.Up until then, when you're in beta, you're like, you know, we're still ironing out some kinks.I'm not sure it's worth to pay to put our app in front of someone.And that said, there are some queries that just have remarkably commercial intent.At the time, I was like, Madonna tour tickets. If you did Madonna tour tickets and you looked at the organic results, they were terrible.There's no tickets to buy.But if you put search ads there, the people who actually have tickets to Madonna's tour are happy to pay a lot to get those expensive tickets in front of users. And they actually make the search quality better. SPEAKER_04: That's an interesting argument, and I don't disbelieve the data Marissa Meyer is citing.But you could imagine a different story about ads and search.If you were looking for something specific and hard to find, like Madonna concert tickets, an ad might be the best search result available.But what if you just need someone to unclog your toilet? In the old days, you might open the big fat phone book known as the Yellow Pages.I got a couple of them right in front of me.Ryan McDevitt again. SPEAKER_03: A-AAAA Sewer and Drains, AAAA Scott's Plumbing, just like ridiculous names. SPEAKER_04: Why did all these plumbers have such ridiculous names?Well, in a format like the Yellow Pages, whose listings were alphabetical, those plumbers' listings would appear at the top of the plumbing category. SPEAKER_03: They're trying to attract customers who have an urgent need.They don't have time to search.They probably don't use this very often.And so that's the one way to grab attention is to be at the front of the yellow pages. SPEAKER_04: McDevitt began studying plumbers when he was a graduate student.He was looking for a dissertation topic.He and his wife were house-sitting for another couple when he suddenly got an idea. SPEAKER_03: And so I jumped out of bed in the middle of the night and they actually had a Yellow Pages.And so I looked and sure enough, they're in the plumbing category, a bunch of AAs, locksmiths, a bunch of AAs.And then you start to think about the logic behind that.So I spent the better part of two years calling every plumber in Chicago.And what was McDevitt hoping to learn? SPEAKER_04: He wanted to know if there was any sort of relationship between the kind of plumber who would use a ridiculous name to get to the top of the Yellow Pages listing and the quality of the plumber. The paper he wound up writing is called A Business by Any Other Name. SPEAKER_03: I thought it was a clever title because I put A in quotation marks, but I guess that's kind of lame outside of economics.It's okay, Ryan. SPEAKER_04: Your humor is safe with us.Anyway, McDevitt set out to compare plumber quality as measured by data he got from the Better Business Bureau and plumber name based on how they listed themselves in the Yellow Pages.What did he find? The plumbers with a lot of A's in their names tended to be more expensive and lower quality than other plumbing firms.He also found that the low-quality firms listed themselves under multiple names. SPEAKER_03: You'd call up AAA plumbers and say, hi, I'm Mike, what do you need?And then you go down to A-best plumbers, hey, it's Mike, what do you need?And then you go down to the best plumber in Chicago, hey, it's Mike.And those plumbers are the worst possible plumbers.They're really trying to manipulate the Yellow Page listings to get a lot of results. SPEAKER_04: The Yellow Pages still exist online, but that's not where most people go today when they need a plumber. They go to Google.And there, McDevitt argues, the same logic applies.Firms that do everything they can to grab a customer's attention are not competing on quality. SPEAKER_03: Now you're blanketing Google with a bunch of listings.You're blanketing Google Maps with a bunch of listings.You're trying to win the first ad slot on Google, just like you try to get the biggest ad in the yellow pages.All these behaviors are consistent with a story.You're trying to attract uninformed consumers who aren't going to search a lot. SPEAKER_04: So if I'm reading this correctly, your research showed that plumbing firms that advertise on Google have 13 times as many complaints as firms that don't.First of all, am I misreading that?13 times is the actual magnitude? SPEAKER_03: That was the right number back in 2007, 8, when I was pulling the data.So it's a big difference.And again, the logic is the ones that are trying to attract these one-off customers who are searching quickly, those are the ones that you can rip off. SPEAKER_04: I've seen other research on position auctions for Google advertising.This is from Susan Athey and Glenn Ellison, I believe, which says that position auctions actually make search more efficient and they sort firms from high to low quality.Do you agree with that? SPEAKER_03: You know, it's a theory paper and the theory paper, a beautiful paper, it depends a lot on the assumptions in the setting.And so they did not have plumbers in mind when they wrote that paper.Yeah. What's different in the setting of plumbers is the costs are very different.The profits are going to be very different if... you're not providing the service in a legitimate way.If you're a fly-by-night plumbing firm, those are the ones that are going to be most profitable and get the most value from winning the auction. SPEAKER_04: A few years ago, Google was in the news for a locksmith scam.A shady call center would create fake listings for locksmiths across the country advertising very low prices.If you clicked one of their links, the call center would send out a poorly trained subcontractor who then demanded three or four times the listed price. Google eventually cracked down on these call centers by requiring special verification to advertise locksmith services.This kind of problem goes way beyond shady locksmiths and plumbers and beyond Google as well. SPEAKER_03: I've noticed pretty plainly over the past couple of years that anytime you try to search for anything on Amazon, it's really hard to find what you're looking for.The first dozen or so listings, it's mostly junk. SPEAKER_04: McDevitt, we should say, actually worked with Amazon for six months a few years ago. SPEAKER_03: Looking for a phone charger, AirPods, whatever it is.These sellers have found a way to manipulate their search algorithm.And Amazon's making a lot of money from the ad placement now.They've taken a page out of Google's playbook.It's quite lucrative for them to auction off those slots.And it's not always with the customer's best interest in mind. SPEAKER_04: So maybe these are just intrinsic properties of the modern web, the spammy and junky landscape you have to slog through in order to glean the benefits. But Tim Wong, the former Googler, now a media researcher, Wong argues it did not have to be this way. SPEAKER_11: It was a dream in the early 2000s when we saw Wikipedia coming up, like, wow, maybe this is an alternative way to generate all sorts of things on the internet.Wikipedia launched in 2001. SPEAKER_04: Wikipedia is hardly perfect or definitive.It is, however, an example of a vast website that provides valuable information to a huge audience and It doesn't accept advertising.It's a nonprofit and it relies on volunteers to create and maintain content.But let's face it, Wikipedia is pretty much a one-off.It is not a model for how the web is won.The Google model, built on billions of dollars of ad revenue, that is the model that's winning. SPEAKER_11: I think what that has effectively ended up doing is sucking the air out of other experiments that could happen.There is basically a generation of investors in Silicon Valley where you pitch them on a tech idea and they say, well, wouldn't ads work better?We know ads already work.Why don't you do ads?So, you know, if I right now were on the air to propose to you that we should start a subscription only search engine, you'd say that's ridiculous.People would never pay for that because they're so used to having a search engine for free. And I think that is also a factor of historical accident, right?That basically since advertising became so dominant so quickly, so early, we have sort of set the norms of the market in ways that make it really difficult for alternative models to form.And so I think it's almost a failure of imagination to believe that things could not have turned out on the internet any other way. SPEAKER_04: Would it be ridiculous to launch a subscription-only search engine?When we first published this episode in 2022, we talked about Neva, an ad-free subscription-based search engine, which has since shut down. Then again, Perplexity and ChatGPT are offering premium versions for $20 a month, and they can do more than just search.Coming up after the break, could the internet have turned out another way?I'm Stephen Dubner.This is Freakonomics Radio.We will be right back. Freakonomics Radio is sponsored by Honey Nut Cheerios.We all know that heart health is oh so important.And with Honey Nut Cheerios, making heart healthy decisions doesn't have to be complicated. Make Honey Nut Cheerios part of your breakfast with whole grain oats and a touch of real golden honey.Not only do they taste great, but they can help lower cholesterol.Eating a heart healthy breakfast like a bowl of Honey Nut Cheerios can help set you up to make better choices throughout the day.Add a change of heart to your shopping cart. SPEAKER_10: Brought to you by Eaton Vans, the symbol of advanced investing.What's inside your ETF?With Parametric Equity Premium Income ETF, you know.Inside, you'll find institutional quality expertise from a specialized team with deep derivatives experience.Get to know what's inside PAPI, the symbol of alternative income, at eatonvans.com slash CNBC. Before investing, prospective investors should carefully consider the investment objectives, risks, charges, and expenses.The current prospectus contains this and other information and is available at EdenVance.com.Read the prospectus carefully before investing.Not FDIC insured.Offered no bank guarantee. May lose value.Not insured by any federal government agency.Not a deposit.Investments involve risk.Principal loss is possible.Distributed by Foresight Fund Services, LLC. SPEAKER_04: We first spoke with the economist Ryan McDevitt in 2021 for an episode about kidney dialysis.His research had found that the consolidation of the dialysis industry into just two big companies had led to worse outcomes for dialysis patients.Here's the McDevitt quote that stuck with me from that episode.Bad things can happen when there's no competition.So I asked him if the lack of competition in online search could also lead to bad things. SPEAKER_03: This is a very standard theoretical result where if you have almost absolute market power, you're going to increase prices and you're going to reduce your quality to the extent that it maximizes your profits.In healthcare, that's very bad for obvious reasons.In a tech setting like search, the implications are a little bit different. SPEAKER_04: As of today, Google handles about 90% of online global search activity. What's wrong with that? SPEAKER_03: Mostly, you're going to not have that same incentive to continue to innovate to offer the highest quality products because you don't have to.You're just a little bit less disciplined.They still are innovating, of course.They're hiring many PhDs and they're putting out new great products all the time.But that rate would be even faster if they're worried about losing all their customers to the competitor down the street. SPEAKER_04: There are a few search competitors, Bing in the U.S., Yandex in Russia, Baidu in China.There's also DuckDuckGo, a privacy-focused search engine.But again, Google's global market share is 90 percent.Google's Chrome browser is also easily the biggest browser in the world, with around two-thirds of global market share. In second place, with just under 20 percent of the market, is the Apple browser, Safari, which runs on iPhones and iPads and MacBooks.In 2012, Google co-founder and then CEO Larry Page argued that Google couldn't really be a monopoly because, in his words, it's easy for users to go elsewhere because our competition is only a click away. But Google pays Apple a reported $18 billion a year to be the default search engine on Safari.And that's why if you type into your iPhone, Chinese food near me, or even why is Google search so bad, you will get results from Google, not Bing, not any other competitor. SPEAKER_02: And what's that designed to do?Well, it's designed to make sure that consumers don't have to make an explicit choice or that Apple doesn't have to think about providing other alternatives on a level playing field with Google.It's protection money, essentially. SPEAKER_04: That is Jeremy Stoppelman, CEO and co-founder of Yelp.Yelp is a huge crowdsourced review site where tens of millions of users rate restaurants, stores, even plumbers and locksmiths. Stoppelman came up with the idea in 2004 when he had a hard time finding a good doctor. SPEAKER_02: In 2005, we started to get traction, particularly in San Francisco, with random people finding our site and contributing local reviews that had never really been created.You could look up a dry cleaner and see what people in the neighborhood thought of that dry cleaner.And that was an incredibly novel concept.So it wasn't long before Google took note Early on, Google licensed Yelp's content.Ultimately, that partnership was not long for this world because Google decided it really didn't want to just organize the world's information.At least when it came to local search, it felt like it needed to own that space. SPEAKER_04: Google then tried and failed to buy Yelp.And then Google began inviting users to post reviews of local businesses directly to Google.If you use Google Maps, you've seen these reviews. And how did Yelp feel about that?Here is Jeremy Stoppelman testifying before the Senate Judiciary Committee, accusing Google of unfairly prioritizing its own content and even stealing Yelp's content. SPEAKER_12: Allowing a search engine with monopoly market share. to exploit and extend its dominance hampers entrepreneurial activity. SPEAKER_04: That was in 2011. SPEAKER_02: Stoppelman still feels strongly about Google.They felt like no rules applied and they could do whatever they want, which I think is a telltale sign of an abusive, dominant monopoly.Stoppelman, like some of us, is old enough to remember a different Google. If you go back to the early days of Google, it was 10 blue links, minimal ads.And those links were intended to be the best content on the web that they could find.And they were known for crawling every nook and cranny of the web.And users loved it.That's what made them successful.The problem with monopoly power is that you can degrade the experience because you've locked in that user. So in the early days, you have to delight users, as Google did. You have to give them a product that is just way better.But once you've become wildly successful, you might not degrade the results everywhere, but there are certain areas you could cut some corners and dial some knobs and generate a heck of a lot more money.And at that point, you really become a tax collector. And that's what Google really is.They're a tax collector. SPEAKER_04: So if you're Jeremy Stoppelman, what would a truly competitive market for local search look like? SPEAKER_02: Get Google and these other big tech companies to stop putting their thumb on the scale for themselves.Don't self-preference.Pick objectively the best content or the best website, period.There are other websites out there.Yelp is not the only one.There's TripAdvisor.com. There's Angie's List, HomeAdvisor, Take Your Pick, ZocDoc.There's lots of different players that have consumer reviews, but Google makes sure that the prime real estate is dedicated to two things. Ads and themselves. SPEAKER_04: Google is now facing several antitrust cases in the U.S.alone, including one brought by the Department of Justice, alleging that Google is, quote, crippling the competitive process, reducing consumer choice and stifling innovation.They've already been fined for antitrust violations in the EU and in India. And just recently, back in the US, Google agreed to pay nearly $400 million to settle claims from 40 states that Google kept collecting users' location data, valuable stuff if you want to serve local ads, even after users had opted out of being tracked. SPEAKER_02: I've been shocked at how fast the winds on this topic have shifted.When we began speaking out about Google, We got a lot of eye rolls, both from the industry as well as from regulators, frankly, and from the White House.The number one most frequent corporate guest in the Obama White House was Google, to give you some idea of where it was not so long ago. SPEAKER_04: In early 2022, a Brooklyn man named Vitaly Borker was arrested for running a fraudulent online store that sold eyeglasses.It was the third time he'd been arrested for pretty much the same thing.He would send customers faulty or counterfeit glasses, overcharge them, and then if they complained, he would harass or threaten them. Believe it or not, this was part of Borker's business model.As he told The New York Times, a mistreated customer might register an online complaint, which would show up in Google's index with links to his site, which in turn would boost his ranking on Google and bring in even more customers. Google eventually announced it had changed its ranking algorithm to prevent this sort of behavior, but you can bet that plenty of other people are still finding ways to game the system.After a couple of decades with Google as the main gateway to online search, the web is constantly shape-shifting to fit inside Google's algorithms. SPEAKER_06: I do think the quality of the internet has taken a hit. SPEAKER_04: That, again, is Marissa Meyer, one of Google's first software engineers. SPEAKER_06: When I started at Google, there were about 30 million web pages.So crawling them all and indexing them all was relatively straightforward.It sounds like a lot, but it's small.Today, I think there was one point where Google had seen more than a trillion URLs. SPEAKER_04: So is that URL inflation what's responsible for worse search results? SPEAKER_06: When you see the quality of your search results go down, it's natural to blame Google and be like, why are they worse?To me, the more interesting and sophisticated thought is if you say, wait, but Google's just a window onto the web.The real question is, why is the web getting worse? SPEAKER_04: Okay, Marissa, so Google's just a window onto the web.Why is the web getting worse? SPEAKER_06: I think because there's a lot of economic incentive for misinformation, for clicks, for purchases.There's a lot more fraud on the web today than there was 20 years ago.And I think that the web has been able to grow and develop as quickly as it has because of less regulation and because it's so international.But we also take the flip side of that in a relatively unregulated space.There's going to be, you know, economic misincentives that can sometimes degrade quality.And that does put a lot of onus on the brokers who are searching that information to try and overcome that.And it's difficult.It kind of has to be more in my view of an ecosystem style reaction rather than just a simple correction from one actor. SPEAKER_04: One way Google has tried to fight the overall decline in quality is by supplementing its index of a trillion web pages by showing you some selected content rather than just showing you links.If you ask a simple question about cooking or the age of some politician or actor or even what's the best podcast? You may see what Meyer calls an inline result or what Google calls a featured snippet.It's a bit of text that answers your question right there on the search results page with no need to click on a link. SPEAKER_06: I think that Google is more hesitant to send users out into the web.And to me, that points to a natural tension where they're saying, wait, we see that the web sometimes isn't a great experience for our searchers to continue on to.We're keeping them on our page.People might perceive that and say, well, they're keeping them on the page because that helps them make more money, gives them more control.But my sense is that recent uptick in the number of inline results is because they are concerned about some of the low-quality experiences out on the web.I think that the problem is really hard.You might not like the way that Google is solving it at the moment, but given how the web is changing and evolving, I'm not sure that the old approach, if reapplied, would do as well as you'd like it to. SPEAKER_04: Coming up after the break, it took a while, but we did finally get someone from Google to speak with us. SPEAKER_05: Yes, you may ask one question. SPEAKER_04: She's just kidding.We get to ask plenty of questions.I'm Stephen Dubner.This is Freakonomics Radio.We'll be right back. Freakonomics Radio is sponsored by IKEA. Filling your bag can now be more affordable than ever because IKEA has hundreds of new lower prices on some of their most popular items.And don't worry, IKEA cuts costs without compromising quality.IKEA is making it more affordable than ever to furnish your entire home with home solutions you will love.Shop hundreds of new lower prices today at IKEA-USA.com. That's IKEA-USA.com. Freakonomics Radio is sponsored by Progressive, where drivers who save by switching save nearly $750 on average.Plus, auto customers qualify for an average of seven discounts.Get a quote now at Progressive.com to see if you could save.Progressive Casualty Insurance Company and Affiliates.National average 12-month savings of $744 by new customers surveyed who saved with Progressive between June 2022 and May 2023. Potential savings will vary.Discounts not available in all states and situations.Freakonomics Radio is sponsored by Fidelity.With Fidelity Active ETFs, the investing potential is in the name, active. Because instead of just riding the index, Fidelity Active ETFs seek to outperform it with an expert team working behind the scenes. Fueled by industry-leading expertise and robust research capabilities, Fidelity active ETFs shift with the markets, pursue upside potential, and adapt to volatility.And while you can get the potential outperformance of an actively managed fund, you can still buy and sell it on your terms just like any other ETF. Take a more, well, active approach with Fidelity Active ETFs.Learn more at fidelity.com slash active ETFs.Before investing in any exchange traded fund, you should consider its investment objectives, risks, charges and expenses. Contact Fidelity for a prospectus, an offering circular, or if available, a summary prospectus containing this information.Read it carefully.While active ETFs offer the potential to outperform an index, these products may more significantly trail an index as compared with passive ETFs.Fidelity Brokerage Services, LLC. Member NYSE SIPC. It's easy to be nostalgic for the old days of Google search, 10 blue links, simplicity.But the simplest interface might not be able to handle today's internet and the declining quality of a lot of online content.And here's one more problem to solve.What you want from Google and what I want from Google may be different.This is Liz Reid. SPEAKER_05: You come in and you might type a question, but actually what you meant by that question is actually very different than what someone else might mean. SPEAKER_04: Reid is vice president of search at Google. SPEAKER_05: So I joined Google in 2003 in the New York office, actually, and started there as a software engineer out of college. SPEAKER_04: So we all know that the fortunes of Google and Alphabet were built on search, which creates this massive audience for advertising.Since you are running search now, do you fantasize about how Google search could be different slash better if it were not an ad-supported service?Do you stay up thinking, oh man, if only we had gotten around to some kind of a premium paid version, just imagine what I could do with this sucker. SPEAKER_05: In all honesty, one of the things that I love about working on search is that Google's mission around universally accessible is something we take very seriously.And I think that's really one of the powers of the ads model.Like a premium model would say, great, it's available for a small subset of the world, but And I think that's one of the best parts about the Internet is the addition of advertising really, truly democratized access to information.If you think about things like a billion users use us a day, like that's a lot of people. SPEAKER_04: I'm surprised it's not more.What are the other six billion using? SPEAKER_05: It's more than a billion.And then, you know, also some of the six billion are three years old.But over a billion people are using it per day.That ability to provide information to the whole world, to help empower them, to help them go about their daily life or to help them find a better job or build new skills.I think that's an amazing part of Google's mission.And the ad system really fundamentally is what supports that. SPEAKER_04: Look, I am not in a position to complain because, A, I've used Google every day from the minute it was available.So thank you, first of all.Second of all, when it comes to ad supported, like this show survives, it exists because of advertising.So I'm familiar with the model.I think the model is a really good model.And I think it makes all kinds of businesses viable. That said, when you think about the original paper from your founders, there's a famous line, advertising income often provides an incentive to provide poor quality search results.So how do you reconcile that early reckoning of what's optimal with what has become real? SPEAKER_05: Behind the scenes in search, we take great pride in not only trying to provide high quality results, but ensuring that they are not influenced by ads.So we have a very strong culture that says whether or not you're an advertiser does not allow you to change the results we show. You cannot pay us to change how you show.Those results are very pure.And we go to great lengths to ensure that that is the case.And so the quality of the search we provide is run separately from the ads to do that.Relevant ads are actually quite helpful to people, and people often click on them.And if they don't click on them... They disappear.We don't get paid if people don't click on the results. It's not we just get paid for showing them.But fundamentally, what we can do with the search results isn't affected by the ads.We build out our search results separately. SPEAKER_04: So here's my recent-ish experience with Google, having used Google for a million years.But in the last... year and a half or two, I felt more and more that whereas in the old days, a Google search would typically produce results that were really useful to me if I wanted to learn something about the search topic.And these days, it feels to me that a Google search will more typically produce results that are useful if I want to buy something related to the search topic.And then I find myself going down further.And then, yeah, I find what I'm after, but it feels like a different environment.That is one person's experience.And I've read a lot about other people who have related complaints about Google.So for those of us who are whining like me at the moment, is this our perception that's changed or is the reality changed? Are there more ads or ad related or more sponsored related or even Google generated snippets and so on, on the first page of a Google search result than there used to be? SPEAKER_05: So the number of ads we show on a page has been capped for several years, and that hasn't changed.I do think people sometimes come to buy as well as to research a topic, and we have done more to provide sort of non-ads-related information about products.I do think we're trying to continually ask the question, how do we help those who have the intent to buy successfully buy, and those who don't have the intent to buy, not buy, right? SPEAKER_04: Is there a secret word that I can type in that indicates that I'm not looking to buy, I'm looking to learn? SPEAKER_05: It's a great question.So there's not a magic word that we're like, aha, this is the magic word that filters it, but we'll think about this.But we are trying to think about how do we do that.And so sometimes people will use like research X, but I wouldn't promise that that's the secret word.I think that is something that we are actually continually exploring on. SPEAKER_04: Now, what about the other non-ad results I'm seeing?I think you call these snippets, correct? SPEAKER_05: We typically use the word snippet internally to refer to some additional context or reference from the page itself that helps you decide if the result you're about to click on is going to be more relevant so we can save you a lot of time by not having you spend time going to a page you're not really interested in. SPEAKER_04: So for instance, I looked up the other day, I looked up Premier League standings, the English soccer league, and the result I got, it pulls up a table that looks like it might be a summary from some Premier League affiliated site, but it turns out that it's a Google table.And when I click into it, I get a much larger version of that.And again, as I keep clicking around it, I just stay within this little island of Google generated results that are no offense, not great. It's as if I was looking for the New York Times, the Wall Street Journal, and instead I get like a pretty good high school newspaper.Like it's trying, but it's not the same thing.And it looks pretty real because it's got the Premier League lion wearing a crown there.But then when I click the feedback link. Google is asking me, what do you think?This is helpful.This isn't useful. But then the score is wrong or missing.And I think, wait a minute, I don't want to be the one to have to tell you that the score is wrong or missing.I want you to tell me what the proper score is.So again, how is this a better search result for me, for the user, than something that's editorially curated versus algorithmically created? SPEAKER_05: Okay, so this unit is not algorithmically created.The data would be sourced from a high-quality provider.We go through a pretty extensive vetting process to ensure the overall accuracy of any place where sourcing the data is high-quality, highly accurate.One of the things that is really important to us at Google is that we not only show relevant results, but that they're very reliable and very trustworthy. Now, our assumption is not that the data should be wrong, but users get very frustrated if we are wrong and they can't tell us.We all make mistakes, right?And sometimes our providers make mistakes.So if there's a mistake, great, then users can tell us and then they can help us improve our product. SPEAKER_04: So I get that and I appreciate that.I just don't understand why if I'm searching for something that seems prima facie a request to go to the source, essentially, why I would want to get a secondhand version of that.I don't see why it's in Google's interest to do that. SPEAKER_05: So in your statement, you said, my request is to get to the source.That is your intent, okay?With all due respect, it's a very good and well-founded intent. SPEAKER_04: But you're saying I'm a weirdo. SPEAKER_05: No, no, no.I'm just saying not everyone is identical in this world, right?Some folks may want to go and check on this like every day.I just want to go check.What's happening?What changed?What changed?What changed?And they've got five seconds to go look at, right?And so when we think about really trying to help people with their information needs, we need to recognize that both people care about depth, but they also often care about speed.If you go back in time at Google, this was one of the things that Google prided itself on, was that it was fast.But fast isn't just about how fast the server renders the page, right?Fast is about how quickly you can get the information that you seek out. Why would this be useful for Google to do?Because some subset of the people who are coming really just want to find out the answer at a glance.Other people really want to do more in-depth research.It is still the case that we send more and more traffic to the web every year, but we also give people multiple options so that they can get their tasks as easily as they can and really meet their need. SPEAKER_04: So here I am complaining about Google Search, which is absurd because it's such a bounty for me and everybody.But not only that, I also use the other products that have been created because Google Search is so profitable.Google Maps, for instance, which I know that you've worked on.This is a live atlas in my pocket.It's unbelievable.So Do you think the moral of the story is someone like me who's complaining that Google search doesn't seem quite as good as it used to for research purposes, should I just shut up and be grateful for everything you're giving me every day? SPEAKER_05: I think one of the great parts about working on a product like search is that users keep raising their expectations about what's possible.In the early days in Google, if you entered a very simple query and you didn't get the good results, then you thought you did a bad job entering the query. Now you can enter a super long complex query, and if Google doesn't get it immediately, you're like, Google is an idiot.But that's great because that challenges us to do better and better.But the bar of what users are expecting raises.If you asked a query like, when does Starbucks open?We would show you nearby Starbucks and their hours of opening.You have to understand that it's not like Starbucks opens at the same time in every single branch. But if we didn't understand that, you'd be like, what are you doing, Google?Users' expectations rise, and that keeps us on our toes. And that's what honestly drives us.If you didn't complain, if none of you pushed us, we might not make better and better products.So I love the provocation to challenge us to make search better and better every year.We're in it to help you. SPEAKER_04: Do you ever find yourself frustrated by search results in your civilian life and then use that experience to tweak the algorithm or tweak the results? SPEAKER_05: Yes, I find my examples.We don't tweak it to fix my needs, to be very clear.I send complaints probably every two or three days.You might think that we all think it's perfect, and it's not.One of the things I will continually push us to get better on is how do we help people with more complicated tasks, and how do we help people with exploration, right?Google is both immensely useful if you want to do something like buy a house, and it's still really hard, right? Because it's actually not just about buying a house.You actually have to figure out, can you afford a mortgage?Where would you actually live?And then you buy a house and then you're like, oh my gosh, nothing works. And you have to find a contractor.And these things go on, right?And so if you think about that, if I took Google away, you would go nuts.But you still have to do a lot of hard work.And so how do we continually push to go and say, okay, well, if that's what you're trying to do, how do we make that as easy as possible? SPEAKER_04: As we noted earlier, there's no such thing as a free anything, and Google is no exception.It's all about whether you find the trade-off acceptable.I went back to Ryan McDevitt, our Duke economist friend, to ask what he makes of the Google trade-off overall. SPEAKER_03: I am very happy with that trade-off.I think we're getting the good end of that bargain.You know, clicking on a few bad links doesn't cost you a whole lot in the scheme of things, as long as you're then careful when you actually go to make the transaction.So a few junky links, I mean, it's not so bad. SPEAKER_04: What do you think of the Google ecosystem, this unbelievably vast network of products and services, software and ideas, most of it funded by the simple fact that billions of people use their search engine every day, whether they choose to or not?Is that tradeoff acceptable to you?Do you even consider it a tradeoff? Thanks for having me. Meanwhile, coming up next time here on the show. SPEAKER_09: People will sometimes look at me and say, well, you just think wastewater is the answer to everything.And I'm like, but it is the answer to a lot of things. SPEAKER_04: Three surprising stories about water.The first story is microbial.The second is racial.The third, geopolitical. SPEAKER_01: This is not a problem of the Saudis coming and stealing Arizona's water.This is a problem that Arizona has a bad water policy. SPEAKER_04: Water, water everywhere.But you have to stop to think.That's next time on the show.Until then, take care of yourself.And if you can, someone else too. Freakonomics Radio is produced by Stitcher and Renbud Radio.You can find our entire archive on any podcast app or at Freakonomics.com, where we also publish transcripts and show notes.This episode was produced by Alina Kullman and Zach Lipinski.Our staff also includes Eleanor Osborne, Elsa Hernandez, Gabriel Roth, Greg Rippin. Jasmine Klinger, Jeremy Johnston, Julie Canfor, Lyric Bowditch, Morgan Levy, Neil Carruth, Rebecca Lee Douglas, Ryan Kelly, and Sarah Lilly. Our theme song is Mr. Fortune by the Hitchhikers.All the other music was composed by Luis Guerra.As always, thank you for listening.I found out that you give the best Halloween candy in all of Northern California.Is that true? SPEAKER_06: We give movie size.Word got out.And so now it's like thousands of boxes of movie candy every October. SPEAKER_08: The Freakonomics Radio Network.The hidden side of everything. SPEAKER_00: Stitcher. Tired of getting sketchy text?Imagine having a lie detector that scans your text, email, and social media for risky links, alerting you to scams before you click.McAfee Plus is just like that.Stop scammers in their tracks before they get to you and your personal data.Learn about living a more secure and private life online with McAfee Plus.And learn how to protect your everything at McAfee.com slash podcast. SPEAKER_04: Freakonomics Radio is sponsored by Robert Half.Robert Half Research indicates 9 out of 10 hiring managers are having difficulty hiring.If you have open roles, chances are you are feeling this too.That's why you need Robert Half. Their specialized recruiting professionals engage with their proprietary AI to connect businesses of all sizes with highly skilled talent in finance and accounting, technology, marketing and creative, legal and administrative and customer support.At Robert Half, they know talent.Visit roberthalf.com today. Freakonomics Radio is sponsored by Kohler.Kohler smart toilets combine sculptural design with intuitive technology for the ultimate in clean and comfort.You can personalize the integrated warm water cleansing, the heated seat, and warm air dryer. A touchless lid, seat, and flush deliver convenience, while the self-sanitizing bidet wand offers peace of mind. Plus, create your ideal environment using only your voice with NuMe 2.0, Kohler's most advanced smart toilet yet, featuring built-in Amazon Alexa.Explore the complete lineup at kohler.com slash smart toilets.