How much does this cow weigh? (Classic)

Episode Summary

In the classic episode titled "How much does this cow weigh" from Planet Money, the hosts explore a fascinating experiment originally conducted by Francis Galton, a scientist and statistician, over a century ago in England. Galton, who had a strong belief in the superiority of experts over the average person, was intrigued by a contest at a country fair where participants were asked to guess the weight of an ox. He collected all the guesses, calculated the average, and found it to be almost exactly the actual weight of the ox, only one pound off. This outcome was both surprising and eerie to Galton, as it suggested that a collective of random people could arrive at an accurate estimation without any individual expert knowledge. The Planet Money team decided to replicate Galton's experiment by asking people to guess the weight of a cow named Penelope at a county fair in Burlington County, New Jersey. They took the experiment further by posting pictures of Penelope online and inviting guesses from around the world. The hosts were curious whether a large group of random people, including non-experts and self-declared experts, could collectively guess the weight of the cow accurately. After collecting guesses from over 17,000 participants, the average guess was 1,287 pounds, impressively close to Penelope's actual weight of 1,355 pounds. This result was only about 5% off, demonstrating the phenomenon known as the "wisdom of crowds," where collective guesses can converge on a surprisingly accurate estimation. Interestingly, when the guesses of self-declared experts were analyzed separately, their average guess was slightly worse than that of the non-expert group. This outcome further emphasized the idea that a diverse crowd's collective judgment can be more reliable than that of a smaller group of experts. The episode delves into the reasons why this phenomenon occurs, suggesting that each person's guess adds a unique piece of information based on their individual experiences and perspectives. The errors in individual guesses tend to cancel each other out, leaving behind the valuable bits of information that contribute to the accuracy of the collective estimate. The episode concludes by reflecting on the broader implications of the wisdom of crowds, noting its relevance in various domains such as the stock market, where collective decisions set the value of companies despite individual irrationalities. The experiment with Penelope the cow serves as a compelling illustration of how, under the right conditions, the collective intelligence of a group can lead to remarkably accurate outcomes, challenging the conventional emphasis on expert knowledge.

Episode Show Notes

This episode originally ran in 2015.

About one hundred years ago, a scientist and statistician named Francis Galston came upon an opportunity to test how well regular people were at answering a question. He was at a fair where lots of people were guessing the weight of an ox, so he decided to take the average of all their guesses and compare it to the correct answer.

What he found shocked him. The average of their guesses was almost exactly accurate. The crowd was off by just one pound.

This eerie phenomenon—this idea that the crowd is right—drives everything from the stock market to the price of orange juice.

So, we decided to test it for ourselves. We asked Planet Money listeners to guess the weight of a cow.

Spoiler: You can see the results here.

This episode was hosted by David Kestenbaum and Jacob Goldstein. It was produced by Nadia Wilson and edited by Bryant Urstadt. Alex Goldmark is Planet Money's executive producer.

Help support Planet Money and get bonus episodes by subscribing to Planet Money+
in Apple Podcasts or at plus.npr.org/planetmoney.

Learn more about sponsor message choices: podcastchoices.com/adchoices

NPR Privacy Policy

Episode Transcript

SPEAKER_01: Support for NPR and the following message come from our sponsor, Whole Foods Market.Now through April 16th, explore the tropics at Whole Foods Market with savings on fresh flavors and juicy finds.From ripe yellow mangoes to animal welfare certified meats with tropical inspired marinades.Shop in-store or online. SPEAKER_04: This is Planet Money from NPR. SPEAKER_05: Hey, everyone.It's Erika Barris.The show you're going to hear today originally aired in 2015.Here's Jacob Goldstein and David Kestenbaum. SPEAKER_04: Francis Galton was the kind of person who believed in experts.You know, people who had studied things, people who knew stuff.He figured they knew things that ordinary people just did not.I mean, of course they did, right?Obviously. SPEAKER_03: One day, Galton goes to a country fair.This is about 100 years ago in England.And there's this contest going on at the fair.Guess the weight of the ox. Galton's a scientist and a statistician, and he figures, hey, I can do an experiment here, right?He figures, I'm going to take everyone's guesses, take the average, and compare that to the actual weight of the ox.We heard this story from James Czerwicki.He's an economics journalist. SPEAKER_02: So he thought what you were going to end up with was a really flawed guess because in his mind what you were doing was you were taking guesses of a few smart people, a few mediocre people, and then a lot of morons because he basically thought everyone was dumb.So he figured the group's guess was going to be way, way off the mark. SPEAKER_04: The contest organizers gave Galton the little slips of paper with everyone's guesses on him.He took them, calculated the average.The average was 1,197 pounds. And the ox? SPEAKER_02: The ox weighed 1,198 pounds.So that, in other words, the crowd's judgment was essentially perfect.One pound off?One pound off. SPEAKER_03: This is super creepy. Like what's going on here? SPEAKER_04: Is there some kind of like collective unconscious magic?It's like a Ouija board or something, right?But the idea that underlies this, it is everywhere.It's the idea of the stock market, you know, thousands of random people buying and selling shares.Like when you hear that Apple stock went up or the Dow plunged. That's basically people guessing the weight of an ox. SPEAKER_03: Yeah, it's everywhere, right?It's the price of oil.It's the price of orange juice.All kinds of things that are really important to the world work exactly this way. SPEAKER_04: But why should it work?Why should a bunch of random people, a lot of whom have no idea what they're doing, somehow magically produce an answer that makes sense?Does this really work?And if it does, why does it work? Hello and welcome to Planet Money.I'm Jacob Goldstein.And I'm David Kestenbaum.Today on the show, Mr. Galton, we redo your experiment.What's the cow's name? SPEAKER_09: Penelope. SPEAKER_04: Hi, Penelope.Thanks for letting us weigh you.Can I pet her? SPEAKER_09: Yeah. SPEAKER_04: She's chewing.One pound off?Come on. SPEAKER_01: This message comes from NPR sponsor Grammarly.What if everyone at work were an expert communicator? Inbox numbers would drop, customer satisfaction scores would rise, and everyone would be more productive.That's what happens when you give Grammarly to your entire team.Grammarly is a secure AI writing partner that understands your business and can transform it through better communication.Join 70,000 teams who trust Grammarly with their words and their data.Learn more at Grammarly.com.Grammarly.Easier said, done. This message comes from NPR sponsor Slack. Sometimes it feels like there aren't enough hours in the workday, especially if you're trying to grow your business.That's why you and your team need Slack.It's the AI-powered platform where work happens, and it has so many helpful features, like huddles for impromptu meetings and Workflow Builder to automate tasks.Slack is what you need to help everyone have a productive, easy day.Slack.Grow your business here.Learn more at slack.com. SPEAKER_03: So we came up with a plan to repeat Galton's experiment.Find a fair and a cow and a big scale to weigh the cow.In secret, in secret.And then we were going to throw the question out to the crowd.Ask the world, how much does this cow weigh? SPEAKER_04: We didn't want to just limit it to people at the fair.So we figured we'd take some pictures, post them online, and ask the whole world to guess. SPEAKER_03: So we went out to a county fair in Burlington County, New Jersey.We met Penelope the cow in the dairy tent.She was sitting on a bunch of hay. SPEAKER_04: Kirsten Kuzmich was taking care of her. SPEAKER_03: Can you just describe what she looks like? SPEAKER_09: Yeah, she's mostly black.She has white legs, and she has a white spot in the middle of her head, but she's a big black cow. SPEAKER_03: What did you say?I said holy cow without even realizing what I was saying.She's much bigger.She just stood up.She's walking out of the barn now, and she's way bigger than I thought when she was sitting down. SPEAKER_04: We took some pictures of you, Jacob, standing next to the cow for scale.And just for fun, we decided to ask people at the fair how much they thought Penelope weighed.As it happened, it was Kids' Day, so there were a lot of kids around. SPEAKER_08: Hi, Penelope! SPEAKER_04: Which was fine, you know, they're non-experts.What's your name? SPEAKER_08: Caleb. SPEAKER_04: How much do you think Penelope weighs? SPEAKER_08: Uh, six pounds. SPEAKER_04: How'd you come up with that number? SPEAKER_08: Because I'm six years old. SPEAKER_03: You guys want to guess how much this cow weighs?Yeah. SPEAKER_08: Sixty hundred pounds. SPEAKER_03: Like six thousand? SPEAKER_08: Yes. SPEAKER_04: Do you know how much you weigh? SPEAKER_08: Not at all. SPEAKER_04: I'm sympathetic.Looking at Penelope, I had no idea how much she weighed.Like, I didn't even know how to think about it.Did she weigh more than my car?Did she weigh less than my car?I don't even know how much my car weighs.More than a cow. SPEAKER_03: I'm going to say more than a cow.We found an older group of kids.And, yeah, they also guessed on the low side.But they had this bigger problem, this really more worrying thing.And it was a problem that adults also seem to have.And it was this.The first kid said a number.And then all the other kids said, Basically the same number.Numbers that were like too close to the first key. SPEAKER_04: It's like they're incapable of guessing anything different. SPEAKER_12: My name's Issa. SPEAKER_04: And Issa, how old are you? SPEAKER_12: I'm 10. SPEAKER_04: How much do you think that cow weighs? SPEAKER_12: 200 pounds.My name's Gabriela.I'm 10.And I think the cow weighs 300 pounds. SPEAKER_08: My name is Caleb.I'm nine, seven years old, and I think the cow weighs 300 pounds. SPEAKER_04: Oh, Caleb.People are not that different from cows.We heard.If we don't know something, we look for a leader, even if the leader maybe doesn't know anything. SPEAKER_03: Penelope finished chewing, and we took her over to be weighed.It's actually pretty unusual to want to weigh a cow, and the scale they had at the fair was not for cows. SPEAKER_10: What kind of scale is this? It's actually like a truck scale is what it's for.Same size scale they'll use for big trucks and stuff, which we use it to weigh the tractors during the tractor pull.It'll work for a cow?Yep. SPEAKER_03: Test and Bem, you were obsessed.Paranoid.Arguably paranoid about keeping the results of this secret.You didn't want it to leak out, I guess.Again, all these people had gathered. SPEAKER_04: Actually, can we seriously clear everybody out except for just a minimum of people?Can we swear you the secrecy?I'll swear.Everybody else over there. Kirsten walked Penelope up onto the scale, and we watched this little digital display. SPEAKER_03: Okay, it's 1,355 pounds. SPEAKER_04: 1,355 pounds.We walked Penelope back to the dairy tent, and then we went home.The next day, we posted photos online. SPEAKER_03: Of the cow and you.And me, right.I was there to give some sense of perspective.We put you on the tractor scale.Yes, 165 pounds.That's how much I weigh. SPEAKER_04: Then our colleague Kwok Trung Bui here put it all up online.Guess the weight of this cow. SPEAKER_03: And the idea was our hope was that lots and lots of people would guess because the fundamental question here, the thing we're trying to figure out is if you have a bunch of random people making their best guess at something, do you get close to, you know, the truth?Do you get close to the right answer?So we put it up and we waited for the results to come in. SPEAKER_04: All right.It's been up for how long now? Two minutes.How many entries?15 entries.Reload, reload.Okay, here we go.Still 15?Still 15.Come on! Oh my god.That's all we're going to get, 15.I'm going to retweet this.It's already been buried after two minutes. SPEAKER_03: We also showed the pictures of me and the cow to James Czerwicki.He's the New Yorker writer we talked to at the beginning of the show.He actually wrote a book called The Wisdom of Crowds.So we asked him to guess. SPEAKER_04: Remember here, the actual weight of the cow?1,355 pounds.All right.I will guess that the cow weighs 725 pounds. How did you come up with that number? SPEAKER_02: I don't know.Maybe looks like four or five times Jacob's size, I guess.Although I'm sure cows are, I don't know, are they denser or not than humans?So, you know, whatever. SPEAKER_04: It's pretty random, actually.Pretty random and pretty wrong.We told them Penelope's actual weight, twice as heavy as his guess. It's so bad. SPEAKER_02: It's a sad commentary that someone who's been talking about an ox for this long has absolutely no clue how much a cow weighs.If we get a crowd of people like you... It's going to be terrible.We're going to be in bad shape.I'm praying somebody was guessing 2,200 on the other end. SPEAKER_03: Because the key question is, what's the average going to be, right?Is the crowd going to get it right?Or at least how close are they going to get?So we left this up online for five days, let people guess for five days.Our colleague Bui tallied it all up.David, you and I came into the studio.We didn't know the results.And Bui came in to give us the numbers.First of all, how many people guessed? SPEAKER_04: So the number of people that guessed, 17,205 people.17,000?That's legit.That's good.That's good.It's as if you got like a small town to all guess.But we took those guesses, added them up, and calculated the average.This was the big moment.You guys ready? 1,287 pounds. 1,287?Penelope actually weighed 1,355? SPEAKER_03: Pretty close, right?So that's to within, like, what, 60-ish pounds?That was pretty impressive.Yeah, I mean, they're only, like, 5% off, you know?And, okay, sure, the Galton thing was one pound off.This isn't that.But remember, this is just a bunch of random people, you know, looking at this little cow picture in their Facebook feed on their iPhone. SPEAKER_04: And here's another amazing thing.When we asked people to guess, we also asked them this other question.We asked, are you an expert?Have you ever worked with cows?Because remember, Galton thought experts might be better.And 3,000-some people answered yes to that question.Jacob, you wondered were they really, really experts. SPEAKER_03: Sure, these are just people clicking a button online.So we emailed a bunch of them, and we heard back, and they did seem pretty expert.You know, a lot of them were farmers.One of them mentioned the, quote, absence of a visible udder. SPEAKER_04: Actually, a few of them mentioned that. SPEAKER_03: And apparently that tells you something about how old the cow is, how much it weighs.So how did the experts do? SPEAKER_04: Here's the answer.So the average guess for the experts was 1,272 pounds. SPEAKER_03: They're worse.They were worse.It's amazing.So, okay, so maybe that is wisdom of the crowds. SPEAKER_04: To be fair, the experts were only marginally worse, but they did not beat the crowd. SPEAKER_03: We told Sir Wiki about these results, and he wasn't surprised.In fact, he writes in his book, chasing the expert is a mistake.We should ask the crowd. SPEAKER_04: And the fact that the larger crowd got it to within 5%, he said that seems about right to him.When people do versions of this experiment, asking people to guess the number of jelly beans in a jar, for instance, the crowd usually gets it to within 3% to 5%. SPEAKER_02: You know, one of the things that's interesting about this is even though I've written a book and done this experiment a number of times, every time I do it and every time I hear the results, I'm like, it's not going to work this time. Because the idea is so counterintuitive.It's pretty extraordinary in that regard.The power of this to actually let the group arrive at really good decisions is – it's eerie.There's something eerie about it, I think.It is eerie, right?Yeah, it is.There's something magical about it that seems magical, I think.It's not magic.It's just math. But it seems magical. SPEAKER_04: Sir Wiki says the reason this seems to work – is that every person's guess is contributing some new little piece of information.Everybody is different.Everybody thinks slightly differently when they're trying to guess the cow's weight.Maybe one person studies that photo of the cow from the side.Some people are probably trying to figure out how many Jacobs would fit in the cow.Someone else might know how much a horse weighs and kind of go from there.Like every person's guess in some ways reflects their specific life experience of judging the size of things in the world, just from decades of living. It's like every person's mind is a different scale for weighing the cow. SPEAKER_03: Any one of those scales isn't going to be a great scale, right?Each one of those is probably going to be wrong.There's going to be some error in every single one. SPEAKER_04: They're good in some way, but they also have some problem with them. SPEAKER_03: Yeah.And one of the essential things is those problems tend to cancel each other out, right?Maybe one person is wrong 200 pounds high, but the next guy is wrong 200 pounds low.So the wrong parts, the wrongness kind of washes out.And in the end, what you're left with is all those little bits of information. And the result is amazingly good. SPEAKER_04: You know, collectively, we do seem to know what we're doing.Surwicky says there are certainly times when this does not work.Like, think stock market panics or bubbles. SPEAKER_03: Yeah, a big problem is that thing we saw with the kids at the beginning, where one person says a number and then everybody else around them just kind of latches onto that number.There's actually a technical term for this.It's information cascade. SPEAKER_04: It's like my neighbor just bought a house.That seems like a lot of money to pay for a house, but he did fine.I'm going to do the same thing.Or everyone's buying that stock.It must be a good stock.I'm going to buy it. SPEAKER_02: The stock market is not perfect.But what is amazing about the stock market is that investors individually, even very good investors – are oftentimes irrational.They have tiny bits of information.They're making decisions based on emotion or on some tip they got.And yet collectively, we trust them to set the value of all of these companies.It's kind of scary when you think about it.But the interesting thing is I don't think there's a better way to do it.And there is not a more effective way of doing it either. SPEAKER_04: This is why it is so hard to beat the stock market. The wisdom of the crowd is pretty good.And the people who seem to beat it, who say, I can beat the stock market, often they are just plain lucky. SPEAKER_03: In our experiment, for example, there were 15 people who got the cow's weight exactly right.They were off by zero pounds. SPEAKER_04: We picked one of them at random as our winner.We called them up to tell them the news and to see how he did it. Hello?Is this Harris?Yeah.How's it going?Harris Pollack is 20 years old.He's a student at Hamilton College.Never touched a cow in his life.In fact, could not even remember his guess. We told him he'd guessed 1,355 pounds and that the weight of the cow was also 1,355 pounds.Oh, my God.You won.That's amazing.Do you want to know how I got to that guess? SPEAKER_15: Yes.I googled it.I googled average weight of female cow and it said, here, I'll get it.So it pops up in a little box and it comes from dairy moose. Dairymoos.com. SPEAKER_03: Dairymoos.com says the average weight of a cow is 1,500 pounds, depending on the age and whatever.Harris looked at the picture of Penelope the cow and said, she looks a little bit on the small side.He went with 1,355.It was just a guess. SPEAKER_15: Yeah, completely guessed. SPEAKER_03: So we're going to send you the cheapest plastic cow trophy we can find. SPEAKER_04: We talked with Harris about what we should put on the trophy because it's a bit of a puzzle, right?Like, should it say, I got lucky?He was actually fine with that.He said that made sense.I was pushing for mutual fund manager of the year.Robert here suggested someone had to win.In the end, I think we are just going to say, congratulations.Congratulations.Congratulations. SPEAKER_11: Support for this NPR podcast and the following message come from Easy Cater.Committed to helping companies from nonprofits to the Fortune 500 solve food for work.From ordering online for meetings and team lunches to managing food spend for your whole organization, Easy Cater can help you simplify your corporate catering needs.Over 100,000 restaurants nationwide, plus budgeting tools and payment by invoice.Learn more at easycater.com. This message comes from NPR sponsor, RSM.Change waits for no one, but when it happens, and it always does, be prepared to take charge with RSM's proven advisors who make it their business to fully understand yours.RSM brings human insights powered by technology, so you can leverage the knowledge of future-focused minds who look beyond the ordinary.RSM, Experience the power of being understood. Take charge now at rsmus.com slash Spotify. SPEAKER_06: Throw on those boots, grab your cowboy hat, and saddle up that horse.Beyonce's new album, Cowboy Carter, is here.Beyonce says this is the best music she's ever made, but is she knocking down the doors of a country establishment or looking for validation?We're talking all about it.Listen to the Pop Culture Happy Hour podcast from NPR. SPEAKER_04: All right, we got some footnotes.You know how at the end of research papers, they put all the technical details there?A couple things we want to tell you.When we calculated the average of the guesses, we did throw out outliers, like the person who just held down the nine key as their guess.Nine, nine, nine, nine, nine.Nine, nine, nine, nine, nine, nine, nine.Thanks for that.Also, for people who love the median, we calculated the median, too. SPEAKER_03: I am a median lover.The median is the value in the middle where half the guesses are higher, half the guesses are lower. The median was pretty close to the average.The median was 1,245 pounds, within 8% of Penelope's actual weight.The median expert guess was a little worse, but pretty close.You can find all the numbers online at npr.org slash money.Also, there are some pictures of Penelope the cow, among other things, on our Instagram feed at Planet Money. SPEAKER_04: You can also email us, planetmoneyatnpr.org.Thank you also to everybody for guessing.Thank you to Penelope the cow and to Rosemary Kay and the other folks at the Burlington County Farm Fair. SPEAKER_05: This episode was originally produced by Nadia Wilson, and today's rerun was produced by Liza Yeager and Rachel Cohn, with additional audio support by Valentina Rodriguez-Sanchez.Brian Erstadt edited this episode.Alice Goldmark is our executive producer.I'm Erica Barris.This is NPR.Thanks for listening. SPEAKER_04: How heavy is the cow? SPEAKER_07: Absolutely no idea.Absolutely no idea.I really wouldn't. SPEAKER_04: Like, does 10,000 pounds sound too heavy, or who knows? SPEAKER_07: I really have no idea.20,000 pounds?20,000, I think, is going over the limit.Yeah, no.So less than 20,000.Less than 20,000.More than 5 pounds.More than 5 pounds. SPEAKER_04: More than a bird.On NPR's ThruLine, SPEAKER_14: It's difficult to imagine an America without tipping in restaurants or wherever else. SPEAKER_13: When tipping first came, it was the most un-American thing to tip.And now it's the most un-American thing to take it away. SPEAKER_14: The long, complicated legacy of tipping in America. SPEAKER_11: Find NPR's Throughline wherever you get your podcasts. SPEAKER_16: If you need a good laugh, tune into the next All Songs Considered from NPR Music as we play a mix of the funniest songs of all time with a little help from Weird Al Yankovic.I had no idea laughter and joy was good for you.That's a revelation.Listen to All Songs Considered every Tuesday wherever you get podcasts. SPEAKER_00: The world of podcasts can feel overwhelming.We'll let you in on the easiest way to find your next favorite show.Head to npr.org slash podcast.From politics to pop culture to music and everything in between, you'll find a selection of shows that'll make you a super fan in no time.