Why Are There So Many Bad Bosses? (Ep. 495 Replay)

Episode Summary

Introduction - The podcast explores why there are so many bad bosses. Promoting good employees to management roles often leads to bad bosses. - Management science is not very scientific yet. There is limited empirical evidence on what makes a good or bad boss. Research on Bosses - Studies show managers affect employee retention and productivity, but it's unclear what behaviors lead to this. - Surveys of employees about their managers may not be reliable. People may bias responses based on their relationship. - Technology firms are creating separate tracks for technical specialists, so they don't have to go into management. But this is still rare. The Peter Principle - The Peter Principle states that employees rise to their "level of incompetence" as they are promoted based on competence in their current role. - A study found the best salespeople made the worst managers, supporting the Peter Principle. Their teams' sales declined. - Firms know this happens but accept it. Promotion motivates employees more than higher pay. - Potential solutions are higher pay, dual-track careers, and alternate promotions like "distinguished engineer." Case Study - Katie Johnson was a successful data scientist but disliked being a manager. She stepped down to return to an individual contributor role. - Personality tests during management training showed she lacked "people skills." But she was still promoted. - With no technical promotion track, management was the only way to advance. But she is now happier and paid more as an IC. Conclusions - The process for selecting managers is often flawed. Good performance in one role does not guarantee success in management. - Traditional career ladders equate promotion with success. But not everyone wants to manage, nor is suited for it. - Rethinking incentives and advancement for technical specialists could improve management quality.

Episode Show Notes

People who are good at their jobs routinely get promoted into bigger jobs they’re bad at. We explain why firms keep producing incompetent managers — and why that’s unlikely to change.

Episode Transcript

SPEAKER_09: Freakonomics Radio is sponsored by Twizzlers. No matter the situation, Twizzlers is the perfect candy to relieve your boredom. And in a world where other candy is just too sweet and overpowering, Twizzlers is the perfect level of sweet and comes in the perfect chewy twist. Twizzlers are an enjoyable relief from the monotony of everyday life, and they taste great too. Head to the store and enjoy Twizzlers today. SPEAKER_08: Carl's Jr.'s new Big Char Chili Burger is big on charbroil flavor. Big on spice, with melted pepper jack cheese and spicy Santa Fe sauce. Big on smoky sweet heat, with a whole fire roasted charred Anaheim chili. And big on savings, with the Big Char Chili combo. Get the big, bold, smoky flavor of the new Carl's Jr. Big Char Chili Burger with small fries and drink, for just $7.99. Tax not included, for a limited time. SPEAKER_09: Price and participation may vary. Hey there, it's Stephen Dovner. Do you ever wonder how your boss became a boss in the first place? Yeah, we do too. Especially when things go sideways. In retrospect, it's easy to say that Sam Bankman-Fried was not the best person to be running FTX, the bankrupt cryptocurrency exchange. But retrospect is always easy. What about right now? Do you have a bad boss? Have you ever had one? Chances are, yes. So I hope you enjoy today's episode, which we first published last year. It's called Why Are There So Many Bad Bosses? SPEAKER_03: My name's Katie Johnson and I'm a data scientist. SPEAKER_09: Johnson is 32 years old and lives in London. She grew up near Bristol, went to university in Birmingham, and since then has held a series of increasingly impressive jobs at a series of companies. These were all what are known as IC jobs. IC standing for Individual Contributor, which means what? SPEAKER_03: It is someone who makes as opposed to managing people who make. Johnson loved being an IC. SPEAKER_09: She loved analyzing data and she was really good at her job. But after a while, she thought it might be nice to become a boss. SPEAKER_03: Yeah, I wanted to manage more and more people. SPEAKER_09: And you wanted to manage more people because why? You were just power hungry like the rest of us? SPEAKER_03: I think there's a couple of reasons. So the first is that I wanted to start getting more autonomy over what I was working on. I would be working on stuff in my IC role and I think this isn't the most important thing. I thought that if I became the leader of the team, then I would get to pick what I worked on. SPEAKER_09: Okay, that seems sensible. SPEAKER_03: The other reason was to have more impact at the companies I was working at. So you could describe this as having a seat at the table. SPEAKER_09: Also sensible. SPEAKER_03: I guess the final reason is that we all kind of, not everyone I guess, but I was included in this, have a concept that being more successful means being more senior. And so in order to not necessarily show others, but definitely myself that I had achieved and become successful, I needed to keep moving upwards within a company. SPEAKER_09: Johnson's father in his own career had seen things differently. SPEAKER_03: So my dad has been a network engineer. He recently retired, but he's been that for his whole career. And he had absolutely no aspiration to become the manager. He's like, why would I want to do that? SPEAKER_09: But Katie Johnson did want to become a manager and several firms were willing to make her own. She took the most appealing offer at a software firm that helps companies acquire new customers. SPEAKER_03: And I was sent on some management training and had to do what can only be described as a very long personality test. And the idea was to tell me what I was good at being good at. SPEAKER_09: And what was she particularly good at? SPEAKER_03: Critical thinking, attention to detail, courage, all these internal thinky type characteristics. SPEAKER_09: You can see why Katie Johnson would seem to be a great boss. Her new job title was head of data and analytics. She had roughly 10 people reporting to her. The promotion came with more money, more prestige, more leverage to set the agenda. Also, however, more meetings. SPEAKER_03: Oh, so many meetings. Like compared to being a data scientist, I'd maybe have a half hour meeting in the morning and then I'd just be free to do coding and thinking and making stuff. But I was in meetings. I think Tuesdays I used to be in meetings for like seven hours. SPEAKER_09: No offense, but did you not see that coming? SPEAKER_03: No, I really didn't. I thought it would just be like my normal data scientist job with a few one to ones on the side. That was okay because it's quite interesting. You're talking about the work, you get into quite depth and problems with my team. It's more like the meetings, like an hour's coffee with someone to try and set up a better working relationship with their team times that by like five or 10 other teams. It's just draining. SPEAKER_09: Keep in mind this was happening during the pandemic shutdown, so all these meetings were virtual and as drained as Johnson was from all those meetings, she was getting good reviews as a manager. SPEAKER_03: Yes. People would tell me what a great job I was doing. I was coming across well. SPEAKER_09: But she found that being a boss made her miserable. SPEAKER_03: I would finish my day and my study, walk into the living room, put a blanket over my head and cry because I was in so much pain at how bored I was. SPEAKER_09: In retrospect, Katie Johnson had plainly erred in wanting to become a boss, but she'd also felt that management was the only sensible way to advance her career. And if you look at how most firms and institutions around the world operate, you'd have to agree with her. The question is, does this standard operating procedure produce good bosses or bad bosses or even horrible ones? The horrible boss is a familiar caricature. We all know the stereotypes, the screamer, the sadist, the idea stealer, the passive aggressivist. These are some of our most enduring characters in film. Peter Blake from Glengarry Glen Ross, played by Alec Baldwin. Put that coffee down. SPEAKER_07: Coffee's for closers only. SPEAKER_06: You call yourself a salesman, you son of a b****? SPEAKER_09: Or in the film Office Space when Peter is trying to escape the office on Friday afternoon and he gets snagged by the boss. Hello, Peter. SPEAKER_11: What's happening? I'm going to need you to go ahead and come in tomorrow. So if you could be here around nine, that would be great. Okay. Oh, oh, and I almost forgot. I'm also going to need you to go ahead and come in on Sunday too. SPEAKER_09: Then there's Miranda Priestly, played by Meryl Streep in The Devil Wears Prada. SPEAKER_12: You have no style or sense of fashion. SPEAKER_04: Well, um, I think that depends on what you're... SPEAKER_12: No, no. That wasn't a question. SPEAKER_09: The horrible boss motif is so attractive that the director Seth Gordon made a film called Horrible Bosses. Yeah, we've got to trim some of the fat around here. SPEAKER_10: Trim? What do you mean by trim the fat? I want you to fire the fat people. SPEAKER_09: Truly horrible bosses do occasionally turn up in real life, especially in Hollywood itself. The producer Scott Rudin, for instance, has been accused of years worth of alleged abuses like smashing an assistant's hand with a computer monitor. But even in Hollywood these days, and especially in more normal industries, this sort of grotesquerie is harder to get away with. Bosses who are outright monsters are more likely to lose their jobs. But how much attention are we paying to the more common type of bad boss? Someone who's simply incompetent or overstretched or even just miserable being a boss like Katie Johnson was? Do we even know how many bad bosses are out there? The more you dig, the more you learn that the science of boss behavior is not very scientific. One Gallup poll shows that roughly 50% of American employees have at some point in their career left a job because of a bad boss. An employee might have 10 or 20 bosses over a career, so maybe that number isn't so bad. A survey of European employees found that only 13% rated their current boss as bad. So maybe the Hollywood caricature is way off. Still, considering that nearly all of us will at some point in our lives have a boss or be one, we thought there might be some boss questions worth asking. And so today on Freakonomics Radio, when a boss is a bad boss, have you ever wondered why? There's no reason to believe that a great salesperson will be a great manager. SPEAKER_09: And yet this kind of promotion happens all the time. Why is that? SPEAKER_04: So there are two ways to motivate people. We can pay them a whole lot more, or we can give them an opportunity for promotion. Today on the show, why good employees become bad bosses and whether that will ever change. SPEAKER_09: Spoiler alert, probably not. SPEAKER_02: This is Freakonomics Radio, the podcast that explores the hidden side of everything with your host, Stephen Dubner. SPEAKER_09: One of the reasons I became a writer years ago is because I didn't particularly like having a boss. Like Katie Johnson, I prefer to set my own agenda, my own pace. I also really like working alone. Also like Katie Johnson, I am not particularly fond of meetings, so I wouldn't be a very good boss either. Fortunately, at Freakonomics Radio, there are a couple of other people who do all the bossy stuff, leaving me pretty much free to do this, what we're doing right now, asking questions, trying to find answers. So here's a question I've always been curious about. How important are bosses anyway? I don't mean CEOs, the ultimate boss. If you're interested in that, we once did a series called The Secret Life of CEOs. Today we are just talking about your standard issue middle manager. Do they really matter? SPEAKER_10: Yes, broadly speaking, managers matter. Bosses matter for outcomes. SPEAKER_09: That is Steve Tedelis. He's an economics professor at UC Berkeley's Haas School of Business, a training ground for future bosses. Management is not something that Tedelis himself aspires to. SPEAKER_10: Tell me how close you are to administration so I know how far away to be from you. SPEAKER_09: But he has spent time while on sabbatical, working as a boss at some well-known firms. SPEAKER_10: When I was at eBay and Amazon, I managed teams and I enjoyed it very much. SPEAKER_09: How do you assess yourself as a manager in that realm? I'm blushing, so. Because you're the best ever? But I'm pretty good, so I'm feeling a little uncomfortable. SPEAKER_09: Your positive self-assessment is based on direct feedback or just a general warm glow feeling? At eBay and Amazon, the feedback was actually formal through surveys. SPEAKER_09: Surveys, that is, with questions like, on a scale of one to five, how much do you agree with the following statement? My boss generates a positive attitude in the team. Or my boss is someone I can trust. Or my boss provides continuous coaching and guidance on how I can improve my performance. These surveys led Steve Tedelis to ask his own bigger questions about bosses. For instance, does it really matter? SPEAKER_10: Do these measures of manager skills or characteristics, do they really have any value for the firm? Is there some way in which managers who score higher on these surveys are actually contributing more? SPEAKER_09: These are eternal questions in the field known as personnel economics. You could ask the same questions about any manager. The head coach of a football team, the chairperson of your homeowners association, the president of the United States. But as I mentioned earlier, the academic literature on the impact of bosses is not particularly advanced. You can see why, if you think about it. There are so many variables in the relationship between a boss and their employees that it can be hard to pinpoint the effects of the boss. This is why most research focuses on one single quantifiable metric, productivity. SPEAKER_10: For example, there is a paper by the late, wonderful economist Eddie Lazear, Catherine Shaw and Chris Stanton, where they show that there is variation in output of employees based on the managers that are in charge of them. SPEAKER_09: That paper from 2015 analyzed data from a single firm that the researchers were not allowed to identify, but it appears to be something like a call center. The analysis looked at what happened when a worker moved from what the researchers identified as an average boss to a high quality boss. Such a move, they found increased productivity by as much as 50%. So if this were a call center and a given worker handled 100 calls per shift under an average boss, an excellent boss could boost that to 150 calls. So at least in this type of setting, a quote good boss is doing something right, but the data couldn't say what. Steve Tedelos wanted to learn more, so he teamed up with Mitchell Hoffman, an economist at the University of Toronto's Rotman School of Management, to write a research paper. SPEAKER_10: I had access to interesting data and people in this company that will have to be unnamed because when it comes to personnel data, companies are very hesitant. SPEAKER_09: Tedelos would only say that this firm did high-tech knowledge-based work. Maybe, given his history, you might picture a firm like an eBay or an Amazon. In any case, he is looking at a very different type of work than the earlier research with its narrow measure of productivity. What we're doing is opening the hood up a little bit. And what sort of data did they have access to? SPEAKER_10: We have data that allows us to measure the impact of a particular manager skill that we're calling people management skills, as opposed to just do managers matter. SPEAKER_09: People management skills, meaning the sort of things you find on those employee feedback surveys. How well the manager coaches and communicates, how trustworthy they are. So that's the boss data. On the employee side, Tedelos and Hoffman had a lot of concrete data. Subjective performance scores, as well as how often a given employee was promoted or given a raise, the number of patents they filed, and whether they stayed at the firm or left. SPEAKER_10: In these high-tech knowledge-based companies, retention is a very, very important focus because getting these high-skilled workers is not easy, and there's a lot of competition. And when you lose an employee, especially an employee that's very valuable, then it could take months to replace them. SPEAKER_09: So Tedelos and Hoffman set about to sort through all this data to look for any causal relationships between the rating of a given manager and the various outcomes of the employees working under them. What did they find? For the most part, it was a big bag of nothing. SPEAKER_10: We didn't find that the ratings of the managers seemed to impact the subjective performance of their employees, their income, their promotions, or patent applications in a meaningful way. That's right. SPEAKER_09: On all those employee outcomes, performance, earnings, patents, it just didn't seem to matter whether the manager was highly rated or poorly rated. But there was one other outcome to look at. Employee retention. Bingo. Tedelos and Hoffman looked at employees at this one firm who moved from a manager with a poor rating to one with a high rating. SPEAKER_10: That's associated with an attrition drop of about 60%. SPEAKER_09: That is huge. And within that huge effect was an important nuance. What we see then is that managers help retain better employees, more than worse employees, SPEAKER_10: which shows that the impact of being a better manager is strongest where it matters the most. SPEAKER_09: So a good boss seems capable of keeping the best employees happy and presumably productive. Conversely, a bad boss might drive away the best employees. The Tedelos-Hoffman paper was published in 2021 in the Journal of Political Economy, one of the best econ journals. So OK, the economics literature on bosses and management just got a little bit deeper. But remember, employee retention was the only outcome where it seemed to matter whether a boss was good or bad. And if you ask Steve Tedelos a more fundamental question like, what does a good boss actually do to instill this loyalty? SPEAKER_10: This is where I have to take a step back and say that there are certain things that may be outside the scope of what economists should be dealing with. SPEAKER_09: If you were to make a list of things that you would like to measure, were it possible given the data, what would some of those things be? SPEAKER_10: Really good question. Something that's very hard to measure that I believe is important is compassion. I guess if this is going to be on the radio, I might lose my economist card. SPEAKER_09: Steve Tedelos is not the only economist who's been frustrated by the lack of evidence for what makes a good boss good. Obviously, compassion is as important as he suspects, but we just don't have any large scale empirical evidence yet. The Stanford economist Nicholas Bloom has been studying leadership and management for years. And yet no one could really give us a straight answer on what defined a good or a bad leader. SPEAKER_01: You look at the data and there's 10 different recipes for success. Maybe they each work for a particular case study. I've still 20 years later struggled to find anything that's the secret recipe beyond saying, sure, there are some people that are better than others, but it's damn hard to tell what it is. SPEAKER_09: This has not stopped leadership gurus from promoting their pet theories. As Bloom puts it, there is a ton of BS around this from airport bookstore Pulp Fiction. And here's another reason to question the literature on management and bosses. As we've been hearing, most of the boss data comes from employee surveys. Have you ever taken a survey that rates your manager? If so, were you told it was anonymous? Did you believe it was anonymous? Were your answers objective? Or did you maybe think, well, my boss thinks I'm good at my job, so I'm going to say they're good at theirs or vice versa. I don't think my boss likes me, so I'm sure not going to give them a good rating. As we have said before on this show, survey data can be the lowest form of data. Here again is Steve Tedelos. I'm sure you know that economists are very wary about using surveys. SPEAKER_10: And economists believe in what we call a revealed preference approach, meaning how you behave is telling me a lot more about you than what you say about yourself. SPEAKER_09: Just how big is the gap between what people say and how they behave? Over the years, I have heard many economists give many examples of this gap. Steve Tedelos' example is my all-time favorite. SPEAKER_10: There is a lot of discussion about privacy and privacy regulation these days. And you hear a lot of people saying how their privacy is important to them. And then you turn to them and say, here's a Snickers bar. Could I have your mother's maiden name? And they say yes. So it's a little bit confusing when you tell me that you really care about privacy and then you just scroll down on every app you download and click yes, yes, yes. That doesn't tell me that you really care about privacy. So the same is true for many other types of behavior. SPEAKER_09: So let's keep in mind that much of what we have been told in the past about good bosses and bad bosses is not exactly evidence-based. Users like Tedelos and Hoffman and Bloom have been chipping away at the black box of boss behavior, but we've got a long way to go. This means we need to keep looking for good data and asking good questions. So coming up after the break, who becomes a boss and why? If so many people think the boss selection process is stupid, why do firms keep doing it? And whatever happened to Katie Johnson? SPEAKER_03: I get to the end of the day and the last thing I want to do is talk to someone else. SPEAKER_09: I'm Stephen Dubner. This is Freakonomics Radio. And remember, you can get our series, The Secret Life of CEOs, and all our past episodes on any podcast app. We'll be right back. Freakonomics Radio is sponsored by Mercury. 90% of startups fail. 90%, just 10 out of every 100 last. In order to succeed, startups need grit, talent, and the ability to perform at the highest level. That's where Mercury comes in. Mercury is banking engineered for the startup journey, a modern solution to help your company become the best version of itself, to eliminate the hurdles that come with traditional banking, to offer a product crafted to help you scale with safety and stability, to go beyond banking and provide access to the foremost investors, operators, and tools. Because when you can operate with confidence, building your company becomes an art form. Join over 100,000 companies banking with Mercury at mercury.com. Mercury is a financial technology company, not a bank. Banking services provided by Choice Financial Group and Evolve Bank and Trust, members FDIC. Strong bonds lead to lasting relationships. At Vanguard, their active fixed income team knows that strong relationships can build strong bond funds. Vanguard's active bond funds are backed by a collaborative culture and expert team. Vanguard is designed to keep fees low, creating an easier path for their active managers to seize the right opportunities to outperform at the right time. Vanguard knows active bond funds that help stabilize portfolios and generate income, can give clients peace of mind so they may focus on more important things like lasting relationships. At Vanguard, clients are more than just investors, they are owners. Vanguard strives to do what's best for its clients and their financial success. That's the value of ownership. Learn more at vanguard.com slash vanguard active. Visit vanguard.com to obtain a fund prospectus or summary prospectus containing investment objectives, risks, charges, expenses, and other information. Read and consider carefully before investing. All investing is subject to risk. Investments in bonds are subject to interest rate, credit, and inflation risk. And shareholders own the funds that own Vanguard, Vanguard Marketing Corporation distributor. Have you ever thought about where a boss comes from? What I mean is why a given employee will rise from the ranks to become a manager? Here's someone who's been thinking about that a lot. SPEAKER_04: My name is Kelly Xu. I am a professor of finance at the Yale School of Management. SPEAKER_09: Kelly Xu, along with Alan Benson and Danielle Lee, published a paper in the Quarterly Journal of Economics, another top journal, called Promotions and the Peter Principle. SPEAKER_04: So the Peter Principle is a very funny and popular management book written by Lawrence J. Peter. And his book offers an explanation for why we might see incompetent bosses everywhere. SPEAKER_09: Okay, I'm listening. What is this explanation? Let's go back to Lawrence J. Peter himself. This is from a 1973 documentary. The Peter Principle states very simply that in any hierarchy, an employee tends to rise SPEAKER_12: to his level of incompetence. I'm sorry, as many times as I've heard that phrase, I still laugh at it just because it SPEAKER_09: sounds like it's going to be not irreverent and then it turns immediately irreverent, which makes me chuckle. Oh, exactly. I think it's a funny idea, but it also rings true. SPEAKER_04: And it's funny in a kind of unpleasant way because it reminds people how much they dislike their bosses. Peter was a Canadian education scholar. SPEAKER_09: He used his daily observations to form a theory about job promotions. I saw that very often a competent individual was promoted by a person who was a very competent SPEAKER_12: person to something he couldn't do. I saw a competent mechanic where he used to take my car. He was terrific. He was very responsible, very precise, knew exactly what he was doing. So they made him foreman. Now he's no longer fixing cars and he's trying to manage other mechanics and he's very incompetent. SPEAKER_09: The more Peter looked around, the more he saw people who were good at their jobs, routinely stumbling into bigger jobs they weren't good at. In any organization where competence is essentially eligibility for promotion and incompetence SPEAKER_12: is a bar to promotion, people will rise to the level of incompetence and tend to stay there. SPEAKER_09: The book he wrote with Raymond Hull was called The Peter Principle. Why things always go wrong. It wound up selling millions of copies. The book was meant to satirize corporate strategy. Nevertheless, a variety of big firms tried to recruit Peter to become their management guru. He declined, saying that he didn't wish to rise to his own level of incompetence. Kelly Shue again. SPEAKER_04: His idea is that firms and organizations tend to promote people based upon their performance so far. What that means is a worker who is good at her job will be quickly promoted to a new job role, which might require different set of skills. If she's good at that new role, she's going to be promoted again until she reaches a position where she's actually a bad match for that new job role. And then she will no longer be promoted. SPEAKER_09: On the one hand, it would seem to make perfect sense that you promote someone who's good at their job. You don't want to promote the bad workers. On the other hand, managing is not the same as doing. SPEAKER_10: There's no reason to believe that a great salesperson who knows how to negotiate deals will be a great manager. SPEAKER_09: That again is the Berkeley economist Steve Tedelis. I look here in my company, Berkeley, great researchers often make for lousy department SPEAKER_10: chairs. Great engineers often make for lousy engineering managers. SPEAKER_09: But here's the thing about the Peter Principle. Even though the theory had been around for half a century, no one had ever checked with real data from real companies whether Lawrence Peter was right. A few observations about a car mechanic or an academic researcher turned department chair, those do not constitute empirical proof, especially in the realm of management and all that airport bookstore pulp fiction. This is where Kelly Hsu and her co-authors come in. They wanted to see if the Peter Principle actually exists and if so, what should be done about it. First step, get hold of some data. SPEAKER_04: We got our data from a company that offers sales performance management software and services. SPEAKER_09: Hsu can't tell us the name of the company, but picture something like Salesforce. SPEAKER_04: A typical client of our data provider is a firm that employs business to business sales workers and that client firm would input the sales numbers and the whole organizational structure into a software program. And what we're doing is we're studying the data that these client firms uploaded into the software program. SPEAKER_09: How many firms and how many workers? SPEAKER_04: We see data for about 40,000 business to business sales workers at over 130 different US-based firms. SPEAKER_09: And how many of those were in managerial roles? SPEAKER_04: 5,000 managers and about 1,500 promotion events. SPEAKER_09: So in terms of empirical studies in your realm, this is considered a pretty large and robust data set or would you have liked it to be even bigger than that? SPEAKER_04: I would always prefer a bigger data set, but for this type of question, a very large and comprehensive data set. SPEAKER_09: So these are sales workers and sales managers. What makes sales a good business function to study? SPEAKER_04: One is important to study sales workers because almost 10% of the US labor force are somehow involved in the sales function. The other benefit is that we have a very good measure of their performance. So we can test are the stronger performers more likely to be promoted. SPEAKER_09: So that makes a lot of sense from your perspective as the scholar. From my perspective, as someone who's not in sales, I would think, well, your findings may not translate very well that in a field like journalism or in healthcare or in many other fields, the measurables aren't nearly as measurable as they are in sales. So how generalizable do you think your findings are? SPEAKER_04: I believe it's likely to apply to other settings where the skills required to succeed at one level differ from skills required to succeed in the next level. So some examples are science, manufacturing, academia, entrepreneurship. SPEAKER_09: Can you think of industries or sectors where this problem wouldn't apply? SPEAKER_04: It's actually hard for me to think of a setting in which this problem wouldn't apply at all. I've also seen it in the context of government structures. A good example is actually the ancient Chinese imperial examination system. It's famous for being a meritocracy even thousands of years ago. So you would take a test and the top scorers on the test would become administrators within the government bureaucracy. But their problem was they would make the test based upon familiarity with classical poetry and the people who are best at that test would then become tax collectors, which is a different skill set. SPEAKER_09: But ancient Chinese poetry was an incredibly rich and diverse body of literature, yes? So I could imagine how a mastery or even a deep appreciation of that could theoretically apply across a number of skills. SPEAKER_04: Theoretically, yes. SPEAKER_09: You sound unconvinced. SPEAKER_04: And to be fair, I do not have the historical data to prove that being the best at classical poetry means you're not the best at tax collection. SPEAKER_09: Since you don't have that data, let's look at say modern US politics. How would you assess the relationship between a person who's electable and a person who will govern well? SPEAKER_04: Oh, that is a very good point. So someone who is electable might be very charismatic, very good at public speaking, whereas the actual function once someone has been elected might involve being good at deal making, back office politics, or understanding the actual details of the policies that they're passing. SPEAKER_09: Do you know anything about that question empirically? SPEAKER_04: I'm drawing a blank, but you really did raise a very good research idea. Maybe I will look into this. You've been thinking about settings where this type of problem might apply for a long time, but somehow I never thought about the government or elected official example you just raised, but it seems like spot on for having potential as a problem. SPEAKER_09: Okay. Before I hijack this conversation with Kelly Xu to talk about politics and ancient Chinese poetry, we were talking about her research paper that tried to identify the Peter Principle in the wild. As Xu told us, she had performance data on roughly 40,000 sales workers and around 130 companies. The next step was to confirm that companies indeed use an employee's job performance as a trigger for promotion. The answer? Yes. SPEAKER_04: We find that doubling in worker sales corresponds to a 30% increase in their probability of being promoted. Another way to look at it is if someone is the top sales worker within their team of five or six people, then that top sales worker has about triple the probability of being promoted relative to the average sales worker. SPEAKER_09: Is that alone evidence of the Peter Principle? SPEAKER_04: No. Just to promote based upon past performance isn't necessarily a Peter Principle problem because it could be that the best salespeople really are the best managers of salespeople. In that case, you want to promote the best salespeople. SPEAKER_09: Okay. So the next step, I guess, is seeing whether the best salespeople indeed do become the best managers. How do you do that? SPEAKER_04: So first, we're going to measure the quality of each manager. Managers in our data are no longer directly involved in sales. Their job as a manager is to coordinate and facilitate the sales of their subordinates. SPEAKER_09: And presumably those subordinates are people they worked with side by side and maybe competed against just the week before they were promoted. Is that the case often? SPEAKER_04: We actually see for the most part people when they're promoted, they're rotated to a different team, possibly because the firm overall is exactly afraid of those internal team dynamics that you've just described. So we don't want to call someone a good manager just because her team sells a lot, because we're worried that maybe she was lucky and she was assigned to great sales workers. And those sales workers could have been great regardless of her managerial input. To get around that problem, we're going to measure manager quality as the manager's value added to her subordinate sales. If my subordinates sell more when they work under me than when they worked under other managers, then I would be considered a high quality manager. SPEAKER_09: So here's the key question Kelly Hsu is asking. Does being a good salesperson make you a good manager of other salespeople? Here's what she found. SPEAKER_04: The manager with double the prepromotion sales as another manager leads to about a 6 percent decline in subordinate sales. SPEAKER_09: Oh my goodness. SPEAKER_04: Yes, what we find is that among promoted managers, those with low sales prior to their promotion, they are actually better at managing their subordinates. SPEAKER_09: Let me say that again. Oh my goodness. When these firms select people to be managers based on their current job performance, they are actively making themselves worse off. In other words, the Peter principle is as real as Lawrence Peter said it was. And I'm editorializing here, it would also seem to be incredibly stupid. SPEAKER_04: If the firm's only goal were to have the best possible managers, then the firm could, by putting more weight on collaboration experience and less weight on sales numbers, the firm could promote better managers and raise overall firm sales numbers by about 30 percent. SPEAKER_09: That's assuming that collaboration experience is in fact more important for a manager than just high sales numbers. Still, a 30 percent increase in revenue simply by killing off the Peter principle? That would seem to be a no brainer. So does this mean that modern firms simply aren't aware of the age old Peter principle? SPEAKER_04: Most firms are aware of the Peter principle problem, and it's a problem that they purposely choose to live with. Some evidence we have indicating that in situations when the firm is trying to select a new manager who is going to be in charge of a very large team. So that's a situation which manager quality matters a lot. In those situations, firms put less weight on a worker's sales numbers, probably because they know they're going to end up with a bad manager. SPEAKER_09: So Shue is arguing that firms know they will get worse managers by simply promoting people who've been good at their previous jobs rather than people who might actually be good managers. And yet, for the most part, they continue to do it even though it hurts their profits. Why would they do that? Economists are always telling us that companies are by definition profit maximizing machines. Knowingly promoting a bad manager does not sound very profit maximizing. So are companies just making a mistake? SPEAKER_04: A firm having a Peter principle problem doesn't necessarily mean that the firm doesn't understand what it's doing or it's making a mistake. SPEAKER_09: So what is going on? After the break, Kelly Shue gives us some answers. SPEAKER_04: You don't want to brag about your pay on your resume. SPEAKER_09: I'm Stephen Dubner. This is Freakonomics Radio. We'll be right back. Freakonomics Radio is sponsored by Canva. If you need to design visuals for a brand, the online design platform Canva makes it easy. With Canva, you can keep your brand's fonts, colors, logos, and graphics right where you design presentations, websites, videos, and more. Create brand templates to give anyone on your team a design head start. Drag and drop your logo into a website design or click to get your social post colors on brand. With just a few clicks, you can save time resizing social posts too with Canva magic resize. If you're a designer, Canva saves you time on repetitive design tasks. No design resource, just design it yourself. With Canva, you don't need to be a designer to design visuals that stand out and stay on brand. Start designing today at Canva.com, the home for every brand. Hey, everyone, there is a new show for you. It's the story of a woman who discovers her uncle's secret life buried inside a low budget 90s thriller that started Rob Lowe and Ice-T. The podcast is called Magnificent Jerk. It's a journey through Chinatown gangs, drug robberies, Hollywood reinvention, and a family confronting its unspoken past. Magnificent Jerk, the true story of a fake story about a real life. Magnificent Jerk is an Apple original podcast produced by Pineapple Street Studios available on Apple podcasts. SPEAKER_09: Before the break, the Yale finance professor Kelly Hsu was telling us about a study she and her colleagues published about the Peter Principle. She said, It's the idea that a good employee will be promoted to bigger and bigger jobs until they get to a job they're not good at, and then they tend to stay there. But for years, the Peter Principle was just a theory. Kelly Hsu wanted to see if it's real. Using data on thousands of promotions, she did find that when top performing salespeople were promoted into management, the sales performance on the teams they manage declined. In other words, just because somebody is good at their job doesn't mean they'll be good at managing people doing that same job. Hsu also found evidence that firms know that the best salespeople make bad managers, and they choose to promote them anyway. So what is happening? SPEAKER_04: What we believe is happening is the firm is doing its best to motivate workers, and they face a trade off. SPEAKER_09: OK, this is where it gets really interesting. SPEAKER_04: Motivating based upon past performance is very motivating to workers, so it's a very strong incentive system. We can also work out that it's in some ways cheaper than offering really strong pay for performance. So there are two ways to motivate people. We can pay them a whole lot more, or we can give them an opportunity for promotion, which they might value a whole lot because that's something that they can put on their resume, and it increases their status in society. You don't want to brag about your pay on your resume. SPEAKER_09: I mean, the minute you say that, it makes me think, wait, maybe we should make it more acceptable for people to brag about their pay, because wouldn't that be more efficient in the end and encourage less promotion of people who are going to be bad managers? SPEAKER_04: That's a fantastic idea. I don't know of research testing that directly, but I do know in other cultures there's differences in it being more socially acceptable to talk about your compensation. SPEAKER_09: I mean, I was kind of half joking, but it would be interesting if there was some metric or badge you get saying, I'm really good at what I do, and I'm so good that I've been rewarded a lot of raises, and plainly, I'm very valuable to the firm, and I could be a manager if I wanted, but I'm better than that. That's an incredibly ham-handed, naive way of putting it, but is there any mechanism in managerial science for that kind of delineation between success on a financial level and success on a managerial level? SPEAKER_04: There have been some interesting attempts in that direction. So I've heard of many technology-focused firms, especially those in Silicon Valley. They face this problem that they have a pool of very talented and skilled engineers, and those engineers may not be the best managers of engineers. Many of those firms offer something called a dual career track, where someone can rise in the ranks of being an engineer, basically having a higher and higher title. You can start as engineer, then distinguished engineer, then lifetime distinguished engineer, and that's a way for the firm to recognize someone's contributions in a public way without moving them over to management. SPEAKER_09: The Berkeley economist Steve Tedelis has also noticed this movement. In companies like eBay, Google, Amazon, Facebook, there's the term of IC, or independent contributor, SPEAKER_10: and you will have people who are at the level of VP, not managing a single person, because they are just gods in their realm of engineering or coding or architecture and so on. By distinguishing between ICs and the so-called management talent, the firm is saying, look, we are going to promote people in ways that reward them for what they're great at. You're not a great manager. You're not going to get incentivized by becoming a manager. SPEAKER_09: Has that model trickled out at all of that high-tech realm? SPEAKER_10: One area where I have seen it is in consulting companies, where you have the kind of deep technical talent, think of PhDs, et cetera, that will remain and be very heavily rewarded for the work they do, and they will not manage people. SPEAKER_09: The fact that Kelly Shue and Steve Tedelis can identify a handful of cases where career success is not tied to a promotion into management, well, those are exceptions that prove the rule. As Shue found in her research, the Peter Principle is alive and well, as absurd as that may seem. It is yet another confirmation that management science, as lovely a phrase as that may seem, is not yet very scientific. Most firms stick with what they've always done. When an employee is good at what they do, you turn them into a manager to oversee other people who do what they used to do, even if they are not cut out to be a manager, like our friend Katie Johnson, the English data scientist we met earlier. SPEAKER_03: I didn't see that there was another path whereby I could be director level, but not have direct reports. I just didn't ever see that. SPEAKER_09: Looking back, there were some clues that Johnson wasn't quite manager material. You remember during management training, she took that personality test and she told us the areas where she got high scores? SPEAKER_03: Critical thinking, attention to detail, courage, all these kind of internal thinky type characteristics. Well, those were not the only results of this test. SPEAKER_03: Things that I can do, but I struggle with was compassion, empathy, relationship building. I saw this output and I was like, why didn't anyone do this to me before I got this job? Because this just screams great data scientist, not so great manager. But it was too late. SPEAKER_09: She'd already been made a manager. And as you'll recall, it was not going well. SPEAKER_03: I would finish my day and my study, walk into the living room, put a blanket over my head and cry. SPEAKER_09: So let's say we're talking a scale of zero to 10. Where would you put your median satisfaction when you were an IC or a maker? SPEAKER_03: When I was a maker, I put myself as an eight and a half. I actually loved what I did. I absolutely loved it. The only reason I would even deduct 1.5 points is because there were some frustrations, as I mentioned, about not being heard and not being autonomous. SPEAKER_09: And then where would you put a zero to 10 when you'd become a full on manager? SPEAKER_03: I would say I'd put myself more at like a four or a five, a six would be a great day. SPEAKER_09: Okay, that's your personal satisfaction. I do see, however, on LinkedIn, a review from your manager. He writes, Katie is a rounded and passionate data leader with all the qualities required to inspire, manage and lead a team. Plus she has got brilliant IC skills to boot. And he notes that you are a real unicorn in the data analytics field. So that sounds like you were the best manager ever. SPEAKER_03: Yeah. It's really nice, isn't it? SPEAKER_09: It's really nice. Did he write that before or after you decided to quit? SPEAKER_03: He wrote that after. SPEAKER_09: You heard that right. Katie Johnson quit that management job. She quit being a boss entirely. She went back to working as a data scientist at a different firm. SPEAKER_03: I don't know if you can ever be successful at something you don't like. I want to do something that I love and I'm really passionate about because that's the only way. Maybe other people are different, but I have to love it. I have to be like on a Sunday night, I can't wait to start my work tomorrow and get back to what I was doing. And I was never, ever, ever going to have that in my management job. SPEAKER_09: So before you ever became a manager, as a maker, you said your average satisfaction or happiness was around eight and a half. When you became a manager, it dropped to, let's call it five, six on a great day. What is it now? SPEAKER_03: I'd say it's a nine and a half now. I'm super happy. SPEAKER_09: Are you getting paid less now as a data scientist than you were as a manager? I'm getting paid more. How did that happen? SPEAKER_03: I think there are more individual contributor roles now that pay good money. I think that this technical specialist route is becoming more prominent and more rewarded. And people do realize that there are going to be a lot of people who don't want to become the manager. And how do you motivate them? SPEAKER_09: I believe you looked at the Peter Principle paper. Is that right? Yeah, I did. The way the Peter Principle is usually described is to me almost comical. It's that people rise to the level of their incompetence, which I find is a bit cruel sounding because one could also say that people rise to their ceiling of competence. Right? And then maybe they're not as good at that. It's not like they suddenly turn into idiots. But I am curious, just your thoughts on the notion of promotion into management as a reward for being good at what you've been doing all along. SPEAKER_03: For me, this is where the idea of splitting out those levels of seniority. So maybe you don't become the manager, but you can become a technical expert and you are paid and rewarded for that is something that helps with the incentives. What I would say on that, though, is often we have this dual career track of, OK, you can be a manager or you can be a technical specialist. But even though you might get a quote unquote promotion and be paid more, the technical specialist still might be excluded from high level conversations. So being a manager just has this connotation of seniority that a technical specialist doesn't necessarily and you still might be overlooked in terms of just the respect. And I think that is motivating more than just, hey, here's a promotion, here's a new job title. You want that autonomy and that having a seat at the table, people caring what you think. It has to come with that. SPEAKER_09: I would think that many people who are promoted from some sort of maker to some sort of manager, that it would be hard to step back if for no other reason than it seems like a loss of status. Yes, it definitely feels like a loss of status. SPEAKER_03: I guess for me, I'm lucky that I don't care what people think as much as other people or at all. SPEAKER_09: I'm sure that was identified in your personality test as well. SPEAKER_03: Yeah, complete rogue. Doesn't care what others think. People judge you, which I find interesting because I don't know anyone who likes their job as much as I do. So for people to look upon me and feel sorry for me in a sense that I have chosen to go backwards in terms of career hierarchy, it's kind of telling in terms of what we value out of a career. SPEAKER_09: And you can tell them that if you hadn't done this, you wouldn't be on Freakonomics Radio. SPEAKER_03: Exactly. I got what I wanted. SPEAKER_09: Was this the plan all along? Yeah, this is a big, long game. SPEAKER_09: Thanks to Katie Johnson for sharing her Boston and back story and to Kelly Hsu, Steve Tedelis, Nick Bloom and all their collaborators for trying to make this thing we call management science a bit more scientific. Coming up next time on Freakonomics Radio. SPEAKER_00: Science markets offer an incredibly sexy prospect of providing a measure of certainty in a dangerous and uncertain world. SPEAKER_09: Seriously? Insurance? Sexy? Apparently, yes, that's next time on the show. Until then, take care of yourself and if you can, someone else too. Freakonomics Radio is produced by Stitcher and Renbud Radio. This episode is produced by Ryan Kelly and mixed by Greg Rippon. We had help from Jeremy Johnston and Jared Holt. Our staff also includes Zach Lipinski, Morgan Levy, Catherine Moncure, Alina Cullman, Rebecca Lee Douglas, Julie Canfer, Eleanor Osborn, Jasmine Klinger, Daria Klenert, Emma Terrell, Lyric Bowditch and Elsa Hernandez. The executive team of the Freakonomics Radio Network is Neil Carruth, Gabriel Roth and me, Stephen Dubner. Our theme song is Mr. Fortune by the Hitchhikers, all the other music was composed by Luis Guerra. As always, thanks for listening. SPEAKER_09: Do you ever want to tell your Dean, thanks so much for giving me all this managerial responsibility but I don't want it. I don't want my reward for being a good scholar to be that I have to do a bunch of management. SPEAKER_04: I haven't thought about that. The Freakonomics Radio Network, the hidden side of everything. SPEAKER_06: I'm not going to lie, I'm going to be a good scholar. SPEAKER_07: Amica is a different type of insurance company. We provide you with something more than auto, home or life insurance. It's empathy because at Amica your coverage always comes with compassion. It's one of the reasons why 98% of our customers stay with us every year. Amica, empathy is our best policy. SPEAKER_05: Gatorade Zero has all the electrolytes and all the flavor of Gatorade with zero sugar to help you get more out of your workout routine. How much more? It helps you feel more hydrated through every mile, every set and every song in your fitness routine. No matter how you choose to move, Gatorade Zero got your back. From yoga to kickboxing and everything in between, Gatorade Zero is the perfect partner for whatever workout comes your way. Helping you get more, do more and be more with zero. Get more out of zero.