542- Player Piano

Episode Summary

The episode explores the life and work of composer Raymond Scott, who was famous in the mid-20th century but has since faded into obscurity. Scott was fascinated by machines and technology, and spent much of his career trying to develop systems to automate musical creativity. As a child, Scott became obsessed with player pianos, which allowed music to be mechanically reproduced without a musician. This early influence shaped his later desire to remove the "human error" from music creation. Scott formed innovative jazz and pop groups in the 1930s and 40s, but ran them with an iron fist, demanding machine-like perfection from his musicians. He later created early electronic music tools like drum machines and sequencers. His magnum opus was the Electronium, a room-sized device meant to automatically generate melodies, rhythms, and musical ideas. Scott shopped the ambitious invention around Hollywood and eventually struck a deal with Motown Records. But the temperamental machine never quite delivered on its promise. Even after his midcentury fame faded, Scott continued refining the Electronium up until his death in 1994. He represents a pioneer of artificial intelligence applied to the arts, who was ultimately unable to mechanize human creativity. Scott's story illustrates both the promise and limitations of automation.

Episode Show Notes

Composer Raymond Scott’s lifelong quest to build an automatic songwriting machine, and what it means for our own AI-addled, ChatGPT world

Episode Transcript

SPEAKER_16: Every kid learns differently, so it's really important that your children have the educational support that they need to help them keep up and excel. If your child needs homework help, check out iXcel, the online learning platform for kids. iXcel covers math, language arts, science, and social studies through interactive practice problems from pre-K to 12th grade. As kids practice, they get positive feedback and even awards. With the school year ramping up, now is the best time to get iXcel. Our listeners can get an exclusive 20% off iXcel membership when they sign up today at iXcel.com slash invisible. That's the letters iXcel dot com slash invisible. Some companies are big, others are small. To Robert Half, their hiring needs are equally huge. At Robert Half, our specialized recruiting professionals elevate their expertise with proprietary A.I. tools to transform candidate discovery, assessment, and selection. Whether sourcing talent locally or in any geography that works for you, Robert Half can pinpoint hard-to-find candidates in finance and accounting, technology, marketing and creative, legal, and administrative and customer support. At Robert Half, we know talent. Learn more at roberthalf.com slash invisible. This is 99% Invisible. I'm Roman Mars. Here at 99 P.I., we are huge fans of The Last Archive. It's a show about the history of truth, how we know what we know, how we used to know things, and why it seems lately as if we don't know anything at all. The first three seasons were hosted by historian and author Jill Lepore, who's a friend of the show and frequent guest. For their just-launched fourth season, producer Ben Nodiff-Haffrey has taken over hosting. There are stories about freelance wiretappers, time travel, and invasive species panics with beautiful sound design that makes you feel like you're inside of history itself. Today, we're presenting the season premiere, which asks the question, can machines automate creativity? And no, we're not talking about A.I. We're talking about the player piano. I also love this episode so much because it features a personal favorite composer of mine, Raymond Scott, a guy whose music you have heard without even knowing it. So let's step inside. The Last Archive. SPEAKER_12: About 30 years ago, a man named Erwin Chuzit encountered one of the strangest machines almost nobody had ever heard of. I was 40. I was broke. It was kind of a professional failure. SPEAKER_03: Chuzit was a DJ for a small community radio station in New Jersey. SPEAKER_12: A friend of his had put him on to a musician named Raymond Scott, one of the most famous musicians of the early 20th century, who had somehow been completely lost to history. These were records that were 25 cents a pop and used record stores back then. SPEAKER_03: And you didn't even they didn't even have him in a bin. They had him under the bins. SPEAKER_12: Chuzit loved Scott's music, and he began to get drawn into the mystery of it all. Who was this guy? He was obsessed, but his research kept dead ending. I went to a library and went looking through music history books, and there's almost no mention of Raymond Scott. SPEAKER_03: He wasn't in the jazz books. He wasn't in the classical books. He wasn't in the pop books. I was kind of mystified. He was kind of a mystery man. SPEAKER_12: He was stuck until his friend found Scott in a phone book. He was still alive, living in California. Chuzit made a phone call, and then he got on a plane and flew across the country. By then, Scott was in his 80s. He'd had a few strokes, and he couldn't speak. He would rest in the back of a dingy old ranch house with the heat turned all the way up and a humidifier on full blast. So there was a kind of heavy fog all around. His wife was taking care of him, but she also kept a lot of stray animals. There was a dog with paralyzed hind legs dragging itself around, and a lifetime's worth of stuff piled everywhere. There were old rusted tape decks. There were wires. There were reels of tape. SPEAKER_03: There were 78 RPM discs, many of them broken, some of them on shelves, old magazines of electronic industry publications, parts catalogs, some of them dating back to the 1940s and 50s. SPEAKER_12: I should say, this story, spooky as it is, it's kind of my dream. I'm Ben Natofhaffery, and I've produced this podcast for the last few years, and I'm hosting a season of six episodes now, which more on that later. All my life, I've written about history and made music. To find a secret hidden archive full of strange musical electronics, I can imagine almost nothing better. To know through artifacts what someone else once knew, something lost, because the records and papers and magazines that Chus had found told a story. Scott had been one of the most famous musicians of the 20th century. He'd been on TV every week for a long time in all the big magazines and films with movie stars. But almost nobody remembered him now. SPEAKER_03: And I saw Raymond's entire life's work spread out between a leaky guest shed, a garage, some outbuildings on the property in Van Nuys. SPEAKER_12: How could somebody so famous be so forgotten? But something else didn't make sense either. There are all these old machines and tools strewn about with the rusty edges. And in the corner of the guest shed, covered in dust, Chus had saw a huge hunk of metal encased in wood. SPEAKER_03: A large, dusty piece of furniture, a bit like a wooden console. SPEAKER_12: But it wasn't furniture. It was a heavy machine with wires spilling out, hundreds of switches on a black metal front, and wood paneling all around. It looked like the cockpit of an airplane, except that some of the switches and buttons said things like record and power, and others said things like doo-wah. SPEAKER_03: I didn't know what it was. SPEAKER_12: Later on, someone helping to sort through Scott's files found a contract. It was between Raymond Scott and Motown Records, and it detailed a binding, confidential agreement to build that machine that Chus had been staring at. A machine that was meant to write songs. The Electronium. Chusett had come out to California because of these 25-cent records he'd gotten obsessed with. It was honestly pretty random. But somehow, he'd stumbled on one of the strangest stories in the history of technology. How did it work? That's the voice of Brian Kehoe, one-time keyboardist for The Who, Fiona Apple producer, Beatles historian. And one of the people for whom this machine has become now a kind of holy grail. Because it makes no sense. Raymond Scott began building this thing in the 1950s, and it was a kind of mechanical, early artificial intelligence that actually worked. We're freaked out about ChatGPT now? This thing was built, in secret, at a major studio in the 1970s. Michael Jackson used to watch it work. And nobody now can figure out how to get it to work again. In the years between Chusett stumbling upon the Electronium and that rundown ranch house in today, a lot of people have gotten involved in preserving the machine or bringing it back to life in some fashion. Brian Kehoe, but also Marc Mothersbaugh, the lead singer of Devo, Gaget, the pop star, and teams of engineers and programmers and musicians from all around the world. Because it turns out that the man behind it knew how to make music like no one else. And they want to hear it again. Welcome to season four of The Last Archive, the show about how we know what we know, how we used to know things, and why it seems sometimes lately as if we don't know anything at all. This episode is about that machine and its inventor, Raymond Scott. Not just because Scott is the most famous composer of the 20th century that most people have never heard of, but because I think his life traces one of the biggest stories about truth in our world today. The attempt to define the difference between man and machine. SPEAKER_08: Remarks before Harrison's down, he is now sitting down. There's another reason I want to spend some time with Scott. SPEAKER_08: He is making himself comfortable. He recorded his whole life. SPEAKER_12: And will begin. There he goes. Which made for some fun research. SPEAKER_12: Raymond Scott was born in Brooklyn in 1908. His parents named him Harry Warno. His father had sailed from Russia to New York two years earlier on a ship called America. Sometime after Scott was born, his parents bought a music store in Brooklyn, in Brownsville, a small Jewish neighborhood. They lived in the two-floor apartment above their shop, surrounded by music and sound machines. Scott especially loved the phone. Sometimes he'd make prank calls. SPEAKER_12: Scott was growing up in an in-between time. A mishmash of the world we know now, in the world of the 19th century. The electrified subway was brand new then. The year Scott was born, it had made its way out to Brooklyn. But the gas street lamps in Brownsville were still lit every night by a lamp lighter. There were chickens in the street, the smell of the sea out over Canarsie, candy shops and tenements, hot spiced corned beef in the delis, and briny half-sour pickles in the Jewish market. Farms and salt water. It felt like the old country. It felt like the ends of the earth. SPEAKER_06: It was like a little village. It was a neighborhood. Pearl Zimny Winters, one of the girls from the neighborhood. SPEAKER_12: Later on, she and Scott got married, and she's all over Scott's recordings. Juzit, who never got over his obsession with Raymond Scott, interviewed her with a colleague, just a little before she died. SPEAKER_06: I used to go into the music store, you know, to buy music when I was a kid. That music shop is where I think the dream of the songwriting machine began. SPEAKER_12: It was a snapshot of everything that was changing in music in the early 1900s. For centuries, if you wanted to hear music in your house, someone in your family needed to know how to play. For a while, buying a song meant buying sheet music, bound together in little pamphlets. But later in the 19th century, technologies that could capture and reproduce sound were invented. And by the start of the 20th century, mechanical music was taking off. Suddenly, you didn't need to know somebody who could play to listen to music. You could listen on records, wax cylinders, the radio. Scott was obsessed with these machines and the music that came out of them. He even started an amateur home radio station, so he could make broadcasts from his bedroom to the living room. You mean to tell me that's recording now? SPEAKER_09: Oh my God, what if I could... SPEAKER_05: Even as a kid, he was always working on something. SPEAKER_12: He'd dangle microphones out the window to record conversations on the street, or the neighbor practicing piano. He would hang around the music shop with his dad, tinkering, and watching not just how music was made, but how it was sold, what sold, and how it got reproduced. And there was one machine in particular that he became fascinated by. He told me that he taught himself to play the piano. SPEAKER_06: He taught himself to play the piano with the player piano. And I guess that's how he first started. SPEAKER_12: The player piano. You've probably seen one before, in a saloon in an old Western. You know when someone gets shot, falls on the piano, and it starts playing itself? That's the player piano. A piano that plays as if there were a ghost at the keyboard. Songs were sold as scrolls of paper with little holes punched out for each note. A set of mechanical instructions for the piano. The result? You could hear nearly any song in your home, even if you had no idea how to play it yourself. Scott loved the piano in the shop. He'd take a roll and probably play it as slowly as possible, fitting his little fingers to the keys as they pressed themselves down. Learning by machine. Most people these days think of the player piano as a novelty or a gimmick. But I want to spend a minute with it here, because it's a big part not just of music history, but of automation history. We tend to think of automation as man versus robot, factory lines and coal mines. But the player piano was a kind of robot, too. One we often forget about. But an early, massively influential one that foreshadowed so much of what was to come. When Scott was a kid, people thought the player piano would be the future of music. There were hundreds of thousands of them sold each year, and millions of song rolls. By 1919, when Scott was 11, there were more player pianos being sold than regular pianos. It wasn't just sales, though. Copyright laws in the United States were built around the player piano and the record player in equal part. You can draw a straight line from player piano rolls to punch cards and the first computer programs. And people made all kinds of player pianos. What you're listening to now is a special kind of player piano roll that could capture all the subtleties of human performance. This one was recorded by the composer Debussy and reproduced decades after his death by machine. That's what Scott was learning in his family's music shop, roll by roll. Not just to play like a machine, but to wonder at all the magical things machines suddenly could do. When I was trying to understand how Scott grew up, I read up on his neighborhood. And in one memoir, I found a particular detail that snapped it all into view. The drugstore just down the street from Scott had a poster in the window. It was titled The Human Factory, and it imagined a person as if they were a kind of complex machine with all these little engineers inside. Scott must have passed that poster plenty of times. He had dreams of becoming like a machine himself, attaching motors to his hands so he could play the piano faster, the kind of way only a player piano could. Everywhere, that line between man and machine was beginning to blur. But there was one place where the difference was unmistakable. The machine never made mistakes. The song sounded the same every single time. And to Scott, that was the ideal. The struggle between being a musician and an engineer was very real for him. SPEAKER_06: He just loved equipment. Mark was the one who insisted that he go to Juilliard. I don't think he wanted to. That choice. Music or engineering. SPEAKER_12: It set the course for Scott's entire life. Because Scott never could give up on engineering. But his brother, who was a rising star in music, saw that he had a gift for composing that almost no one else did. He got Scott a job as the pianist for the CBS Radio Orchestra, and immediately Scott began to get noticed. He was anxious that people would think he only had the job because of his brother. So Harry Warno flipped through the phone book until he found a name he liked. Raymond Scott. A name he also chose because it sounded less Jewish. And he was always anxious about that. He played his piano. He wrote his songs. And he kept his engineering passion more as a hobby. CBS was a good situation, except for one thing. He was always playing standards. Songs that people knew they liked and had heard a million times already. SPEAKER_03: He said that he wanted to write music that people would like the first time they heard it. He asked his brother Mark if he could put together a band. He wanted to put together a six-piece band with himself in it. SPEAKER_12: Mark said yes. Scott started hunting for five musicians who could do exactly what he wanted. What he wanted was music with a spark that could form a connection with a listener immediately out of nowhere. He had a couple songs ready, so he found his guys, rehearsed, and then he got an audience together in CBS's Studio B. They dimmed the lights all the way. And they began to play. A journalist wrote about it a year later. SPEAKER_22: Nobody who attended that premiere 18 months ago was likely to forget it. Out of the darkness there came a thin wailing note, barely masking, a slow suggestive thumping on the drums. When it was over the audience rose to its feet and cheered. Fan mail poured in. Who was this man, Scott? Where was he from? Where had he been all these years? SPEAKER_03: They created such a, generated such an amazing listener reaction that they immediately got a recording contract with the master label, which was owned by Irving Mills, who was Duke Ellington's manager. SPEAKER_12: The response was unprecedented. SPEAKER_08: In a minute I'm going to take you right on in. We're going to have a very entertaining visit with one of the year's sensational musical groups when we get in there. SPEAKER_12: Scott was trying to sell a perfect musical package. He said he went out to clubs to track which tempos made people get up and dance. He had a whole thing about names. He called his band of six people a quintet, not a sextet. He even renamed his saxophone player. SPEAKER_10: And he is the youngest of our group. His name was originally Dave Harris, but now it's Eric Hoek. Eric Hoek? That's an interesting name. SPEAKER_08: Yeah, that's Raymond's idea of a name. SPEAKER_12: He wouldn't write his music down. He'd just play it at the piano for his quintet and then have them play their parts back till they could do it right, note for note. SPEAKER_05: And because the fellows have marvelous years and memories, they never forget a composition once they find it. SPEAKER_12: Once they had it down, it rarely changed. And that was just how Scott wanted it. If he could have replaced each of his musicians' minds with a scroll of music, he probably would have. He didn't know how to handle human relationships too well. SPEAKER_03: They called him a bully. They called him a bastard. They called him all kinds of names because he was trying to make them play better. One of his musicians once said, nobody worked with Raymond. Everybody worked under Raymond. Johnny Williams, the drummer, said we hated every minute of it because we were being told what to play. He said at the same time that we hated it, we were making more money than anybody in town. The music was like jazz, but without the improvisation or the looseness. Tightly managed. The price of mechanical perfection. SPEAKER_12: All right, boys, let it pay again, please. SPEAKER_02: Pay again, please. He rehearsed. I want to cut that. And he rehearsed. Keep on cutting, please. He rehearsed. Keep it from getting agitated by saying simple. Do it that way without thinking about it. He was driving his musicians crazy because they would say nobody needs to rehearse this much. SPEAKER_03: All right, guys, we're recording now. SPEAKER_12: Scott held his musicians to an impossible standard. He wanted them to play like machines, but it's hard to argue with the results. His rise was stratospheric. Stravinsky, Cab Calloway, Duke Ellington. They were all Raymond Scott fans. In the 1940s, he had his own radio show, the Raymond Scott Show. He became the music director of CBS Radio, where he led a racially integrated radio orchestra. This, I think, not because he was especially progressive, but because all he cared about was the music. SPEAKER_03: This in so many ways explains why he was working with machines late in life. Oh, yeah. Rather than musicians. They were his best friend. SPEAKER_12: The machines were his best friends. To me, when I heard this story, I kept thinking about Scott as a kid at the Player Piano. When that machine was invented, it scared people. Two years before Raymond Scott was born, John Philip Sousa, the famous composer, wrote an essay called The Menace of Mechanical Music. The whole course of music has been the expression of soul states, he wrote. And now in this 20th century come these talking and playing machines to reduce the expression to a mathematical system of megaphones, wheels, cogs, discs, cylinders, and all manner of revolving things. The Player Piano became a dark symbol of modern life. When Kurt Vonnegut wrote his first novel about a dystopian America run by engineers and their automatic machinery, he called it Player Piano. By the time Raymond Scott was getting famous, those fears about mechanical music were everywhere. SPEAKER_05: Same story everywhere. New machine. SPEAKER_05: High speed production. Fewer jobs. And ten men for every job that can be had. SPEAKER_12: Scott was fighting a classic battle. Mechanical perfection against human error. What was at stake were free will, agency, the human soul. That conflict was one of the main rhythms of 20th century history, and Scott was like a leading melody. And then he hit a wrong note. That story after the break. When you're working on the go, how can you make sure the confidential information on your laptop screen is safe from wandering eyes? SPEAKER_16: 3M has the answer with the new 3M Bright Screen Privacy Filter. Using Nanoluver technology, 3M Bright Screen Privacy Filters deter visual hackers while providing a 25% brighter experience over other privacy filters. In fact, it's 3M's brightest privacy filter yet. The perfect balance of screen clarity and visual privacy. It's a new type of privacy filter built for an era where our screens are wherever we go. Try the new 3M Bright Screen Privacy Filter and stop worrying about confidential or personal information escaping your computer screen. Everything that appears in your screen is for your eyes only. Visit 3MScreens.com slash BrightScreen Privacy Filter. To get your new 3M Bright Screen Privacy Filter today and work like no one is watching. 3MScreens.com slash BrightScreen Privacy Filter. What's more important, making sure you're set for today or planning for tomorrow? You can actually do both at the same time with annuity and life insurance solutions from Lincoln Financial. You're not just taking care of you and your family's future. You're also helping yourself out today. Lincoln's annuities offer options to not only provide you with your guaranteed retirement income for life, but to help protect you from everyday market volatility and their life insurance policies not only provide your family with a death benefit, but some can even give you immediate access to funds in case of an emergency. Go to Lincoln Financial dot com slash Get Started Now to learn how to plan, protect and retire. Lincoln annuities and life insurance are issued by the Lincoln National Life Insurance Company, Fort Wayne, Indiana. Products sold in New York are issued by Lincoln Life and Annuity Company of New York, Syracuse, New York. Distributed by Lincoln Financial Distributors, Inc., a broker dealer. SPEAKER_16: Squarespace is the all-in-one platform for building your brand and growing your business online. Stand out with a beautiful website, engage with your audience and sell anything. Your products, content you create and even your time. With member areas, you can unlock a new revenue stream for your business and free up time in your schedule by selling access to gated content like videos, online courses or newsletters. This summer, why not share your adventures with your followers in a newsletter or maybe make some fun video compilations of all your summer escapades. Now you can create pro-level videos effortlessly in the Squarespace Video Studio app. You can easily display posts from your social profiles on your website or share your new blogs or videos on social media. Automatically push website content to your favorite channels so your followers can share it too. Plus, use Squarespace's insights to grow your business. Learn where your site visits and sales are coming from and analyze which channels are most effective. Go to squarespace.com slash invisible for a free trial and when you're ready to launch, use the offer code invisible to save 10% off your first purchase of a website or domain. Chances are you're listening to 99% invisible on your phone, probably while you're on the go. Think of all that you do on your phone the moment you leave your front door, whether it's looking up directions, scrolling social media or listening to your favorite podcast. It requires an amazing network. That's why you should switch to T-Mobile. T-Mobile covers more highway miles with 5G than anyone else and helps keep you connected with 5G from the driveway to the highway and the miles in between. Because your phone should just work where you are, it's your lifeline to pretty much everything you didn't bring with you. So next time you head out, whether you're taking a trip or going to work or just running errands, remember T-Mobile has got you covered. Find out more at T-Mobile dot com slash network and switch to the network that covers more highway miles with 5G than anyone else. Coverage is not available in some areas. See 5G details at T-Mobile dot com. SPEAKER_12: In the 1940s, Raymond Scott was properly famous. He and his wife Pearl packed up their kids and his equipment and moved to a big house out in Tuckahoe, New York. We had a wonderful apartment in the city, but we moved from there because he was a ham radio operator. SPEAKER_06: He wanted to be where he'd have good reception. SPEAKER_12: I kind of love that. He finally had enough money to buy a big house, but actually the only reason he was moving out of the city was so that he could have better ham radio reception. He was tinkering with his machines again. Not just microphones and hi-fi equipment, but new sorts of instruments. Problem was, electronics was not a casual hobby in the late 1930s and early 40s. SPEAKER_21: He saw an electronic parts catalog and he wanted to order every part in the catalog. Stan Warno is Raymond Scott and Pearl Zimney Winter's son. SPEAKER_12: He made a great documentary about his father called Deconstructing Dad. I visited him last winter. And he thought the only way he's going to make enough money to do that is to form a big band. SPEAKER_21: And so he did form a big band and went out on the road. SPEAKER_11: It's 4.30 in New York and time for CBS to present the Raymond Scott Show. Across the continent and later to the whole world by shortwave comes song hits of the day, starring America's number one composer with a band. Here he is, Raymond Scott. SPEAKER_12: In the 1930s, Scott's hits seemed to have been about the music first. But in the 40s, his focus seems to have shifted from writing great songs to making as much money from his music as possible so he could fuel his mechanical hobby. It was like his own version of his dad's music shop. Music sold any way you like. But a big band needed a singer. He was always churning through them, always on the lookout for someone perfect. And that's how we met Marjorie Chandler. SPEAKER_06: We were in Chicago and we took an apartment there. SPEAKER_12: Scott heard through one of the band's managers that there was a young girl from Canada he should meet. She'd sung in a big radio contest and won first place. She was about 13 years old and her voice was amazing. Scott decided to take her on as a student, full time. SPEAKER_21: He thought she had real potential. And so she came to live with us. SPEAKER_12: Marjorie's family sent her to live at the house in Tuckahoe. According to Pearl, she and Scott were like surrogate parents, except Scott and Marjorie spent endless hours practicing. It was like with his quintet, except Chandler was a kid away from her parents. This tape is likely from later on, but even then you can hear how exacting he is. SPEAKER_07: Long blue skies were overcast. SPEAKER_12: Scott gave her a new name, Dorothy Collins. She'd go to school. She'd wander around the big house and write her name, Marjorie, over and over again. Then she'd go back to practicing. SPEAKER_12: It was a back-breaking regimen, but she was an incredible talent. SPEAKER_21: And as she got older and better, he began featuring her in his band. SPEAKER_12: She grew up with the family. When she was a bit older, she sang with the band for the first time on the air. After Scott started hosting the Lucky Strike hit parade, a popular TV show, she became the featured singer. She was 24. And at some point along the way, they got romantically involved. SPEAKER_21: And then I have seen some letters where my mother was writing to him saying, I'm not really comfortable with her. And who knows what was going on? Because again, they eventually got involved with each other and he divorced my mom and married her. SPEAKER_12: Scott and Marjorie, now Dorothy Collins, were married when she was 25. I don't want to dramatize this or speculate on how and when they got together, because no matter what, it's a dark turn. She had been like an adopted daughter to them, away from her own parents. It was the culmination, I think, of the most dangerous strain in Scott's thinking about musicians and people. What he must have seen in Marjorie Chandler in the beginning was Dorothy Collins, the chance to make his own musician, his own person, as if he were building a machine. Every week they appeared on TV together. Collins became a kind of American darling, achieving a level of celebrity even Scott had never had, a star. The money came pouring in. They moved into a mansion on Long Island. SPEAKER_19: It had 32 rooms and four stories. SPEAKER_12: That's Deb Studebaker, Raymond Scott and Dorothy Collins' daughter. She's a teacher and a poet, which you can hear by the way she describes her childhood home. SPEAKER_19: The house was at the end of a long gravel driveway. It had a forest behind it. It was very grand. There was a library with a secret door. You pull it out, there was a bathroom behind it. We would go on these explorations in the forest. There was wisteria hanging over an archway that was always filled with bees. SPEAKER_12: Inside the house, Scott had begun to amass all the electronic parts he wanted. He was at once secretive and proud to show it off. Let me take you downstairs and show you these technical facilities. SPEAKER_09: And I take it we're supposed to have, oh, maybe a half million separate items or so. An electronic music studio wants to grow and grow and grow and grow. The room was full of gear, switches, meters, welders, a furnace. SPEAKER_12: But now I'd like to take you upstairs to show you what we've been building with all this equipment. SPEAKER_12: Upstairs was a 30-foot wall of obscure electronic musical machinery. Alongside his other musical work, Scott had begun writing and recording music for commercials. I have for several months now been unable to get this jingle for Sprite out of my head. Over the course of the 1950s, Scott wrote jingles for a lot of big companies. Schlitz Beer, RCA Victor, Vicks, Ford, Chrysler. And a lot of the time, it was Dorothy Collins singing them. He had a plaque over his piano that read, ideally, the word should make sense. What makes an Ellen bulb bounce? SPEAKER_10: A melon bulb bounce. A melon bulb bounce. What makes an Ellen bulb bounce? SPEAKER_20: The ice-cocked taste of Sprite. SPEAKER_12: These companies were selling the future, and they needed a sound to match it. In the 1950s, Americans were drunk on the post-war promise of consumer technology. It was the age of automatic, of being able to buy all sorts of machines that would make your life easier. SPEAKER_10: To make reality of imagination, this is Bendix, the Tomorrow People. SPEAKER_12: Scott and Collins seemed at the time to have a happy life together as the Tomorrow People, throwing parties at their mansion, making music in the machine rooms, and listening to it in the listening room. They were in many ways the sound of that post-war dream world. They made music meant to push the button that sent consumers marching off to make a purchase. During those years, Scott was creating the kinds of machines his music helped to sell, whirling spinning devices that seemed as if they came from the future. Just keep in mind how different what you're hearing is from popular music in the 50s. I mean, this was the top song of 1959. We fired our guns and the British kept a-comin' There wasn't as many as there was a while ago SPEAKER_15: We fired once more and they began to runnin' On down to Mississippi to the Gulf of Mexico SPEAKER_12: Music like Scott's just didn't exist in the mainstream, but he was sneaking it in there through commercials. He saw his machines as a way to push the envelope, and thought that because the sounds they made were new, they'd catch the ear in a way jingles made with old instruments couldn't. Scott seems to have created one of the first, if not the first, musical sequencer, a device that is the foundation for much of modern pop. In a weird historical twist, one of the ways he had financed all this experimentation was by selling his early hits to Warner Bros., where they became a lot of the music soundtracking the Looney Tunes. Literally, this man put the tunes in Looney Tunes. But then he started to get sick. His brother and his father had died of heart disease, and Scott had his first heart attack in 1958. I don't think it's a coincidence that within a year, he began to work on the first version of the Electronium, his songwriting machine. SPEAKER_21: I remember him telling me, you know, about this machine. I'm working on a machine that's going to compose and perform at the same time. This was the stuff of science fiction, a dream a few people had had, SPEAKER_12: but nobody went for it quite like Scott. A machine not just for playing music, but for composing it. Scott began to work harder and harder on the machine, and at the same time, his marriage to Dorothy Collins unraveled. She discovered that she loved acting and the theater, SPEAKER_19: and my dad didn't travel with her or us. He was always working on his own stuff. But I think there was a certain lightness, I think, that she probably found being respected now, you know, for something new that was hers. Acting was hers. He had nothing to do with that. SPEAKER_12: Collins left, and then they were divorced. She testified in court that he was such a perfectionist, so intensely critical, that he gave her asthma, and she couldn't sing when he was around. SPEAKER_19: As my mother used to say, it was like Frankenstein's monster, and the monster kind of woke up and decided, you know, that she could be her own person. SPEAKER_12: But Scott was bereft. He took a bunch of sleeping pills, thinking he was going to kill himself, SPEAKER_21: but he just went to sleep for a long time. He moved out of the house into an industrial space in a big office park on Long Island. SPEAKER_12: His TV show was off the air. He didn't have a hit band anymore, and he was alone. But he had one thing left. The Electronium. SPEAKER_21: I have very clear memories of being out there, and the Electronium was in the very next room. Iterating away, which is what it did. You had to kind of set it up, and then it would go through these iterations. And we would be listening to it, and he would hear something he really liked, and he'd jump up and go in there and record it on the cassette. SPEAKER_12: In the 1960s, Raymond Scott was living in a long, low, white cement warehouse, surrounded by machines. SPEAKER_17: He had to seriously downgrade his life. Jeff Winner. He works with Chuzit, that radio DJ who went out to visit Scott. SPEAKER_12: And together with Scott's family, they're preserving, managing, and sharing his archives. He went from a massive mansion of his own design SPEAKER_17: to living on Long Island in a warehouse that wasn't even zoned for residential, that didn't have a kitchen. He was not supposed to be living there. He'd gotten married for the third time, to a woman named Mitzi Curtis. SPEAKER_12: And this time, it stuck. But money was tight. Popular music was moving on. He was still composing the occasional jingle, but now, really, it was all machines. And not just in his warehouse. The concern over automation was reaching a fever pitch in the United States. In 1960, John F. Kennedy even ran for president against the machine threat. SPEAKER_04: Because the problem that West Virginia is facing is the problem that all America is going to face. That is the problem of what happens to men when machines take their place. SPEAKER_12: Meanwhile, Raymond Scott seems to have been trying to replace as much of himself as possible with the machine. Everything he had ever done up until that point, in one way or another, would become part of Electronium. SPEAKER_17: Even if he hadn't even declared to himself that that was his goal yet, it's like everything's under that one roof. SPEAKER_12: His bassline generator, his drum pattern generator, the melody sequencer, all of it tied together with thick wires, hidden behind the concrete walls of the factory. SPEAKER_18: And when Raymond came to the door, the first thing I encountered was, Well, I want you to sign this disclosure agreement. Tom Ray. He used to work at Moog, probably the most famous synthesizer company of all time. SPEAKER_12: He's taught electronic music history at the Berklee College of Music, where he was a professor. But at the time he met Scott in the summer of 1970, he was a graduate student working on his dissertation for a Ph.D. in music. I mean, I'm not an industrial spy. I'm a graduate student. SPEAKER_18: Ray had heard that Scott was touched with genius, and he wanted to see what he'd been inventing. SPEAKER_12: What did I see? I saw everything. Oh my gosh, you know, what is this thing over here? SPEAKER_18: And I said, doesn't seem to have a keyboard or any kind of an interface. He said, well, it does. It had one little micro switch. And so he goes over and he flips some of these many, many knobs and switches and things on the panel of the thing and said, I'm going to have it suggest a theme and it gives out with a little melody. And then he says, I think I will ask it to make the intervals, the music musical intervals wider. And he flips a couple of switches and they're wider, you know, and he put together, as I sat there, a rather lush composition with not only accompaniment, but counterpoint and, you know, the whole thing. SPEAKER_12: Scott was inventing madly during those years. The Electronium combined a lot of different gizmos he'd created, and it was a constantly changing set of modules. You controlled the music the machine made by means of switches. He called the composer guidance control. One of the major X factors of the Electronium is that it seems to have had some way of generating randomness within the preset patterns. They would change on their own over time, but it's not clear to anyone how. This was a crazy idea, but you can get a clue to why Scott was after it from an ad he made around then with Jim Henson, the Muppets guy for IBM. They were pitching a new word processor, but the ad is all about modern life. It's a kind of crazy montage of vacant looking people, machines and explosions. SPEAKER_13: There always seems to be enough time to do the paperwork. But today there isn't. Today there isn't enough time. Today there aren't enough people. SPEAKER_15: Machines should do the work. That's what they're best at. People should do the thinking. That's what they're best at. SPEAKER_05: But what about a machine that did the work and the thinking? When Scott was born, machines were being created mostly to help people do rote physical labor. SPEAKER_12: In the first half of the 20th century, they began to do those things automatically at the push of a button. And by the age of the Electronium, machines began automatically to do things that looked a lot like intellectual labor. SPEAKER_08: This robot manipulator can be easily taught because of its electronic brain. Can this type of control be applied to other types of machines? Certainly. SPEAKER_12: In that light, Scott was reaching for the brass ring, a machine capable of making art, of helping people make art, that expressed a human soul and stirred human emotions. But he needed money to do it. So he started doing a little press. Small articles here and there. It's like inventing the typewriter, he told a journalist. Only the typewriter furnishes the plot and reads the result. SPEAKER_18: I've always told people that I consider Raymond Scott one of the pioneers of artificial intelligence in music. SPEAKER_12: But if you wanted to buy an Electronium from Raymond Scott, it was going to cost you an arm and a leg. And it was a crazy idea. So it was by a stroke of luck that the head of Motown Records, Berry Gordy, heard about it. SPEAKER_13: It's not a one-man organization or a two-man organization, but it is an organization of teamwork. There's unseen heroes, so to speak. Berry Gordy founded Motown in 1959 in Detroit. Before founding the company, he had worked at a car factory during the years when there was lots of hubbub over plants that had achieved near-full automation. SPEAKER_12: It was on the assembly line that Gordy started to think about doing music differently. In his autobiography, he wrote, At the plant, the cars started out as just a frame pulled along on conveyor belts until they emerged at the end of the line. I wanted the same concept for my company, only with artists and songs and records. If we had gone any year without hit records, we would have been out of business. SPEAKER_12: Motown was a Black-owned business, selling music by Black artists to everyone in America. Like everything in the music business, it was precarious economically because hit records deal in matters of taste, and taste is subject to biases and whims. Gordy, with his assembly line past, wasn't having that. He wanted to systematize as much as possible. They'd A-B test songs with different artists until something stuck, like R&D. They had a house band, the Funk Brothers, providing iron-clad rhythm section arrangements across Motown songs, as if they were the engine department. The only thing missing was the automation. And that's why it makes sense to me that one day, in the early 1970s, Berry Gordy pulled up to Raymond Scott's warehouse with a string of limos to see the automatic songwriting machine for himself. And by the way, Berry Gordy knew who Raymond Scott was like anybody of his generation. Raymond Scott was a famous person. SPEAKER_17: So Gordy also knew he was getting that in the deal. Someone who is a musical mind who has already written hits. SPEAKER_12: Scott showed Gordy and his crew the warehouse. And then he fired up the electronium, just like he did with Ray. He must have shown Gordy how you flipped the switches to set a pattern, then watched as the machine iterated, changing notes, repeating phrases, rifling through ideas semi-randomly. SPEAKER_10: And during the last couple of minutes, the pattern generator was on only slightly. Only one, four, five, and ten, eleven, twelve, eleven, twelve. SPEAKER_12: Scott was selling an idea at that point. The potential of a songwriting machine that could hit on an idea that a person alone never would. If it came up with a hook that sparked in the way a hit does, you'd know it when you heard it. And you could bottle it up and sell it to millions of people. This idea, I think, came straight from Scott's quintet days. Finding that sound that you like the first time you hear it. It's a tricky balancing act because it has to be new enough that it catches your attention. But a hit also has to sound familiar enough that you kind of know what you're going to get as soon as you hear it. It's like an elevator pitch to the listener, and Gordy was uncompromising about it. Here's Smokey Robinson in a 2019 documentary, remembering that process. He used to say that all the time, we gotta get him in the first ten seconds. SPEAKER_05: We had to come up with these fabulous intros, you know, something that would catch your attention immediately. SPEAKER_12: So in that light, the Electronium makes perfect sense to me. What if you could take a machine that had baked into it all of the patterns and intuitive musical sense of a proven hitmaker like Scott, but then this crazy X-factor of proto-artificially intelligent randomness? That dream was Scott's life's work. He needed it to work. Everything was riding on it. SPEAKER_17: So Gordy was so impressed that he wrote a check on the spot for $10,000 to get started. And that was a lot of money back then. SPEAKER_12: It was a huge windfall. Scott was overjoyed. Gordy wanted the instrument remade to suit Motown's needs, so Scott began work immediately. The machine would be a culmination of everything he'd worked on up to that point, including the player piano from his childhood. Here's a call from a couple years earlier between Scott and Bob Moog, the synthesizer legend who'd worked with him. And this knocked me out when I first heard it in the archives, but he was still thinking about the player piano. You can hear the ideas just bursting out of him. SPEAKER_12: A player piano for the space age. Scott, of course, quickly blew through the Motown down payment and ran out of time. But Gordy didn't seem to mind. Scott moved out to Motown's offices in Los Angeles to work on the Electronium in a room above Berry Gordy's garage. He became the director of electronic music research and development. Eventually, he started to work on the machine in the Motown studios. People were in awe of him. I'm thinking of a couple different engineers who were up there, SPEAKER_19: who would just come out and be like shaking their heads, kind of like, you know, what is going on kind of thing. Scott's daughter, Deb Studebaker again. SPEAKER_12: According to a former engineer at Motown, Michael Jackson would come by Scott's studio, a small room on the second floor, and watch the Electronium work. It made music unlike anything they'd heard. The idea wasn't that the machine would write a complete song structure, verse, chorus, bridge, but that it would iterate on combinations of rhythm, chord, and melody in search of that spark. It was a way of automating the part of songwriting Scott excelled at, the thing that caught your ear and made you like something the first time you heard it. It was meant as a collaboration between man and machine, one that took the hard work out of the most crucial part of the songwriting process. The inspiration. But over time, the extreme cost weighed the project down. Also the fact that Scott was never satisfied, refused to be finished. The Electronium worked. It just was always opened up, being redesigned, refined, changed. At one point, that same engineer tried to get Motown's famous session musicians to play along with the machine as part of a drive to use the instrument on a recording. But they revolted. SPEAKER_17: They didn't like it. They didn't like the idea of it. They didn't like the concept. They didn't like what it theoretically represented. And these guys were great musicians. They didn't want to be replaced by a machine. SPEAKER_12: It's not known whether the Electronium ever suggested an idea that made it into a Motown song, but I think it's unlikely. Gordy let Scott take the Electronium home with him eventually, to tinker with it around the house. He'd stay up all night and work on it all day in his pajamas, building new bits and pieces, taking it apart and building it again. Then his health got worse. The music industry moved on, started to forget about him. He had several strokes, and the Electronium sat in the guest shed out back, gathering dust, waiting to be found. SPEAKER_01: Well, it's Dr. Frankenstein's monster, isn't it? SPEAKER_12: Brian Kehoe again. The synthesizer wizard, former keyboardist for The Who, Fiona Apple producer, and the second person this episode to bring up Frankenstein's monster. More happily in this case, about a machine rather than a person. He's working now to bring the Electronium back to life. We spoke last winter. SPEAKER_01: And so, Electronium might be literally just a piece of inspiration. If I play piano or if I play guitar and write songs, my fingers are even limiting because I tend to play a certain chord shape because I'm jazzier and he's more country. But if the Electronium is not confined by those things, it might come up with ideas that are beautiful hybrids, maybe a little jazzy but a little polka, and who knows what it would come up with. But that's an idea to say that the human creativity is limited. It's a beautiful thing when it works, but as we know, you can't just write great music all day, otherwise everybody would. I guess part of the problem is like in a creative line of work, SPEAKER_12: your business, especially when you're a Motown, which is an empire at that point, is totally dependent on this fundamentally unknowable, unreliable thing, which is human creativity. You never really know when the muse is going to strike. And so, especially with the kind of assembly line Motown idea, if you could just make that predictable and automate it, the aha moment, then that would take a lot of the uncertainty out of the business. I think you pointed out something that most people don't want to ever mention, SPEAKER_01: which is that creativity is unreliable. You might be Paul McCartney and able to write some of the world's greatest songs, but if I brought him in the room right now and gave him an hour, said write me a great song, it doesn't work that way. SPEAKER_12: It doesn't work that way. But you can understand why someone who devoted his whole life to making perfect music wished that it did. SPEAKER_09: I'm going to put the jacket together. There are a lot of notes on it. SPEAKER_12: Raymond Scott died in 1994 in obscurity and relative poverty in a nursing home near that faded house in Van Nuys. Chuzad, winner, a slew of fellow enthusiasts, and the Scott family started to comb through his archives to piece the whole crazy story together. They shipped boxes and boxes of tapes and records and papers to the Marr Sound Archives at the University of Missouri, Kansas City. Then they released his music and compilations. Scott had always kept his machines mostly secret, in case anyone wanted to steal them. But when they finally released Scott's electronic music in the early 2000s, he suddenly had a new set of posthumous hits. You probably don't even realize you've heard a Raymond Scott song before, but he's been sampled all over the place. Gorillaz, J Dilla, Lizzo, they've all sampled Scott. His music is in The Simpsons, Ren & Stimpy, HBO shows. The song you're hearing now is called Portofino, and it was unreleased in his lifetime. But there are all these recordings of it, each trying it a different way. All electronics, with vocals, with saxophone. When the archivists found it, Chuzad thought the melody was so classic, it must have been a cover. SPEAKER_03: I went into various databases looking for Portofino. There's like 80 or 100 things called Portofino. And I would go through iTunes and listen to every goddamn one of them, and not one of them was Raymond's melody. But to this date, that thing's been out for 21 years. No one has come to us and said, that's a cover version, or someone else wrote that, or it's a traditional melody. SPEAKER_12: A true original. Meanwhile, Mark Mothersbaugh, the lead singer of Devo, bought the Electronium, and dragged it from the shed to his studios. Brian Kehoe is trying now to assemble a team of engineers to bring it back online, in digital or physical form. Even with all the schematics, they're still mystified. SPEAKER_01: You know, somebody said it's still a black box, and that's true. We still don't know what it did. And I feel like we're looking through a keyhole at a room, and we can barely see it until we get through the door a bit more. SPEAKER_12: There are Scott cover bands and Scott festivals. Somehow, his music still resonates. Whatever spark he caught is still catching. What I think is strange is, most of the musicians who knew Scott earlier in his life seem to have hated him. But the engineers who knew him at the end of his life loved him. A lot of his early jazz hits were aggressive, frantic firecrackers of song. But the electronic stuff is often sweet, guileless, innocent. Some of that stuff was written in partnership with the Electronium. His melody, its patterns. And it sounds like a songwriter at peace with himself. At one point, he resisted human control of it, SPEAKER_01: but then he took one of the voice cards and adapted it to a keyboard input, as he found before when he would put a Hammond organ or mostly an ondulene on top of the Electronium. It really needed somebody doing a nice melody in order to sell the package. SPEAKER_12: There is, I think, a lesson in Scott's life, one that's kind of a morality tale for our own AI-addled chat GPT world. He walked from automatic pianos to the first computers. He sought perfection. He sought industrial-scale creativity. But the trade-offs he made were the relationships around him, the failure to see the humanity of the people he was trying to control. People would sometimes talk about Scott as if he were a machine, but I think there's something in his music that testifies to a soul, that ghost at the keys of the player piano. Those recorded phone calls to his family. That early string of hits. All the musical machines. What they have in common is the goal of each song, to connect people through sound. Scott prized perfection in that end above everything else, and it ruined him. Someday soon, someone might be able to bring the Electronium back to life and hear again the inside of Scott's mind. But still, I think he must have known. The Electronium could never write a Raymond Scott song. For that, you needed Raymond Scott. SPEAKER_12: The Last Archive is written and hosted by me, Ben Natofafri. It's produced by me and Lucy Sullivan and edited by Sophie Crane. Jake Gorski is our engineer. Fact checking on this episode by Arthur Gomperts and Lucy Sullivan. Sound design by Jake Gorski and Lucy Sullivan. Our executive producers are Sophie Crane and Jill Lepore. Thanks also to Julia Barton, Pushkin's executive editor. Original music by Matthias Bossi and John Evans of Stellwagen Symphonette. Additional music by Corntooth. Our Foolproof player is Becca A. Lewis. Many of our sound effects are from Harry Jeanette Jr. and the Star Jeanette Foundation. Special thanks on this episode to Alan W. and Tenman, Jack Hertz, Carl Miller and the Pyurian Recording Society, and Byron Werner. For a bibliography, further reading, and a transcript and teaching guide to this episode, head to thelastarchive.com. The Last Archive is a production of Pushkin Industries. I'm Ben Nadeff-Haffrey. SPEAKER_16: A perfect sleeper means more restful nights and more rested days. Find your comfort at Serta.com. SPEAKER_20: Will it be that no-name hotel that says no to every request? SPEAKER_00: No, you'll have to find the elevators yourself. Or maybe the one with the extra stale Danish for breakfast. SPEAKER_20: I think I broke a tooth. When you want a place you can always rely on wherever the road takes you, it matters where you stay. Welcome to Hampton by Hilton. Don't forget about our free hot breakfast. SPEAKER_20: Hilton, for the stay.