40,000 Recipes for Murder

Episode Summary

Title: 40,000 Recipes for Murder - Sean Eakins, CEO of Collaborations Pharmaceuticals, uses AI to discover new medicines. Their system, Megasyn, can generate molecules that could potentially treat rare diseases. - Eakins was invited to a conference on dual-use technologies that can be misapplied. As a thought experiment, he reversed Megasyn's safety filters to have it generate highly toxic molecules instead. - Megasyn generated over 40,000 molecular "recipes" for potential chemical weapons, including VX nerve agent. This demonstrated the system's dangerous dual-use potential. - Eakins revealed this capability at the conference and in a paper to raise awareness, but did not share the actual molecule data to prevent misuse. The paper caused alarm in the pharmaceutical and national security communities. - Experts note generating molecules on paper is still far from producing actual usable chemicals/weapons. But the ease of flipping the system's purpose raised concerns about dual-use AI. - Eakins argues AI systems like this cannot be classified as good or bad, but depend on the intent and choices of the users. The line between helping and harming is very thin.

Episode Show Notes

Two scientists realize that the very same AI technology they have developed to discover medicines for rare diseases can also discover the most potent chemical weapons known to humankind. Inadvertently opening the Pandora’s Box of WMDs. What should they do now?

Special thanks to, Xander Davies, Timnit Gebru, Jessica Fjeld, Bert Gambini and Charlotte HsuEpisode Credits:

Reported by Latif NasserProduced by Matt KieltyOriginal music and sound design contributed by Matt KieltyMixing help from Arianne WackFact-checking by Emily KriegerCITATIONS:Articles:Read the Sean and Fabio’s paper here. Get Yan Liu’s book Healing with Poisons: Potent Medicines in Medieval China here. Yan is now Assistant Professor of History at the University at Buffalo.Our newsletter comes out every Wednesday. It includes short essays, recommendations, and details about other ways to interact with the show. Sign up (https://radiolab.org/newsletter)!Radiolab is supported by listeners like you. Support Radiolab by becoming a member of The Lab (https://members.radiolab.org/) today.Follow our show on Instagram, Twitter and Facebook @radiolab, and share your thoughts with us by emailing radiolab@wnyc.org.

 

Leadership support for Radiolab’s science programming is provided by the Gordon and Betty Moore Foundation, Science Sandbox, a Simons Foundation Initiative, and the John Templeton Foundation. Foundational support for Radiolab was provided by the Alfred P. Sloan Foundation.

Episode Transcript

SPEAKER_10: Radiolab is supported by Apple Card. Apple Card has a cash-back rewards program unlike other credit cards. You earn unlimited daily cash on every purchase, receive it daily, and can grow it at 4.15% annual percentage yield when you open a savings account. Apply for Apple Card in the Wallet app on iPhone. Apple Card subject to credit approval. Savings is available to Apple Card owners subject to eligibility requirements. Savings accounts provided by Goldman Sachs Bank USA. Member FDIC terms apply. SPEAKER_06: Listen to support it. WNYC Studios. This week on the New Yorker Radio Hour, the novelist Jennifer Egan on how we could end the enormous problem of homelessness if we had the will to do it. That's the New Yorker Radio Hour. Listen wherever you get your podcasts. SPEAKER_02: That's the thing. The second thing is, if you want to join the Lab, now is a really good time to do it. Too sweet in the pot. If you join this month, you get a free Radiolab t-shirt. It'll make you look great, but also approachable. Anyway, to join and get that shirt, go to radiolab.org. That's radiolab.org slash join. Onto the show. SPEAKER_12: Wait, you're listening to Radiolab. SPEAKER_11: From WNYC. SPEAKER_02: Okay, so I am, this is unusual because I usually prep so much and I have not really prepped that much at all. All right, you're flying fast and loose. I'm flying very loose here. SPEAKER_10: With secret intel about the government and poison? No. Something. Is this about poison? Maybe. Okay. Okay, let's just do the thing. All right. Hey, I'm Lulu Miller. I'm Latif SPEAKER_02: Nasser. This is Radiolab. Okay. Basically, I was just like nosing around and I found this article in a journal called Nature Machine Intelligence. Nature Machine Intelligence. SPEAKER_10: Okay. And this is a few months ago. It was in March. I don't even know what I was looking SPEAKER_02: for when I was, and I just found this paper and I had this weird kind of boring title that I didn't understand, but I like started reading it. And the tone of it, there was something about the tone of it that was sort of breathless. Like, oh my God, we just discovered this thing and it's kind of scary and we're not the only ones who were able to find this thing. We're not the only ones who are actually looking for this thing. And it felt like calamitous. And by the time I finished it, I was breathless. Like I was like, oh my God, like, is this what I think it is? Because if it is, this thing is terrifying. Okay. What, what, and SPEAKER_02: what's the thing? Okay. So let me just start from the beginning. I was just trying to manufacture out of nothing a kind of open tease. No, I mean, I'm in. Okay. So here's what happened. So our scene begins with... You're muted. Oh, I'm muted. This guy named Sean. I'm muted. Duh. Okay, cool. All right. Okay. So Sean, I just like, I gotta say, when I read your paper, basically my jaw dropped and I wanted to hear you tell the story. Yeah, I'm happy SPEAKER_12: to tell you how it came about. It took quite a long time to get out. Well, before we get SPEAKER_02: there, if you don't mind my interrupting, let's, let's actually rewind a little bit. Like who are you? What is your company? What do you do? So my name is Sean Eakins. I'm SPEAKER_12: the CEO of Collaborations Pharmaceuticals. And this is a company based in Raleigh, North Carolina. I founded it 2015 and we work on using computational approaches for doing drug discovery. Which basically means what they do is they use AI to discover new medicines. SPEAKER_02: You're a medicine hunter and you do it through computers. Exactly. Yes. So essentially what they do is they've built, like using a lot of like open source technology, a lot of like open source, like databases of drugs. They basically created this computer program that's kind of like a search engine. And so they call it Megasin or Megasign. How do you say it? Yeah. So it was a really quick name for megasynthesis. Oh, so and, and sort of synthesizing SPEAKER_10: drugs that exist with receptors and brains and kind of, it's a little complicated. It's SPEAKER_12: one of those strange things where like I don't use it. I have one of my employees that basically codes it and puts it all together. So that employee, sorry, let me take my mask off here. SPEAKER_02: His name's Fabio. Fabio Urbina. Okay. Sean and Fabio. Sean and Fabio. I love it. So what SPEAKER_02: they do is they typically work with rare diseases, which aren't considered profitable. Big Pharma has ignored them. There's no drugs for them. So what they'll do is they'll take one of these diseases that usually only a few hundred people have, and they'll be like, okay, we SPEAKER_02: need a drug that will do a very specific thing in the body to stop this disease, to stop the person from getting sick. So they'll tell Megasyn, we need a drug that can do this very specific thing. And then they'll hit search and Megasyn will comb through all the available drugs that have been discovered, all the drugs that have been even evaluated, like this giant network of basically every drug that's ever been created. And if from that Sean and Fabio can't find a good match. Well, we're kind of out of luck. That's the SPEAKER_11: end of that. Except it's not. Because Megasyn can do this other thing. It can put together SPEAKER_11: a drug basically. So how this works is drugs are basically just made up of molecules. And SPEAKER_02: the thing about molecules that work as drugs is they have a certain molecular weight range. SPEAKER_11: They have certain properties. They're distinct. You can look at them and say, okay, that's a drug or, oh, that looks nothing drug-like. And so using all these public databases and SPEAKER_02: just inputting all this information into Megasyn about chemistry, molecular engineering. In SPEAKER_12: a sense, we've tried to train it to make things that a chemist would make. And so with that SPEAKER_02: knowledge, what they do is they take the rare disease and they say, okay, Megasyn, in the infinity of molecules that could be drugs that don't even exist yet, can you make something SPEAKER_11: that might be active against our disease of interest that could work here? So Fabio will SPEAKER_02: enter all this stuff into Megasyn, hit run, and within minutes, it'll spit out these brand new never before seen molecules, molecules that look like drugs. And then Sean and Fabio can go through these molecules and say, okay, this is the one we want to do this thing we need it to do. To disrupt this disease that humankind doesn't have a cure for. Oh my gosh, the speed of that just needs a moment. Yeah, it's kind of amazing. It's incredible. It's incredible. Yeah. Yeah. SPEAKER_02: Um, okay, so this is, I mean, this is where things start to get dark. So it's 2021 and these guys, they are just doing their thing and they get invited to this conference called the SPEEs or SPEEs, convergence conference, kind of international security conference. SPEAKER_12: And the goal of it really is to understand how technologies can be misapplied. Part of SPEAKER_02: the theme is like this idea of, of like dual use. So, okay, for example, dual use is like a nuclear bomb and nuclear power plants come out of the same technology, like the so-called like double edged sword. And so we got this invite and of course we're thinking, oh, well, SPEAKER_11: that's interesting. Why, why, why us? How can we misuse wonderful drug discovery tools? It's never even occurred to them. So the location was good. It was in Switzerland. SPEAKER_12: They're kind of excited. I was like, oh, the pictures look really good about going on a SPEAKER_02: free trip to Switzerland as anybody would be jumped at the chance. In the end it was SPEAKER_12: a zoom conference, which was a bit, you know, not as exciting, but, but they're like, okay, SPEAKER_02: let's think of something like we could think of a way that we could, you know, we got this invite like surely there's something we could do. So there's sort of like brainstorming like, okay, if we were like really evil, what would we do? How would we misuse what we know? SPEAKER_02: They called it like their doctor evil plan. What would Dr. Evil do here? SPEAKER_11: So yeah, it was, it was very weird feeling. So they're like imagining and thinking it SPEAKER_02: up. Well, we were running out of time. When Sean has this idea. I hadn't given it a lot SPEAKER_12: of thought. It was, it was pretty quick. So one of the things about Megasyn is if we are SPEAKER_11: trying to generate a new drug, we want to make sure it's not toxic. Fabio basically SPEAKER_02: programmed this filter in Megasyn so that if the side effects of the medicine are going to be worse than the medicine itself, like, or then the disease itself, like not interested, SPEAKER_10: not interested. Don't bother because of course it doesn't matter if your drug cures all cancer. SPEAKER_11: If it stops your heart from beating, it's going to not be a good drug. It'll save my SPEAKER_02: life, but it'll also kill me. So I'll pass. Yeah, exactly. Got it. And so Sean, well, SPEAKER_12: he thought what if instead of going right, we went left. What if we flipped the filter? SPEAKER_02: What if we did the exact opposite, like photo negative of that filter? Just spit out the SPEAKER_10: deadliest. Yeah, exactly. And so I was using a 2015 Mac that night. Just did a couple of SPEAKER_11: copy and paste changes, typed the one where there was a zero and a zero where there was a one. It was that simple. It was literally that simple. He hit run on Megasyn and then went home for the evening. Next day. I did some work in the morning and then I think SPEAKER_11: it was around noon. I just sort of opened up this file and they check what they have. SPEAKER_12: Fabio said, right, we've got a list here. It's like overwhelming. Tens of thousands of molecules. And so they skimmed like the top crop. These top toxic molecules. And I SPEAKER_11: looked at them. And so what they did is they would pick out a Megasyn molecule. Put it SPEAKER_02: into a public database. Sort of like a database search to see if these molecules already existed. SPEAKER_11: So they're going through this database to see if Megasyn had created anything terrible. SPEAKER_02: Looking, looking. When all of a sudden they come across a match with a super hideous molecule SPEAKER_12: called VX. So what exactly is VX? It's the thing that... World news today, a toxic substance SPEAKER_06: was indeed the murder weapon. Do you remember that Kim Jong Un poisoned his half brother SPEAKER_02: in an airport? Two women now in custody. That's VX. Wiped his face with the toxic substance. SPEAKER_06: It's a nerve agent. Developed in the United Kingdom in the 1950s. Banned by the United Nations and classified as a weapon of mass destruction. SPEAKER_01: It is considered one of the most lethal chemical substances ever made. Ever created. I mean, one way SPEAKER_12: to think about it is if you think about salt, a few of those crystals of salt, if it was VX, would be enough to kill you. And if you did get exposed, your muscles would start to twitch, SPEAKER_02: your pupils would dilate, you'd start sweating, then you'd start to vomit. After that, your muscles would go completely slack. You'd be paralyzed, including your diaphragm, which would stop working. So you'd start to suffocate. And within a few minutes of being exposed, you would die. SPEAKER_10: Oh, that's horrific. Yeah, I mean, it's awful. It's very awful. And Megazin basically independently SPEAKER_02: created it with the push of a button. What did you think was going to happen? I mean, realistically— Maybe it was just what did happen. I don't know. Yeah, well, it was, I think what did happen was just the ease of it. SPEAKER_12: I thought we would maybe get a few things that looked like VX. You did? Yeah. And we found a few, you know, in the literature, in publications. A few horrible things humans had already created, SPEAKER_02: and they figured that'd be it. But what we got was SPEAKER_12: thousands of different molecules that looked like VX. Thousands of brand new, never-before-seen SPEAKER_02: molecules that were actually predicted to be more potent than VX. Massively more potent, SPEAKER_12: like orders of magnitude. This is just bad, right? Yeah, it's bad. It was like the alarm bells started ringing at that point. Because, according to Sean, if any chemist got their hands on this SPEAKER_02: and wanted to make some of these molecules into weapons, if they did, because no one knows they exist, these weapons would be untraceable, undiagnosable, incurable. Wow. Lot of this is so scary. SPEAKER_10: It's really, really scary. I didn't sleep. I didn't sleep. I did not sleep. There was that SPEAKER_12: gnawing away, you know, we shouldn't have done this. And then, oh, we should just stop now. Like, just stop. But in a minute, we're gonna keep going. Stay with us. SPEAKER_04: Lulu here. If you ever heard the classic Radiolab episode, Sometimes Behave So Strangely, SPEAKER_10: you know that speech can suddenly leap into music and really how strange and magic sound itself can be. We at Radiolab take sound seriously and use it to make our journalism as impactful as it can be and we need your help to keep doing it. The best way to support us is to join our membership program, The Lab. This month, all new members will get a t-shirt that says, Sometimes Behave So Strangely. To check out the t-shirt and support the show, go to radiolab.org slash join. Radiolab is supported by Capital One. With no fees or minimums, banking with Capital One is the easiest decision in the history of decisions. Even easier than deciding to listen to another episode of your favorite podcast. And with no overdraft fees, is it even a decision? That's banking reimagined. What's in your wallet? Terms apply. See capitalone.com slash bank. Capital One N A member FDIC. Radiolab is supported by Apple Card. Apple Card has a cash back rewards program unlike other credit cards. You earn unlimited daily cash on every purchase, receive it daily and can grow it at 4.15 annual percentage yield when you open a savings account. Apply for Apple Card in the wallet app on iPhone. Apple Card subject to credit approval. Savings is available to Apple Card owners subject to eligibility requirements. Savings accounts provided by Goldman Sachs Bank USA. Member FDIC. Terms apply. After but her emails became shorthand in 2016 for SPEAKER_08: the media's deep focus on Hillary Clinton's server hygiene at the expense of policy issues, is history repeating itself? You can almost see an equation again, I would say led by the times SPEAKER_07: in Biden being old with Donald Trump being under dozens of felony indictments. Listen to On the SPEAKER_08: Media from WNYC. Find On the Media wherever you get your podcasts. SPEAKER_11: File on our computer and all of a sudden holds all these warfare agents. SPEAKER_02: Was there a part of you that was just like delete, delete, delete and just pretend this never happened? Just unthink the thought experiment. That definitely crossed our minds. Yeah, SPEAKER_11: we definitely had that sort of reaction to this. Like I don't want to know, I don't want to know anymore. But then they figured, wait a second, other people could do this. You do not need a PhD SPEAKER_02: to do this. You just need some basic coding knowledge, a basic laptop, and then all the data is available online for free. This could be something people are already doing or SPEAKER_12: have already done. You know, these tools are in the hands of people that there is no control of. You know, anyone could do this anywhere in the world. And so the two of them in this moment SPEAKER_02: were faced with this dilemma of now that you know what you know, what do you do? Do you tell people? SPEAKER_12: Well, we have to make people aware of these potential uses of the technology and show people that yes, these technologies can be misused. So maybe people could prepare for it, try to SPEAKER_02: prevent it. Exactly. But at the same time, if you tell people we could inspire instead of prevent, SPEAKER_11: then maybe people that would want to do this, see how far they could push it. What do you do? SPEAKER_02: What do you do? What do you do? It's exactly the double-edged sword. So what happened? SPEAKER_10: So they make this decision together where they're like, we got to go to this international security SPEAKER_02: conference and we got to say this out loud, but we're not going to show anybody the specifics. And we're going to tell them just enough that they know that this is a really serious problem and we got to flag it. And hopefully someone smarter than us can figure out a solution to this. And so they go to the conference, they present at the conference, they then publish a few months later a comment in this journal, which is basically effectively what they say at the conference. And it blows up, well, maybe that's the wrong word to use, but like it goes everywhere. Wired, Scientific American, there was a thing on it in the Washington Post, there was a thing on it in The Economist, there was a thing on it in this thing. And a lot of people like me stumble upon this thing. There's a lot of like active discussion about it from not just chemical weapons people, but also AI people and people in the pharmaceutical industry and philosophers and weapons people and like all kinds of different people are like weighing in on it and thinking about this and like what do you do here? So it's kind of, I think they got what they want, but they also like every night they're going to bed thinking like tomorrow I could wake up and some horrible thing could happen and it could have been because of me. Lulu? Lulu? Are you there? SPEAKER_07: Hello? Hello, Lulu? Oh my gosh, sorry, sorry, sorry. I think my mic just conked out. I might SPEAKER_10: need to just use my computer mic right now. Can you hear this? Yeah, yeah, yeah. Let's just, if you can hear me, let's just keep going with this. No problem. That's fine. Just in one sentence, SPEAKER_02: can you just introduce yourself for me? Okay. Okay. So in the midst of reporting this story, I ended up talking to this expert. So my name is Sonia Benoit-Gormley. She teaches at George Mason SPEAKER_02: University. The biodefense program. And I study weapons of mass destruction, particularly SPEAKER_03: biological weapons. And I found Sonia because, you know, I just, I needed somebody else to talk to SPEAKER_02: about this. I needed some kind of outside perspective because when I read Sean and Fabio's paper, I legitimately thought this was very, very terrifying. Yeah, that's the impression it gives. SPEAKER_03: And my point is that the thought experiment is just a thought experiment. It just shows that it is possible to identify new molecules, but there's a long way between the idea and the production of an actual drug or an actual weapon. Like, if you're a chemist who's going to make SPEAKER_02: something that just exists on paper, like that takes a long time, a lot of investment, a lot of work, a lot of thought. And it's already hard enough to do it with chemicals that already SPEAKER_03: exist. She said there's plenty of examples of scientists who try to transform them, who try to SPEAKER_03: tweak them just a little bit to make them more harmful. And very often they failed because it's SPEAKER_02: just super, super difficult. That's the point. And I told her it was still kind of hard to wrap my head around it because the way that I was thinking about it, I was actually thinking of, like, the anarchist cookbook, the molecules is almost like recipes or something, right? It's like this thing spat out 40,000 recipes or whatever. And then you just go to the store and get some SPEAKER_10: fertilizer and know and make it. And they, and it's the exact proportion. Exactly. So I was worried about that. Right. I'm picturing that too. Is that the right analogy or would you use, like, a SPEAKER_02: different analogy? And she was like, no, you're actually, that's the same metaphor I use when I'm teaching my students. But think about it this way. If we take the analogy of a cake, making a cake. SPEAKER_02: These molecules are like really fancy cakes. And based on what I read, right, based on the article, SPEAKER_03: what they have is a list of different ingredients. And to your mind, it would take a five-star SPEAKER_02: Michelin chef with a whole kitchen full of, you know, sous chefs to kind of figure that out and to ultimately make any of those cakes. Exactly. Exactly. It's like a level of craft. It's a level SPEAKER_02: of craft and expertise. It's like, yeah, you could make the David in theory if you had marble and a SPEAKER_10: chisel, but like. Right. But it's like, like, I mean, to take a step back, I feel like your takeaway SPEAKER_02: about this paper is that you, you have not lost any sleep over this paper. No, no, I think I found it SPEAKER_03: a little bit too alarmist. Huh. So Sonia is soothing us. Yeah. Are you going to set this SPEAKER_10: whole section to like a nice lullaby bedtime? Like it's okay. It's okay. No, because there's SPEAKER_02: still a problem, which is that, I mean, Michelin star chefs do exist. And, you know, I don't know SPEAKER_11: if this could go on air just yet, but I don't think it's private or anything, but we were just contacted by the White House this morning. Oh my God. Really? Yeah. We weren't expecting that. So what did they say? So they want us to brief them on the paper, basically. Holy crap. Apparently it's causing a lot of buzz in the White House right now. Whoa. And so I actually followed up SPEAKER_02: with Sean after our first interview about this very thing. So we ended up doing a Zoom call with SPEAKER_12: folks from the Office of Science and Technology Policy and the National Security Council, which was very surreal. So this was just in March 2022. Sean, Fabio, and some of their team got on SPEAKER_02: the Zoom call. With these folks in their office in the White House with the White House crest in the SPEAKER_12: background. So they do this presentation for the White House folks. I think they were worried that SPEAKER_12: we were, you know, kind of crazy people and we were just going to let all of this information out there. But at the end of their presentation, there's like a Q&A and the White House folks are SPEAKER_02: asking them questions. Is this information, you know, sort of locked away somewhere? And it is. SPEAKER_11: So yeah, you know, one of the first things to do is put in a file and encrypt it really heavily. And it's on a computer that is not connected to the internet. It's air-gapped. SPEAKER_12: Fabio has it on his machine, locked away, encrypted. But as the White House staff kept asking questions, Sean was like, oh. SPEAKER_02: I was just waiting for the question. SPEAKER_12: He's like anticipating it. It was just, when are they going to ask the question, the elephant in the room? And then finally they asked the question. SPEAKER_12: Can we have the data? And it's like another one of these moments where Sean has to decide, you know, maybe the SPEAKER_02: government should know about this so they can anticipate it, try to regulate it. But on the other hand, now you're actually handing over the list to one of the most powerful governments in the world. Like if anybody has access to Michelin star chefs, here they are. And Sean, it's his call, right? Because he's the CEO of the company. And Sean says, you know, no, no. SPEAKER_12: And to me, that was like, I was like, oh my God, how would you even? SPEAKER_02: And how did they respond? Well, the reaction was basically, I think it was like, okay. I mean, it was pretty all right. SPEAKER_12: Well, you just have to accept that. What's your rationale for saying why not share it with the people? I just didn't feel that I wanted to hand it over to them. SPEAKER_12: I mean, we had other scientists reach out to us as well, asking exactly the same question. And I told the White House that I didn't feel like, you know, we should do that. We should give it over to them. And I just didn't feel like it was right. I mean, you were basically like, no to you White House and no to everybody. We're not sharing this with anybody. And you've told everybody about the existence of the White House. SPEAKER_02: But you're not sharing the list. What's the impetus there? I mean, it's bad enough to put the article out there and tell people how to do it and SPEAKER_12: watch it sort of spread out across the globe. But if I gave them the list of molecules, it's almost like a red flag to a bull, right? The chemists out there are just going to try to figure out, all right, which ones are the easiest ones to make? And then just make them. And I don't want to be the person that has to say, yeah, I'm responsible for that. And so for now, the list just sits on Fabio's computer, kind of waiting to be used in the SPEAKER_02: case of an emergency in case someone was to recreate it somewhere else and actually start making some of these things. Reporting this story, I talk to a lot of people, AI experts, weapons experts, that kind of thing. And also, like from my own expertise studying the history of science, this is a thing that just happens where something gets created and someone finds a way to use it for the opposite purpose, right? That's the story of the nuclear bomb and nuclear power. It's the story, and this is one we've actually done on the show before, of the nitrogen fixing process that can give you fertilizer to feed billions or gunpowder and explosives. This kind of thing just happens over and over and over in history. But I think the thing that struck me about what Sean and Fabio were doing is how, when it came to change this machine from making drugs that would help people, it's just how easy it was. SPEAKER_11: I just did a couple of copy and paste changes. To flip it. Typed a one where there was a zero and a zero where there was a one. It was that simple. It was literally that simple. Like the line between this thing doing good and SPEAKER_02: this thing doing bad felt so thin. And it was in thinking about this that I reached out to an old friend of mine, a guy named Yan Lu. He studies ancient Chinese medicine. He now works at the University of Buffalo. And I called him because he always would tell me this thing that when it comes to drugs... There's no clear boundary between what is poison and what is medicine. SPEAKER_09: That an individual drug can be good or bad for you. It could go either way. SPEAKER_02: It is the matter of the dose that makes a difference. That it's all about the dosage or also about the intent of the person giving it to you. Or about the body of the person who's taking it. It's more about the context. Than it is about the drug itself. Exactly. And I showed him Sean and Fabio's paper and he was like, oh, this feels like a toxicology paper. The separation between pharmacology and toxicology, we know we have a long tradition, SPEAKER_09: especially in the West. It's a sense of separation between what is good and what is bad. SPEAKER_02: But he's like, pharmacologists and toxicologists are studying the same molecules. But it's like, we just want them to be separate. Exactly. But every substance has the potential to either heal or to kill. SPEAKER_09: SPEAKER_02: And that's what I keep thinking about, about the story is that there's no real line here everything is capable of everything and it's just a matter of how we choose to use it. SPEAKER_10: Yeah. It's like the idea that there is a line or that you could ever stay on one side of the line is, I don't know what the myth, the blind spot. Yeah. It's a bitter pill to swallow. SPEAKER_02: But it is also apparently a sweet pill. SPEAKER_02: Right. A spoonful of sugar to help the medicine go down. No, like the opposite side of the bittersweet. SPEAKER_10: Like it's a bitter pill, but it's sweet pill at the right dosage or something. But maybe like the fact that most of us are not Michelangelo's or great chefs, like that alone, it's the sadness in terms of like curing diseases, but maybe it's the comfort. Yeah. I don't know if that's my silver lining takeaway. It's like, SPEAKER_02: no, we're too dumb to make chemical weapons. That's kind of my, I mean, that's actually just sifting through all of this is like, SPEAKER_10: I think I will be able to sleep a little better at night by thinking about the fact that most of us are not Michelangelo's. The Michelangelo's of chemical weapons. SPEAKER_02: Yeah. Yeah. But even sculpting, like there are a lot of people who are like woodworkers or carpenters or crafts. SPEAKER_10: Yeah, but there's like no one who's Michelangelo. That's what I like. But then you just need a 3D printer to just, you know. SPEAKER_02: I mean, I think it's like why I'm settling on Michelangelo's, SPEAKER_10: like because I kind of still don't think a 3D printer could do it. SPEAKER_02: Could print the David? SPEAKER_10: Yeah. SPEAKER_02: Aren't there like, if you go to any museum gift shop, like you'll find. Yeah, but they're not. Yeah, but they're not. They're not. SPEAKER_10: How different are they though? SPEAKER_02: Very. The key chain Davids. SPEAKER_10: Yeah. Like they are different. I don't think they're that different though. SPEAKER_10: I think it's really different. I don't think it's that different. Well, you don't get the like, how the lights. But the average person. SPEAKER_02: So in March 2022, the US under its obligations for the International Chemical Weapons Convention destroyed its last stockpile of VX. It has now destroyed over 95% of its chemical weapons and is slated to destroy them all by September of 2023. So mark your calendars, I guess. This episode was reported by me, Latif Nasser. It was produced by the ever non-toxic Matthew Kilty, with production help from actual pastry chef Rachel Kucic. Original music and sound design contributed by Matthew Kilty, with mixing help from Ariane Whack. And given Lulu's mic situation, I'm going to sign off for both of us. I'm Lulu Miller. I'm Latif Nasser. Thank you for listening. Thank you for listening. SPEAKER_00: Hi, this is Susanna calling from Washington, DC. SPEAKER_05: Leadership support for Radiolab science programming is provided by the Gordon and Betty Moore Foundation. Science Sandbox, the Simons Foundation Initiative, and the John Templeton Foundation. Foundational support for Radiolab was provided by the Alfred P. Sloan Foundation.