How AI will step off the screen and into the real world | Daniela Rus

Episode Summary

At the TED 2024 conference, AI and robotics pioneer Daniela Rus discussed the integration of AI with physical objects, drawing inspiration from nature to push the boundaries of technology. Rus, who leads MIT's Computer Science and AI Lab, highlighted the traditional separation between AI and robotics, with AI confined to digital spaces and robotics handling physical tasks without inherent intelligence. She introduced the concept of "physical intelligence," where AI extends beyond screens to interact with the physical world, enhancing robots' capabilities by integrating data-driven knowledge. Rus explained that achieving physical intelligence requires rethinking machine design and learning processes, emphasizing the need for compact, error-free computational systems. She introduced "Liquid Networks," a new AI approach inspired by the simple neural structure of the C. elegans worm, which uses a minimal number of neurons to function effectively. This model allows for smaller, more understandable AI systems that continue to adapt and learn from their environment post-training, unlike traditional AI. The practical applications of this technology are vast, from rapid prototyping and testing new products to teaching robots to perform complex tasks through human demonstration. Rus's lab has developed systems that can convert text to robot designs and images to physical robots, streamlining the creation process and enabling a faster innovation cycle. This capability, combined with liquid networks, could lead to the development of intelligent machines that learn from and assist humans in everyday tasks, potentially transforming industries and daily life. Rus concluded by emphasizing the transformative potential of physical intelligence to extend human capabilities and improve life on Earth. She called for collaborative efforts to develop and utilize this technology responsibly, underscoring the importance of guiding AI development to ensure beneficial outcomes for humanity and the planet.

Episode Show Notes

The convergence of AI and robotics will unlock a wonderful new world of possibilities in everyday life, says robotics and AI pioneer Daniela Rus. Diving into the way machines think, she reveals how "liquid networks" — a revolutionary class of AI that mimics the neural processes of simple organisms — could help intelligent machines process information more efficiently and give rise to "physical intelligence" that will enable AI to operate beyond digital confines and engage dynamically in the real world.

Episode Transcript

SPEAKER_02: TED Audio Collective. You're listening to TED Talks Daily.I'm your host, Elise Hu.We are on the ground at the TED 2024 conference, and one topic has dominated our time here.AI and robotics pioneer Daniela Roos is one of the people doing really visionary stuff in this space by bringing AI systems to physical objects and taking her inspiration from nature.She explains coming up after a short break. Thank you so much for having me. Choose from over 40 themes.Buy all the stocks in a theme as is or customize to better fit your investing goals.All in a few clicks. Schwab Investing Themes is not intended to be investment advice or a recommendation of any stock or investment strategy.Learn more at schwab.com slash thematicinvesting. Ted Talks Daily is brought to you by Progressive.Progressive helps you compare direct auto rates from a variety of companies so you can find a great one, even if it's not with them.Quote today at Progressive.com to find a rate that works with your budget.Progressive Casualty Insurance Company and Affiliates.Comparison rates not available in all states or situations. SPEAKER_01: Canva presents Unexplained Appearances.It was an ordinary workday until... That presentation appeared out of thin air.Also, it's eerily on brand.Wait, did that agenda just write itself?Words appear, making this unexplainable case... Unexplainable?It's Canva's AI tools.I can generate slides and words in seconds.Really?The real mystery is why I'm only learning this now.Canva.com. Designed for work. SPEAKER_00: When I was a student studying robotics, a group of us decided to make a present for our professor's birthday.We wanted to program our robot to cut a slice of cake for him.We pulled an all-nighter writing the software.And the next day, disaster. We programmed this robot to cut a soft, round sponge cake, but we didn't coordinate well.And instead, we received a square, hard ice cream cake.The robot flailed wildly and nearly destroyed the cake.Our professor was delighted anyway.He calmly pushed the stop button and declared the erratic behavior of the robot a control singularity, a robotics technical term. I was disappointed, but I learned a very important lesson. The physical world, with its physics laws and imprecisions, is a far more demanding space than the digital world.Today, I lead MIT's Computer Science and AI Lab, the largest research unit at MIT, where I work with brilliant and brave researchers to invent the future of computing and intelligent machines. Today, in computing, artificial intelligence and robotics are largely separate fields.AI has amazed you with its decision-making and learning, but it remains confined inside computers.Robots have a physical presence and can execute pre-programmed tasks, but they're not intelligent. Well, this separation is starting to change.AI is about to break free from the 2D computer screen interactions and enter a vibrant physical 3D world.In my lab, we're fusing the digital intelligence of AI with the mechanical prowess of robots.Moving AI from the digital world into the physical world is making machines intelligent and leading to the next great breakthrough, what I call physical intelligence. Physical intelligence is when AI's power to understand text, images and other online information is used to make real-world machines smarter. This means AI can help pre-programmed robots do their tasks better by using knowledge from data. With physical intelligence, AI doesn't just reside in our computers, but walks, rolls, flies and interacts with us in surprising ways.Imagine being surrounded by helpful robots at the supermarket.To make it happen, we need to do a few things.We need to rethink how machines think.We need to reorganize how they are designed and how they learn. So for physical intelligence, AI has to run on computers that fit on the body of the robot.For example, our soft robot fish.Today's AI uses server farms that do not fit.Today's AI also makes mistakes. For physical intelligence, we need small brains that do not make mistakes.We're tackling these challenges using inspiration from a worm called C. elegans. In sharp contrast to the billions of neurons in the human brain, C. elegans has a happy life on only 302 neurons.And biologists understand the math of what each of these neurons do.So here's the idea.Can we build AI using inspiration from the math of these neurons? We have developed, together with my collaborators and students, a new approach to AI we call Liquid Networks.And Liquid Networks results in much more compact and explainable solutions than today's traditional AI solutions.Because these models are so much smaller, we actually understand how they make decisions.So how did we get this performance? Well, in a traditional AI system, the computational neuron is the artificial neuron, and the artificial neuron is essentially an on-off computational unit.It takes in some numbers, adds them up, applies some basic math and passes along the result.And this is complex because it happens across thousands of computational units.In liquid networks, we have fewer neurons, but each one does more complex math.Here's what happens inside our liquid neuron. We use differential equations to model the neural computation and the artificial synapse.And these differential equations are what biologists have mapped for the neural structure of the worms. We also wire the neurons differently to increase the information flow.Well, these changes yield phenomenal results.Traditional AI systems are frozen after training. That means they cannot continue to improve when we deploy them in the physical world, in the wild.We just wait for the next release. Because of what's happening inside the liquid neuron, liquid networks continue to adapt after training based on the inputs that they see.We train traditional AI and liquid networks using summertime videos, and the task was to find things in the woods.All the models learn how to do the task in the summer.Then we try to use the models on drones in the fall.The traditional AI solution gets confused, cannot do the task. Liquid networks do not get confused by the background and very successfully execute the task.So this is it.This is the step forward. AI that adapts after training. Liquid networks are important because they give us a new way of getting machines to think that is rooted into physics models, a new technology for AI.We can run them on smartphones, on robots, on enterprise computers, and even on new types of machines that we can now begin to imagine and design, the second aspect of physical intelligence. So by now, you've probably generated images using text-to-image systems.We can also do text-to-robot, but not using today's AI solutions because they work on statistics and do not understand physics. In my lab, we developed an approach that guides the design process by checking and simulating the physical constraints for the machine.We start with a language prompt, make me a robot that can walk forward, and our system generates the designs, including shape, materials, actuators, sensors, the program to control it and the fabrication files to make it. And then the designs get refined in simulation until they meet the specifications.So in a few hours, we can go from idea to controllable physical machine. We can also do image to robot. To do so, our algorithm computes a 3D representation of the photo that gets sliced, unfolded, printed.Then we fold the printed layers with string sum motors and sensors.We can use this approach to make anything, almost, from an image, from a photo. So the ability to transform text into images and to transform images into robots is important because we are drastically reducing the amount of time and the resources needed to prototype and test new products.And this is allowing for a much faster innovation cycle. And now we are ready to even make the leap to get these machines to learn the third aspect of physical intelligence. These machines can learn from humans how to do tasks.You can think of it as human to robot.In my lab, we created a kitchen environment where we instrument people with sensors, and we collect a lot of data about how people do kitchen tasks.We need physical data because videos do not capture the dynamics of the tasks, so we collect muscle, pose, even gaze information about how people do tasks. And then we train AI using this data to teach robots how to do the same tasks.And the end result is machines that move with grace and agility, as well as adapt and learn physical intelligence.We can use this approach to teach robots how to do a wide range of tasks, food preparation, cleaning and so much more. The ability to turn images and text into functional machines, coupled with using liquid networks to create powerful brains for these machines that can learn from humans, is incredibly exciting, because this means we can make almost anything we imagine.Today's AI has a ceiling.It requires server farms.It's not sustainable.It makes inexplicable mistakes.Let's not settle for the current offering. When AI moves into the physical world, the opportunities for benefits and for breakthroughs is extraordinary. You can get personal assistants that optimize your routines and anticipate your needs, bespoke machines that help you at work, and robots that delight you in your spare time. The promise of physical intelligence is to transcend our human limitations with capabilities that extend our reach, amplify our strength and refine our precision, and grant us ways to interact with a world we've only dreamed of.We are the only species so advanced, so aware, so capable of building these extraordinary tools. Yet developing physical intelligence is teaching us that we have so much more to learn about technology and about ourselves.We need human guiding hands over AI sooner rather than later.After all, we remain responsible for this planet and everything living on it. I remain convinced that we have the power to use physical intelligence to ensure a better future for humanity and for the planet.And I'd like to invite you to help us in this quest.Some of you will help develop physical intelligence.Some of you will use it. And some of you will invent the future.Thank you.