Exploring AI's Pace of Evolution, AGI's Future, and Data Dominance with Adept CEO David Luan | E1855

Episode Summary

David Luan, the CEO and co-founder of Adept AI, joins the podcast to discuss the pace of AI evolution and the future of artificial general intelligence (AGI). Luan has an impressive background, having previously worked at OpenAI leading teams working on key language models like GPT-2 and DALL-E. At OpenAI, Luan and his colleague Alec Radford came up with the key insight behind GPT-2 - that natural language understanding tasks could be reframed as simply generating more text. So instead of training multiple specialized models, GPT-2 used Reddit links with over 3 upvotes to create a single large language model trained on high quality data. Luan explains how access to clean, high quality data is becoming the number one bottleneck as models get larger. Luan left OpenAI to focus on developing Adept AI, which aims to create AI agents that can handle arbitrary work tasks and workflows beyond just reading and writing. The key is training models that deeply understand the pixels on screen and can take reliable actions to achieve goals. Adept has enterprise customers where they customize models to accelerate knowledge work, but also just launched Adept Experiments which lets anyone try automating workflows themselves. They are seeing early customers use Adept to cut workflow times in half or reduce errors. Luan expects Adept's capabilities to continue expanding so it can handle higher-level planning and brainstorming, essentially acting as an AI teammate. He thinks interacting with agents that learn from world-class knowledge workers is the path to achieving general intelligence. Luan optimistically predicts conversational AGI that can advise high-level decisions will arrive in under 5 years, though it may take longer for the advice to be fully trusted.

Episode Show Notes

This Week in Startups is brought to you by…

Brave. If you’re building AI and search-based applications, train your models with the Brave Search API. Get started for free at brave.com/jason

Arising Ventures is a holding company that acquires tech startups facing setbacks. Arising Ventures knows what founders care about because they aren’t bankers, they are tech founders themselves! Go to ⁠http://www.arisingventures.com/TWIST

LinkedIn Jobs. A business is only as strong as its people, and every hire matters. Go to http://www.LinkedIn.com/TWIST to post your first job for free. Terms and conditions apply.

Today’s show:

Adept Co-Founder and CEO David Luan joins Jason to discuss his experience at OpenAI (2:45), demo Adept's AI-powered workflow builder (13:47), what facets of AI he is most excited about, what keeps him motivated (32:33), and more!

*

Timestamps:

(0:00) Adept founder and CEO David Luan joins Jason.

(2:45) David's experience at OpenAI and the evolution of deep learning

(5:22) DALL-E origins and its "a-ha moment"

(9:24) The next great well of AI training data

(11:21) Brave - Try the Brave Search API at http://www.brave.com/jason

(12:35) Adept's Northstar since day one

(13:47) Demos: showcasing the power of Adept AI

(15:52) The next battlefield for AI

(18:34) A look into Adept AI Experiments – a sandbox for AI enthusiasts

(20:46) Arising Ventures - head to ⁠http://www.arisingventures.com/TWIST to learn more and connect with the team

(21:51) How Adept aims to streamline job processes

(24:54) Strategies to outperform large competitors

(31:13) LinkedIn Jobs - Post your first job for free at http://www.LinkedIn.com/TWIST

(32:33) What excites David about the future and motivates his daily efforts?

(36:29) The present and expected advancements in AI

*

Subscribe to This Week in Startups on Apple: https://rb.gy/v19fcp

*

Check out Adept AI:  https://www.adept.ai

Check out Adept AI Experiments: https://www.adept.ai/blog/experiments

*

Follow David: https://twitter.com/jluan

https://www.linkedin.com/in/jluan

*

Follow Jason:

Twitter: https://twitter.com/jason

Instagram: https://www.instagram.com/jason

LinkedIn: https://www.linkedin.com/in/jasoncalacanis

*

Thanks to our partners:

(11:21) Brave - Try the Brave Search API at http://brave.com/jason

(20:46)  Arising Ventures - head to http://www.arisingventures.com/TWIST to learn more and connect with the team

(31:13) LinkedIn Jobs - Post your first job for free at http://www.LinkedIn.com/TWIST

*

Great 2023 interviews: Steve Huffman, Brian Chesky, Aaron Levie, Sophia Amoruso, Reid Hoffman, Frank Slootman, Billy McFarland

*

Check out Jason’s suite of newsletters: https://substack.com/@calacanis

*

Follow TWiST:

Substack: https://twistartups.substack.com

Twitter: https://twitter.com/TWiStartups

YouTube: https://www.youtube.com/thisweekin

*

Subscribe to the Founder University Podcast: https://www.founder.university/podcast

Episode Transcript

SPEAKER_02: how far away are we from AGI in your mind? I turn on my computer in the morning, I go to work, you know, whatever I happen to name my assistant Joe and I say, Hey, Joe, what should I work on today? And Joe says, Well, you know, looking at your email box, there's seven companies that have acute issues in your portfolio. And these three probably require a phone call these for you probably need some more information based on what I've learned. So I'm going to send them requests for this information and then schedule them for tomorrow on Wednesday. Is that okay? And it just like, kind of tells me what I'm doing for the next two days. When will that happen? I was gonna ask you how you're gonna define AGI. And if you SPEAKER_01: define AGI by just what you said in that flow, I think that we'll be at a spot where you will be able to get that within the next one to two years. But what would you trust the recommendations? SPEAKER_00: This Week in Startups is brought to you by brave. If you're building AI and search based applications, train your models with the brave search API. Get started for free at brave.com slash Jason. Arising Ventures is a holding company that acquires tech startups facing setbacks. Arising Ventures knows what founders care about, because they aren't bankers. They're tech founders themselves. Go to arising ventures.com slash twist today to learn more and connect with the team and LinkedIn jobs. A business is only as strong as its people and every hire matters. Post your first job for free at linkedin.com slash twist. Everybody, welcome back to this week and startups. We're SPEAKER_02: continuing our in depth coverage of AI. It's moving at a crazy pace. And you're in for a treat today because we have David Lujan, who is the CEO and co founder of adept AI. Previously, David ran research and engineering at a little organization known as open AI back in 2017. He left there to go work on large models at Google, where he focused on Google Brain. And if you're wondering what adept AI is, we're gonna learn all about that today. But basically, they're building a machine learning model that can interact with everything on your computer. Welcome to the program, David. SPEAKER_01: Thanks so much for having me. SPEAKER_02: Okay, so you are not the highest profile person at open AI. But you were a very key person. Maybe you could explain by background what you worked on at open AI because it's pretty darn impressive. SPEAKER_01: Thanks. So my time at open AI was really engaging and fun. I knew a bunch of the core researchers there from just the very tiny machine learning research community from back in the day. Like the analogy I always like to make about how ML used to work is, is imagine a world where the flat earthers toiled in obscurity for decades, and then turned out to be right. That's basically the story of deep learning. And, and that's so that community of deep learners actually pretty small. And I joined with opening I was about 35 people, and ultimately grew it about 135 before I left. And primarily, folks in my org covered basic research. So things like up to and clip and Dolly, all the way to the supercomputers and some of the larger some of the larger scale up efforts there as well. SPEAKER_02: So when you were building those language models, and maybe you could talk a little bit about what they were trained on. I know there were collections of data sources, like there's the open crawl of the web, there are image libraries that were put together, how was that original data set organized when you were in that, like two and three phase. SPEAKER_01: So the thing about GPT two that I think most people don't recognize as being two of its core contributions. The first one is actually not data set related, but just real quick, it's this idea that every single natural language understanding task could be reframed as simply writing more text. So historically, people were training these models for like sentiment analysis of tweets and all stuff. And you're training a model of the input is the tweet and the output is a score of as a positive or negative, then you just end up with this constellation of models that all do different things. But GPT two said we can just boil this all down to one objective was just like write more text and the next word is, is it a positive or negative tweet and you get it right. And the reason why that works is actually because of the data set. So historically, people training language models use things like common crawl, as you mentioned, which is like effectively like it was initially made for making open search engines, right? It's just all the websites you can find on the internet. But most of them are trash. Like we looked at my colleague, Alec Radford, who's a lead author, and I like looked at all the data, and there would just be web pages and web pages of 1000s of product codes for Sony cameras and stuff like that. And the core insight that Alec had was that we actually live in a world where the open internet has given us these amazing tells as to whether or not an underlying web pages is smart or not. And that's called Reddit. So what he did was he scraped Reddit and found every single Reddit URL that linked to an outbound blog post or website or whatever, that had more than three upvotes and said, well, three humans said this thing was good, therefore, it's probably pretty useful. So then we so a human powered search engine, Mahalo was the core here SPEAKER_02: you you used humans directing to or what you assume is humans, right? Yeah, could be some scam or bots. But generally speaking, it sounds like a really good idea. And you use the three vote mechanism to filter it even further. And so then you scrape those pages, you build the language model, SPEAKER_01: and that's what powered gpt two. And that's why gpt two, despite today looking tiny, was so smart for its time. SPEAKER_02: Fascinating. And then what about Dolly and all the images, I know stable diffusion, there was built off of some collection of images that a lot of researchers use. So maybe you could speak to those collections of images and, and how that all work. SPEAKER_01: So Dolly was interesting on the data set side, there was actually not as much. There was not as much sort of this is not to discredit Dolly to Dolly at all Dolly is an amazing project, but but the intelligence didn't come from the data set side, actually came from this fascinating thing where this guy did to Ramesh, who's an awesome researcher at open AI, he came up with this special trick that let you predict discrete codes that correspond to images, even when theoretically, you should only be able to predict continuous one. So it's like a very niche fact. Dolly one architecture looks very different from the Dolly to architecture. But I actually say think that the Dolly one architecture was like particularly inspired and letting us do sophistication at that level way back in like 2019. SPEAKER_02: And so where did the images come from? And how did that work? I'm curious. Yeah, just there was, I'm actually not sure how much I can SPEAKER_01: talk about exactly where those images were sourced. Yeah, but there was there was we also licensed some data sets, which also made it easier. SPEAKER_02: Ah, so I guess there there is a little controversy there of like training of data sets, which just generally speaking, not talking about your time at opening AI and specific use cases. A lot of models that are being built on hugging face a lot of open source models. They just crawl the open web, and they're trained on whatever it can find. Yeah, SPEAKER_01: a lot of the open source models are built that way. Yeah, it's like hackers trying their best to get their hands on whatever. SPEAKER_02: And if they get it in their minds, totally fine. Let's build the model. The challenge has become once it becomes a corporate entity, like open AI, or the stable diffusion corporation, which is called stability, stability, yeah, then all of a sudden, the lawsuits come out and people are like, hey, you trained my model with this. So maybe you could speak to what that means in terms of how this will all play out with regard to such such an interesting rabbit hole, where that will all work out in terms of an advantage. So if you do this as part of open AI, with Microsoft as a partner, those are two very big targets, a $90 billion company, a trillion plus valued company is a big target for lawsuits. And then stability, obviously raised tons of money that makes it another big target. But open source, who are you going to target a bunch of open source, you know, handles that, you know, may or may not have built this stuff. So is that going to give like this huge advantage to the open source community? SPEAKER_01: I actually think a lot of the players in the open source community have been very buttoned up and forthright about how they're handling a lot of this stuff. So if you see some of those models are actually explicitly licensed under a Creative Commons non commercial license, okay, there are ways in which people recognize that, you know, some of this data actually should not be used for commercial purposes. And, and the people who are then breaking the rules are then going downstream of these models that were actually in fact, trained relatively responsibly. I think what's interesting right now is we're moving towards a phase where, where with the public internet closing down a little bit, everyone building their own walled gardens, like the platforms like Twitter, etc, making it harder to for models to be trained off of. Plus, this like increasing fragmentation in the internet ecosystem between the West and like the Chinese internet ecosystem, I actually think that access to trainable clean data is going to be the number one problem, right? You make these models bigger, every time you make them two x larger, you need to scale the amount of training data by a similar multiplier. And people in the field are concerned will eventually run out of tokens or training data. That's why people are looking into can we learn from YouTube, right? But ultimately, the models are one fascinating properties models is that is that their maximum intelligence level, the way that LLM are being trained today, and LLM is maximum intelligence level is like really, really, really roughly rule of thumb, the maximum intelligence level of the smartest training data in the corpus. If you want to get better at stuff, you need to be learning from smarter and smarter behaviors from humans. SPEAKER_02: Got it. When you look out across the data sets that are out there, YouTube, pretty powerful, large data set with the transcripts, and you have images involved in it. But as you're saying, who knows the Providence copyright, all kinds of issues, Twitter, filled with a lot of bots, also kind of staccato, but very much up to date. So that's pretty cool. Then you have Reddit, which has been baking for a long time, you got things like Quora, which has been baking for a long time, lots of experts on it stack overflow. Where's the great wells if we looked at these like oil repositories, who's the Saudi Arabia, who's the UAE, who's the Norway, you know, Texas of having Venezuela, Canadian salt flats, walk us through like when you're when researchers and you know, people are building these things and building models where they say, Oh, this is the oil, this is the diamonds is the good stuff. To me, I think it all SPEAKER_01: depends what you want to do, right? And what the other companies building fun chatbots, like the meta characters, they character.ai, all that stuff, you're gonna want very different data than if you're doing what we're doing at adapt, which is how do we build, like enterprise systems that help you be more productive at work, right. And so, so for for us at adapt, the thing that we care about more than anything else, is how can we learn from the smartest knowledge workers in the world. And if you look at where the where the knowledge of the smartest knowledge workers in the world sits, it's actually never on the public internet. And because of that, I think for adapt to be able to build things that let any end user teach adapt a new skill at work in a very small amount of time. That's the kind of stuff that we really want to be learning from long term. SPEAKER_02: Yeah. Because what you do on your desktop or at your job is not published to the web. It might be in Slack, it might be in Microsoft Teams, it could be a notion, it could be in Coda, it could be in a Google, whatever that Google or a pod you're never gonna crawl that nobody would ever trust you if SPEAKER_01: you crawled back. Yeah. SPEAKER_02: Are you building the next great AI product? Well, if so, you know how expensive API's can be for their model training data. Training AI is pricey. That's a fact we all know it. So you have to try the brave search API. Yes, I am talking about brave the privacy browser that I am obsessed with Braves browser has 65 million users. Think about how much data that drives from brave search, which is the only global scale independent search index outside of big tech. And that index is available to anyone with the brave search API. The brave search API can power your chatbots and train your models inform answers to real time queries, and it will serve images, web results and even rich text snippets. The brave search API features an easy intuitive data structure and its data is populated by real human interaction, not web crawlers, all for a fraction of the cost of the major players. It's free for up to 2000 queries per month with paid plans for as little as a $3 CPM that's cost per thousand. So if you're building a next gen app or chatbots, you got to try the brave search API get started today brave.com slash Jason, Jason's brave. I like it. brave.com slash Jason and get the browser while you add it. It is awesome. It's also got a VPN built in. That's pretty cool. Why don't you show me what you're building at adapt AI labs and thanks for the little diversion down history land there. SPEAKER_01: Yeah, for sure. So first, let me tell you a little bit more about what we're up to and why I'm really excited about it. And then we can quickly flip through some some demos of a release we actually recently did last week. The North Star for adapt from day one actually has been that in the long term, the thing that'd be the most valuable thing to build for work is an AI agent that does much more than reading and writing and drawing images, but can actually handle for you, arbitrary work tasks and workflows, right. And those two things are very different, right? Like, reading and writing is not the ability for you to say be able to delegate your entire like payments process to a neural network. In the latter case, what you really want is you want a system that knows how to use all the software you already have on your computer as if it were you. And in order to get there, you need to train these models that deeply understand not just the text, but also the pixels on your screen, and also what actions lead to what outcomes in the world. And so we've been hard to work on this training this model that could do anything a human can do on a computer. And we've been building effectively a product that enables knowledge workers to arbitrarily delegate tasks to the system. Here's a quick demo example. In this case, let's say you're responsible paying invoices and you get your plumbing invoice, you fire up adapt, that pulls up the invoices all being done by the model right now pulls up the invoice, reads the pixels in this PDF realizes what it's about, store some interesting facts about this and then pulls up QuickBooks and then correctly enters who is the who is the payee rice of on plumbers like how did you pay what what category is this like and it realizes the category was never written in the PDF, but it realizes a plumbing invoice, so it should go into repairs and maintenance. And this task that you probably would have had to do like 10 or 20 times a day for your job, you show adapt how to do it once and now every time you get a new email invoice, you just fire up adapt and it handles this task for you. It's also where does the debt live? Is it in your system tray there? Or how SPEAKER_02: does it you know, intercept this coming in by via email because you have this invoice come in by email, you got to get paid, that you're in purchasing or accounting, boom, it needs to know. So was it just sitting there in the background running? SPEAKER_01: It lives as an overlay as an extension right now, but we'll soon release a desktop overlay as well. And so I think the key of this is we're not forcing you to use this brand new system. It's a helper for all the same workflows. Yeah, exactly. It's a co pilot. Yeah. So sitting gonna sit in the system tray, but right now it SPEAKER_02: sits in your browser window or browser window. Yeah. So you can delegate arbitrary tasks to it right now. SPEAKER_01: I'll show you it show you another example. It's actually a similar variant. But like, one of the most common things people do is people shuttle data back and forth between system A and system B. And a lot of a lot of knowledge worker jobs is just doing that like ad nauseam, right? We had a we're talking to some customers who their insurance agents have to go log on to five different software systems to be able to pull the requisite data to even get one quote done. And so this next example is one where you get an where you get an email from someone who's for filing a claim. And adapt basically, once you show that how to do it once automatically fills out all and populates all the forms involved there. You know, what's interesting about about adapt is that it's actually been a really easy way for us to start working on this, like what I think is gonna be the next battlefield of AI, right? So far, it's been about LLM. But I think what's what's coming up is it's going to be about multimodality, which is the ability to understand images. And it's going to be about building AI agents, because AI agents as defined as a model that could take a series of steps to achieve a goal is, I think, fairly clear to everybody in the field now the thing we have to get right to get like tremendous value out of these underlying smart systems. SPEAKER_02: Yeah, so agents, if we were to explain them, these were like wizards, I think, in the early Windows days, you would create a way you take a you would create either a wizard or a business process. And all this is done offshore business process outsourcing is a big part of this. Yeah, people send their accounting to India, they send their data entry to Manila, whatever it happens to be. And this is just taking that same concept. And instead of doing it with just brute force humans, offshored, millions of them working in lower income, or lower cost of living locations. The person who's in the US doing their desktop can just have it happen in seconds, huh? SPEAKER_01: So really easy way. Yeah. So our first step as a company is we've been working on some of these capabilities that let you as a worker every day, just delegate these tedious tasks. But where we're really going with us and what I'm and why what I'm excited about is being able to do tedious tasks is actually just a building block for what's even more valuable, which is effectively having an AI teammate that you can talk to at work, bounce ideas off of each other, get guidance that has the same context as you do, because it's, it's it's it sees all the same stuff on screen, and you're and, and you're what you do at your company and all that stuff. And then like helps you brainstorm and come up with the best ideas and maybe try some of them. And you're like, well, maybe this one's a little bit better. I think all of that lies on top of a foundation of being able to do arbitrary things, arbitrary, tedious things on your computer, which is close to having how close you to having this in market? Is this SPEAKER_02: like in beta somewhere? Are people using it yet? SPEAKER_01: Yeah. So, you know, what's been interesting this year is that is that the agent space has really suffered from reliability problems. We go look at the space as a whole, I think there was an information article about like the agent winter or something like that. It's because most of these systems, the ones built on top of GPT are like 60% accurate, like they work 60% of the time, one out of 10 times, maybe deletes half your records in Salesforce. And you're like, I can't use this at work. Yeah. And so with the depth, we spent the whole summer, unlike everybody else training our own foundation models in house that deeply understand the pixels on screen are tuned for generating actions. And that took us to a point where this fall, we now have actually very reliable agent models, once we have some custom fine tuning data per use case. So we're excited to announce there will be later an announcement about one of our really large first deployments. But we also actually last week took everything we built for enterprise customers, cut out the specific fine tuning that made them their stuff super accurate, and then just made it into a sandbox anyone can play with. And so this thing's called adapt experiments, you can check it out at adapt.ai slash experiments. And, and it's a it's a it's a super powerful first toy automation tool. Funny thing is actually this morning, someone sent me a post on Upwork hiring people who were experts in using adapt experiments to automate workflows. So it's already getting some very cool traction on the agent space now. SPEAKER_02: So the idea is, you're going to build this platform. But we as people operating businesses will make our own agents and for ourselves, or we're going to make agents and have the ability to publish them. Yeah, so our main as a company, we're actually very enterprise SPEAKER_01: focused. So we're currently doing larger engagements, where we just come in and work with a company and figure out how the adapt agents could just accelerate the knowledge work that's happening there. But this experiments framework that we made is an is an easy way for you or me or any of our friends to pick up and just try what it might be like to go automate something. SPEAKER_02: And then you can publish them and share them with people like check GPT is doing soon. Yeah, we'll soon be able to let you SPEAKER_01: share so far that didn't quite make the MVP. SPEAKER_02: And so that becomes a business model like an App Store in your mind. So if I am really good at accounting, I can kind of make these tools build the classifier engine for where it should live or whatever, and then publish it to the web and maybe share revenue with you. Is that part of the model? SPEAKER_01: It's not the focus of our model. The focus of our model is these like making enterprises really successful. But what's really interesting about what you just said, though, is that like, we hope that in an enterprise setting, you know, oftentimes, like custom knowledge is locked in some people's brains, right? This is one person, while at our company, that's like maybe three people that know how to configure this particular infrastructural dashboard. And they could just teach a depth how to do that and just publish that workflow to everybody at the company. So whenever that needs to be reconfigured, you just hit play on that. And it does it for you. So I'm excited about sharing in that setting. SPEAKER_02: All right, you've heard me talk about Arising Ventures a bunch recently, they are a holding company, they acquire tech startups that you are facing some headwinds, some setbacks, and they give these startups a second chance at life, which is awesome. So if you're going through some tough times right now, and you're trying to get back on solid footing, well, reach out to the team at Arising Ventures could be just what your startup needs to get back on track. They've helped companies like up counsel, up counsel, they took from burning a million a month and shrinking to profitable and growing and jive where they relaunched a shutdown company went from zero to 1 million in ARR in just five months. What a safe in fact, two saves. Listen, Arising Ventures knows what founders care about because they're not bankers. They are tech founders themselves. And they're here to help your startup get back on track. Learn how Arising Ventures can help give your company new life by visiting ArisingVentures.com slash twist today to learn more and connect with the team. That's Arising ventures.com slash twist. Your shortlist of ideal people to use this in the first couple of years is who operations people CEOs sales teams who who are you targeting first because obviously, there's many code copilots, you're not going to compete in that space, you're not going to beat, you know, GitHub or whatever. So who are you targeting? What jobs will become 30 4050% faster? SPEAKER_01: Yeah, we're really targeting right now operations. So like all those examples we showed earlier, processing invoices, dealing with tracking things, shuffling data from system A to system B, customer onboarding, all of this, like they're, they're areas where you just got 1000s of people who are spending their time, like instead of handling the higher level goals, just handling some of this low, this low level flow. And I think, like, the reason why we really want to do this is because I mean, like, so many of us spent half our waking hours at work, right? And if that time is like reinvested, not in not in more, more manual computer process stuff, but instead in like talking to customers or working on the next engineering project, I think it's a really big unlock, SPEAKER_02: you can move up the stack, I've been dealing with my investment team. And I'm saying like, I wonder what low level things we do every day, we could eliminate or outsource. So you know, really trying to figure out how do you automate it with AI? How do you delegate it, offshore workers tend to be the work from home remote workers in lower cost places? Or how do you deprecate it? So I call this my ADD framework, that I'm literally putting my company through automate, delegate, deprecate, look at everything you do every day. And then if you do that, well, then you could call a founder on the phone and have a conversation with them how things going or you could go to meet the next founder that we might invest in. So there's really something here, I think, in terms of you know, teams doing more with less or doing more important work. And that is super exciting. SPEAKER_01: Absolutely. I think it's like, you know, there's definitely both of those. But sometimes we're hearing from customers other value props I didn't even think about, right? Like, in the customer onboarding case, like adapt can help cut down even time to revenue, right, which is a metric, I never thought that the stuff we were doing would actually impact. SPEAKER_02: So time to revenue, hey, when we discover somebody could be a customer, and when we then go do this, go, you know, close them as a customer. So explain to me when you pitched folks, you raised a ton of money, hundreds of millions of dollars as AI companies have been apt to do now, when you pitched investors, the argument I would have is, hey, there are verticalized solutions. So HubSpot, Salesforce, Slack, notion, superhuman, they're all looking at, hey, emails coming in and superhumans looking at, how do we respond to this? And how do I draft your email? Outlook is doing that. Gmail's obviously doing that. So and then if you're a HubSpot, you're going to be I've seen Dharmesh all day long on Twitter talking about how he's automating HubSpot, it's going to go find you your next lead, it's going to craft content for you. So how are you going to do a better job versus verticalized at scale software companies? SPEAKER_01: And yeah, I think this is this is the key question. So I think the most interesting pattern that we've learned from just observing lots and lots of people do work is that they use a million different software tools every day as part of their job, right? The average knowledge worker uses something like 17 different software tools and the most powerful and crucial workflows to those organizations are usually ones that span those different tools. And so one, workflows that span different tools, but two custom workflows to that particular user, right? But even just taking Salesforce, for example, every customer, every company Salesforce deployed looks actually can often look very different from each other. And so there is no one size fit all like thing you can type into a little text box, like, Hey, I want you to go do this thing, because even how you add a lead can be very different from from company to company. And so the power for adapt is recognizing that we should be focused on the highest value workflows and how a user could teach adapt a new workflow really quickly. And the second thing is that we should be focused on workflows that span many, many different software tools. So like other examples, like there's a there's a case where someone wants to use adapt to go do market research every day, right, like on, on the state of state of various different housing markets. So they're pulling up like redfin and Zillow and stuff like that, and just running queries and populating them into a spreadsheet. Like whose job is it to make that happen in the vertical side? Is it reference job? Not really? Is it Google Sheets job? Definitely not. Right? Those are the types of things that know lots of value. And SPEAKER_02: is that going to happen in my browser on my desktop? Or are you going to make me you know, my researcher in the cloud, and fire up a headless browser, and then just have that have literally a virtual desktop on my desktop. And I watch my worker, my AI, you know, research slave go through and do analysis 24 hours a day on you know, properties on Zillow and redfin and put it into documents for me. SPEAKER_01: It could be either we're doing the former right now. But we have had customers ask us, hey, like, why don't you just go spin this up in the background? And we'll just monitor it. Yeah, so both work. There's no, like the hard part about getting a depth to succeed is, is not in any of the scaffolding bits, but it's how the heck do you make reliable models, like LLM's that read the screen, decide what to act on next and do that reliably. And so almost all of our challenge comes from that. SPEAKER_02: How are you going to charge this to be 100 bucks a person per month, 1000 bucks a person per month? How are you thinking about it? Yeah, we're actually seeing tremendous, like most, you know, SPEAKER_01: when we started the company, I think it was a really valuable lesson for me, I always thought that I knew what this model was going to be. And we should just build for that model, which is choose a couple hundred bucks per seat and like upsell people and do enterprise capabilities down the line. What's actually happened is from the get go, there has been so much enterprise demand, and they have no exactly what use case they want to go deploy this thing in. And they are willing to sign up for relatively high ACV things off the bat. So we've said, let's just go do that. And down the line when, when everything becomes more stable and mature, let's pull little chunks of that out that we can then monetize in a more perceived sort of setting. SPEAKER_02: Got it. So you can go to a company and they really care about their accounting and purchase orders, whatever. And you can say, Hey, just give us $250,000 a year, we're going to eliminate 10 jobs, or we're going to make everybody 10 times faster, whichever, however you'd like to look at it. I mean, it's all the same thing. You either you don't have to hire any more people, because even as you grow, people will just be 30% more effective a year. So what are the gains you're seeing per employee in the early tests? What are your customers telling you they're seeing in terms of gains, because you're going to be able to charge more, if you can make people more productive. So what are the gains like, SPEAKER_01: yeah, we're really focused on making people more productive. And also, in all sorts of like side objectives of making people more productive that we didn't expect, right, like decreasing error rate, or making it possible for more people at the company to go do a task, right? There's an interesting demo that we have where, where like Shopify is pretty easy to use. But like, as an admin, there are some things that like, you might know how to do that, like, you want to make it really possible for anyone in your marketing organization to be able to tweak, for example, right? Even though they're not typically the people who go who go do that, and you can just teach a dev how to do it once, right? So it's like things like that. They're also really interesting side effects of a time to revenue example, that I mentioned earlier, that's, that's the kind of stuff that we're that we're really focused on. SPEAKER_02: If you were to pick a number in the early tests of how what percentage more efficient people were, would it be 10% a year 30% in the early tests? So I think it depends on the on the task, and we'll probably be SPEAKER_01: more we're gonna, we'll probably publish a case study at some point on this, we'll have more details. But like, we're hearing things like a workflow that might take somewhere an hour and a half goes down to 30 minutes, for example. Got it. Okay, so very much something where we like our philosophy for how to get the general intelligence involves agents, but it also involves a lot of human oversight. And, and so we've been the whole time, we only basically build human loop systems where you know what the models are doing. SPEAKER_02: I think this is a fine way to look at it. Businesses are growing 30% year over year, 20% year over year, like Uber grows or Microsoft, whatever they grow 1020 30% year over year, and their teams now, this last year, and I think a lot of it had to do with AI and also people getting fit and maybe not hiring ahead, their teams went down in size, and the revenue still went up 30%. So I think what's going to happen is it's not job destruction, or elimination. I mean, sure, some jobs will go away because of AI, that probably be a good thing, because there'd be menial tasks that are arduous. But you can have the same team size. And instead of having to add 1000 people every time you add, I don't know, 10 million dollars in revenue, or 100 million dollars in revenue for some big group, you're gonna be able to do because the whole team can be 30% faster 50% faster at these repetitive tests, maybe you don't have to add anybody. So the company stays the same size, but yet can do more. Is that your thesis as well? Or I think SPEAKER_01: giving Yeah, giving knowledge workers and companies lots of leverage through these systems is really the focus. SPEAKER_02: All right, congrats to the team at LinkedIn, they just completed their march to 1 billion users. So what does that mean for me and you? Well, we all know startup game is rough now more than ever. And you need great team members to compete. Don't I know it, you need team members you can depend on. And there are so many great employees out there ready to interview for your job. And with a billion users, LinkedIn jobs has the best candidate pool out there, hands down bar none. And you can land both active and passive job seekers, the active ones you know about, hey, they got laid off their startup shut down, they're actively looking for their next adventure. But what about those passive job seekers, the ones who they like their job, maybe their boss is a jerk, maybe they're been there long enough, and it's time to move on. Those are the passive job seekers, some of those are the best in the world, because they're highly sought after. And they're not actively looking. But LinkedIn jobs will put your opportunity in front of those passive and active job seekers. So use LinkedIn jobs to find your next amazing hire, go post an open role LinkedIn, and you'll be 100% certain that you have access to the most qualified candidates available in the world. In fact, according to LinkedIn, 86% of small businesses get a qualified candidate within 24 hours, that's one day or less. And guess what? first job listing, it's on your boy J Cal LinkedIn jobs helps you find the most qualified candidates you want to talk to, and they do it faster post your job for free at linkedin.com slash twist slinkton.com slash TW is to post your first job free terms and conditions to apply. What will this look like in five years if you're successful? SPEAKER_01: So this is the part that I'm, I'm most excited about. I think as we were talking about earlier, the first part of what we're doing is, is enabling you to delegate things you don't want to do, right. But I think where this really heads is, as these agents become smarter and smarter, and become better and better handling higher level things, right? Maybe right now, it's like, hey, like, here are the steps required to use invoice processing thing, but maybe in like two or three years, instead, it's like, I want to think about what I want to do in this part of the business, let's figure it out. And let's plan some scenarios together. Like that is the interaction model that I think is going to be extremely powerful. And, you know, my personal background was I was always working on AGI, right? At OpenAI, that was our North Star. At Google, when I was leading a large models effort there, we were really thinking about how do we scale up these underlying models and combine them with the other things we need to do to get smarter systems with adept and we are building a super commercial company with a product that enterprises use. But the reason why we do this every day is because we actually think this particular path of building AI agents that can do smarter and smarter things for you at work that are interacting with and learning from the world's best knowledge workers, and learning not just how to read and write, but the consequences of doing things that have a word is actually the critical path for getting to general intelligence systems in sort of the most the most predictable way. And so what I expect to see from the adept product is that the abstraction level where you can ask you to do will continue to get higher every year. SPEAKER_02: Absolutely fascinating. And how far away are we from AGI in your mind, I turn on my computer in the morning, I go to work. And, you know, whatever I happen to name my assistant, Joe, and I say, Hey, Joe, what should I work on today? And Joe says, Well, you know, looking at your email box, sounds like, you know, there's seven companies that have acute issues in your portfolio. And these three probably require a phone call, these four, you probably need some more information based on what I've learned. So I'm going to send them requests for this information and then schedule them for tomorrow and Wednesday. Is that okay? And it just like, kind of tells me what I'm doing for the next two days, when will that happen? To pick a date. SPEAKER_01: So that particular flow you just said, I was gonna ask you how you're gonna define AGI. And if you define AGI by just what you said in that flow, I think that we'll be at a spot where you would be able to get that within the next one to two years. But what would you trust the recommendations? I'm not sure we'll get let me say, recommendations being as good as SPEAKER_02: an MBA from a school and someone who gets paid 100 or 150k a year. In other words, if you know, to make this like a classic test, I wouldn't be able to tell the difference between its requests and an MBA, who is a chief of staff. So you know, $150,000 a year chief of staff who crushes it would give I wouldn't be able to tell. Yeah, the AI from the chief of staff, SPEAKER_01: I think, with that particular flow, you just said, I think, definitely less than five years. And I think five years is conservative. Wow. So the this idea of a chief of staff being SPEAKER_02: able to watch an executive work, and fill in all that connective tissue and advise them what you know, where their attention needs to be just done completely by AI. I think you are a couple couple of suggestions of which maybe one SPEAKER_01: out of three or two out of three hits. I think that's Yeah, some five years away. Yeah, I mean, the chief of staff might give SPEAKER_02: you five suggestions. You say like, Okay, we're gonna go with these three and the this one I would never do. But thank you for the suggestion. Here's a learning thing. And this one, you will consider it but let's put it on the not right now list. Yeah, pretty amazing. Yeah, I think it's the pace of SPEAKER_01: progress. You know, I think right now, the field is still split between people that are like, wow, like, I see how this stuff is going to keep compounding. And then people who are like, well, just because the last three years has been crazy meat doesn't mean the next three years will be crazy. capabilities of slowing down, like, models aren't going to get too much smarter anytime soon. I think the first group is correct. I think we're going to still see tremendous progress over the next couple years. Awesome. Well, this has been SPEAKER_02: absolutely amazing. This was really fun. Thanks for thanks SPEAKER_01: for inviting me on this really great questions. And yeah, I SPEAKER_02: mean, I've been talking to everybody. And it's really interesting because I've gone down the Asian rabbit hole a little bit and watching the desktop rabbit hole. And I think you're really onto something and thank you. I think it's gonna just work. And then the question is, what can you charge for it? And, you know, what which verticals can you actually carve a niche? I do like the answer to your question. The answer to the question of siloed versus across your entire desktop. I think there will be excellence inside of superhuman or other apps. That'll just be amazing. You open up your notion, here's what you missed. But then there's going to be a moment where it's like, oh, here's what you missed a notion. Here's what you missed in slack. Here's what you missed in Salesforce. I took those three here's what you missed moments. Yeah, and pull them SPEAKER_01: together. And I pulled them together. Here's what you missed SPEAKER_02: to in totality. Exactly. They won't be substitutes for each SPEAKER_01: other. They will actually both coexist very happily. And I think the key with the agents thing is just getting them to actually be reliable. And that's like, I think that's the that's the key advantage that like that we're really trying to run at is is you got to control the whole model stack to do that. All SPEAKER_02: right, everybody. We'll see you next time on the swing service. Bye bye.