Dry Run 🎙️ Episode 10: Happy Belated Birthday Internet!

Hello, we are going live. We have gone live. We are live. Sil, we are back. Three months. I was looking at the docs. It's been three months. We've got a lot of stuff to cover, man. Yeah, it's um it's been a while. You've been pretty busy, too, if I'm not if I'm not mistaken. And actually, you're on vacation right now. Is that right? Yeah, I took a break. That's why I decided to just call up my buddy with cameras pointed at our faces and just hit the Like I'm going to not think about work for a week. It's been a really busy week. We just had our birthday week. 15 years, by the way. 15 years. A Keera, if you will. That's right. Here we are. Here we are a week after Sen's taken some time off. A lot of stuff was built uh uh dur during this time. a lot of like, you know, that's a people talk a lot about like, uh, there's so much stuff that y'all are shipping. What does that feel like? You know, like I get to I get to talk about the stuff that happens. What does it feel like to be in the ship zone? Birthday week is always special because look, we're always shipping all the time anyway. And we don't try sandbagging. Like we were shipping like 2 weeks, 3 weeks before birthday week, right? But birthday week is interesting because for folks who don't know it's uh one week of the year that coincides where cloud with Cloudflare's birthday and we ship a bunch of huge things. So workers was announced at birthday week. R2 was announced during birthday week. I think the Wrangler rewrite was announced during birthday week. It's usually a time for like hey like here are some big swings like here are some cool things we've been up to. Give it back to the internet too, right? Like it's always like happy birthday internet, right? Exactly. Yeah. Happy birthday internet kind of things. It's sometimes a little stressful because well like you want to put your best face forward all of that and you're on the organizing committee so to speak for the birthday party or the event planners and this time was interesting because of course um a lot of AI agent stuff in the air right and I was just thinking the year of the agent still the year it's still the year of the agent next year too. Uh what was interesting I think is agents as a team our little group of like four people we were supporting multiple efforts instead of like shipping anything of our own own even though we actually have some big things in the pipeline. So that was an interesting perspective basically hopping across hey okay we can help you with this help you with this help you with this ship this ship that. So and it was also nice to just like reflect back and think about the company hell like my time here. Mh. So, um, I was just mentioning this to you, which is, so because this is my week off, I realized that I haven't actually watched Frraasier end to end. Frasier, the the Cheers off shoot. Exactly. The Cheers off shoot. Famously, the Cheers off shoot. We love it. Like my wife and I, we both love the show for like years, but I haven't actually watched it. And I watched it and in season one, something like episode 3, he's like, "I'm 41." And I'm like, "I'm 41? What do you mean?" Like it's so weird to like face the show and like oh I'm as old as this person in the show. So do you do you feel like he's more accomplished? Like what how are you comparing yourself? How how does that how does that make you feel? Cuz I feel like that happens right when when age happens you're like I'm comparing myself to this Yeah. Yeah. Like look man in tech we are always in a state of arrested development. You know me I dress like a freaking teenager. You're you're wearing a hoodie and a t-shirt. like um uh it's we we have never really grown into like conventional adults, you know, like top hat, tie, have a cigar, have a gin and martini, a gin mart jin martini for lunch, that sort of thing. Like we've never done those things. Of course, I'm also thinking about like my father at this age, he was like like an adult adult, you know? Yeah. And I'm here like I have no idea what I'm doing with my life. It's uh watching Frasier. That's what you do with your life. Exactly. Like I'm like eating like oranges with the peels on my shirt. Like I'm like watching the show. I'm like, "Okay, might be might not be the right thing." But birthday week was great as you as always. You're always worried about it, but like we have a great track record. Matthew says this, by the way. He's like everybody else now tries to do innovation weeks. You've seen, right? Like every company now tries to do. And he says that the biggest mistake that they do is to have an innovation week, you should have enough stuff that fills a week. The reason that Cloudflare has a week is because oh my god like six announcements a day. If you do like one announcement a day, then by day three everyone's like, "Dude, just get on with the story." No, here like there was like not only were there like five, six big announcements a day, like some things didn't fit the calendar. We we have to like ship it this week and next week now simply because there was no space. So, it's uh Yeah, it went well. It went well. I'm quite excited because we're clearly taking like new bets. Yeah. Yeah. So, somebody on uh YouTube, if if you're watching this on YouTube, you can say stuff uh to Sil is living the life. I believe that's probably in reference to your oranges, Frraasier watching thing happen. I do you think that maybe you are the Frraasier of software development because I I think that he brings what what Frraasier brings is common sense and thoughtfulness and future-looking things. I think that I think you c can you can you be the Frasier of software development? You're the same age. No, no, you say that, but I think I'm more like JD, you know, from Scrubs. Okay. He's clearly a child in a man's body. Even though he's a very good doctor. They they make it a point to say like he's a good doctor and people like working with him and all that, but he's a child in a man's body. I think I'm more JD than than anything else. Sometimes I think I by the way I absolutely tie myself to lead characters of like TV shows. Some days I feel like most of the time I feel like I'm Liz Lemon who's like holding it together. Uh I I have a very competent team but always I'm just like you guys like I can't believe I have to do this and I also have eating habits like a very disgusting eating habits. We we have this conversation all the time, right? Like one is you go from being the youngest person in the room to being the oldest person really quickly and suddenly everyone's looking up to you for direction and I'm like like uh but then you do some things right and I'm like okay I am capable. Okay, like I I'll just keep trying the thing I'm I'm trying. We make mistakes along the way as well. Uh yeah, whatever. Yeah, man. And then I think like I think the other thing and we've brought this up also before on this show is that like one of the things about getting getting be becoming the more senior person is you get to take credit of other people's work. And I think see I think it's time that we start let's let's go through this list and talk about what you did for birthday week. Actually before we do that the thing that we shipped that we didn't start last week. Craig congratulations on AI Avenue. Well thanks man. Thank you. You are like a TV star actually. You know, I was watching it and I got a big vibe of late science shows because you also have an animated puppet which is confusingly a hand. Even though other puppets are usually a hand inside a puppet, your thing is an actual hand. If you're watching this, you folks, if you're watching this, you folks have to have to watch AI Avenue. By the way, it's all on YouTube. It's free. You're down three episodes now, I want to say. Yeah, there's there's three there's three episodes. We did one on voice. So, generative voice. We did one on vision. And then we just we're just wrapping this week. Uh thinking is out. Next week is learning. And York, my robot hand goes a little off the rails. So, it's time it's time for that that story arc to happen where he starts, you know, he's learning and he's learned how he can generate stuff and he's he's going to actually kind of take over. I mean, like, spoiler alert, but like we we've got some ethics to deal with. Famously, robots that get lives of their own have caused no problems. So yeah, it should be a good watch. It should be a good watch. Let's jump into the announcements. Awesome. Yeah, let's do it. So, oh, real quick, ai avenue.show. We'd love to see you there and share it with everybody, right? Cuz it's for everybody. Cuz AI is for everybody. Uh, all right. Let's do it. Let's start taking some credit, Sen. You ready? The first one that I'd like to see you take credit for is a big movement that happened a long time ago. There's a there is a status code called 402. Do you know what I'm talking about? Yeah. 402 is a is an HTTP code that you can return in a response that says that it's a paid resource. You have to provide proof of payment to be able to access the resource. Well, actually it just says we've checked and you haven't paid. X42 is a protocol. I think the folks at Coinbase started it and different people have been making attempts at like making it work. Worcel's Ethanizer built X42 MCP. That's really good. agents SDK launched some support for it. But interestingly the announcement was that Coinbase and Cloudflare are building a joint development foundation and I think like there will they will have like other players in the future to like actually formalize this as a thing for every this is the sort of thing standards are kind of good for there's no particular invention of the tech per se but the new ecosystem of MCP servers and just AI like agentto agent communication like that's what X42 is about like how do you do automated either automated payments or uh human in the loop, whatever. Like, but they're now building a protocol that you can use. See, I'm getting I'm getting some reports that maybe we need to pull your mic a little bit closer. But I thought I just did that. I saw it better now. If someone in the chat can tell me whether it's better now, that would be nice. But yeah, uh look, payments actually is going to be like foundational to this. It's not just X42. Yesterday, Stripe and Open AAI announced what they're calling Agentic Commerce Protocol. Yeah, that's also interesting. Why? Why is that? Let's Let's pop up a little bit. Why are we Why are we here? Why are we talking about paying? Like what's going on? Okay, man. Like this is like the $3 billion question. Typically, when you put content on the web, right, there are three kind of reasons that Man, like how do I Wait, I'll try to kick up the volume a little bit. If someone can keep telling me whether it works or not, that'll be nice. Okay. There are three kind of reasons to put content online beyond the oh, I want to share it with everyone. Okay. Either you do it like for the fame. Mhm. Or you do it for let's say ad space in return for like advertising. You're like, "Oh, like I've built a brand. You can do that." Or it's directly paid content like you have to pay to actually get access to the content. Yeah. You you set up a firewall to get in there, right? And this has been like the the backbone of the internet for what some 20 odd years like this is kind of how it's operated more than 20 years. But specifically agentic crawling has kind of ruined the math on that. Like I can't remember the the uh exact numbers. I think it used to be that roughly for every six crawls that a something like a Google or some search engine would like do of you, they'd send you one visitor. Mhm. And it turns out that number now has gone completely wonk. It's now closer to 200 to 300 for uh some some some of these things. And it's only going to get worse, right? Like I when I do like an 03 search on chat GPT, I very rarely click the links, which is bad in itself, but that's the nature of like this usage, right? That's and that's what's happening, right? Like we used to we used to count on those blue links and those blue links people are not getting there because they don't need to because the answer's there for you. That's that's the dilemma, right? So, you kind of need to implement any of or all three of these mechanisms now like for agents either your content serves ads directly in the like the the content itself contains ads and somehow the agent has to like show those ads to the users or there has to be attribution somehow saying that hey this came from Sil P's blog. Mhm. or you're given the option to make a payment while you're searching for that content which it's all very tricky. There are no like yeah I mean if it took 10 15 years to figure out the answer for regular web it'll take take a few years to figure it out for the agentic web for sure and things like protocols are actually super useful for this whether X42 wins or ACP wins or A2P or whoever remains to be seen. the best thing we can do as infrastructure providers and as like framework creators is to at least make it easy to use and try these things. So the X42 foundation uh announcement was big and of course uh agents SDK has inbuilt support for it and when I say that I mean you can build an MCP server where the API we have is something that we actually got inspired by Ethan's work is you know in an MCP server you usually say this.servertool server.tool name description arguments. You can actually now say this.server.pay and you can put like cost and stuff like for it over there. Wait. So, so if I were to call that I would have to pay. Exactly. Nice. So, and it either you can set it up so it happens automatically. I mean this is up to the application people. Uh or you set it up so that there's a little confirmation before you pay for it. Nice. So, there's there's the great use of the commerce too. So, I'm going to do this thing that costs money. this is going to cost the the developer who made the site, who's hosting this thing. It's going to cost them money and they're just passing it along. Like, I would like I would love for you to do this, but I'll give this to you. Yeah, I'll I'll run this this work for you, but can you throw me a bone? Yeah. And yeah, exactly. You just pass the payment back. And being able to just take a function and mark it as a paid tool, I think, is like quite powerful. There's a lot of work to be done here, but it is actually usable and has tests as of today. like you can you can just update agents SDK and you can start adding paid tools to your MCP server. Also, the MCP client itself, by the way, I have to actually talk about this. Our MCP layer over the last month to 6 weeks has gotten a lot better. So, Nar and Steve on the team, they spent a bunch of time just fixing the fundamentals, updating how the SDK is used to be closer to how it's meant to be used. Like for example, request headers weren't exposed in tools before this like so we had to like fix that. Our MCP client support for O was even though like we were so involved in the process of making it work, it was actually super buggy and we fixed that like completely. So if you're connecting to like oath servers etc. it now works like out of the box and some quite clever tricks in that by the way. So I'm quite happy about that. So on this foundation now we can start building stuff like hey how do you do paid tools there are some new things coming up in the MCP spec for longunning processes like there's like a bunch of stuff I'm very happy that okay fine we can now like in lock step with the stuff that's happening in the official SDK we can bring that stuff to agents yeah cuz it's moving quick right it's it's moving quick over there the the MCP stuff there's like always something like wholesale adoption everywhere right like just fully Awesome. We got a OOTH was buggy and it's fixed. Fantastic fix. There you go. Awesome. Thanks to the team. Like they really like just went through it line by line and just fixed so many things. And we haven't made a lot of noise about it, but I'm not I'm not joking. Night and day difference like 6 weeks ago versus like now. I feel like it landed in the the middle there of the the uh MCP, right? I feel like I feel like it it landed right in the middle of birthday week. all those MCP changes there as they were coming through. Yeah. So, so on that MCP front, if we are seeing people, where do you want to see people go to report issues now about that? Is there is there something that we should be promoting there? So, you can go to the like look because we're a framework team, we're kind of like a nexus of different efforts. If if you're using agents SDK and you have trouble with MCP, you're absolutely welcome to just file an issue like with us directly on our repo. If you are super certain that it's like an MCP MCP problem, the official org is literally called model context protocol on GitHub and I think the repo is Typescript SDK. So github.com/modelcontextprotocol/typescript SDK. But honestly, you can come chat with us in agents. You're very tied in on that community, right? Like you you guys Yeah, we've been speaking to that team as well a little more closely. We want to get even more involved. By the way, this is just the fun of open source. Like even if we dedicated our time just to making MCP better, right? Like just helping out with issues and triage over there, not only will our stuff get like adoption, but like everyone's stuff like gets better. It is a this is kind of the dream situation I keep thinking about where I'm like, you know what, like I'm not in it for the revenue game or getting people. No, I just like this tech has to get good at a time when things are moving so quickly and it's worth it. It's actually worth it just to us to support the effort like just like dedicate some people and you know what I think we might actually do that trying to work out some stuff but we might just dedicate resources to efforts like X42 MCP etc etc. Well, that's cool. That's a that's a great that's a great idea. And I think that, you know, I think pushing a protocol forward, this is the second proto we're we've talked so far about two protocols like pushing protocols forward in this time when there's new ways of thinking about business and there's new problems that are coming up that we have never seen before, right? About letting you know I I believe that MCP is about letting agents play better together and 402 is about letting them also play better together, right? So so we're moving into to the year the agent properly with with protocols. See there's an MCP thing I know we want to talk about but before that since we are talking about protocols. Yeah I want to talk about captain web. Okay let's say so Kenton built something called captain web and the first thing that strikes you about it is that it's not cloudflare specific. It's not it's meant for any JavaScript front end. You can actually do it in between two worker threads on your browser. And it's a new way of making like HTTP calls. So it's not competing with your React query, GraphQL, etc. type thing, but it is in the same space. So people who already built Cloudflare workers might be familiar with how we do RBC calls, right? So between a worker and a durable object and so on so forth and so remote procedure call. Remote procedure calls. Exactly. And uh this there are two or three really clever tricks about it. And the best one is what we call promise pipelining. And what that means is, okay, fine, let's say you have an object that has three asynchronous functions on it, A, B, and C. Sure, if you were talking to it with regular JavaScript async await, let's say you would say, hey, uh, and let's say you had to call them one after the other, okay? You would say, hey, await A. Await B, await C. Okay. That's how you do one after the other. But promise pipelining means that you can actually chain them together. So you can say a function call dot b function call dot c function call and that entire thing goes to the worker gets executed one after the other and then like comes back. So it's closer to like a graphql. Wa. So like one it's one call back up. It goes one call. Not only Yeah. Not only is it one call but like it all gets executed there like at the same time. And there's like some fun branching stuff you can do there, etc. And then your questions about how do you do arrays if you want to run like a function on every element of an array that's returned back. Literally my questions. Yeah. So, so that happens all the time, right? You got to you get an array, you have to process each item and you have to go one at a time. Yeah. All of these things are answered by So now Captain Web is an implementation of that but for any JavaScript runtime. Uh, I designed a uh stupid uh AI slop uh mascot for it who's a cross between Captain America and Spider-Man. I don't know if you saw that. No, that was your work. Yes, that was absolutely my work. Which is to say, I'm taking credit for cha was mine. I was waiting I was waiting for that to happen. Exactly. It is mine with a tagline protect and connect. I'm going to drop I'm going to drop that uh link here in the Yeah. And it's got it's got Oh, it does it. You know, you didn't make the repo, man. The your your guy, he's on the blog post. I'm gonna get the blog post because I think that the blog post was also awesome. Yeah, the blog post is actually super interesting. It's the sort of thing the Cloudflare blog is very good for technical deep dive into something like very fascinating and innovative and and so it's called Captain Web, but I've heard of Captain Proto. This is this is the same guy. It's the same guy and it's the same ideas. In fact, of course, this one doesn't use the like the take on protocol buffers which is Captain Proto. It just uses JSON, but that's like a first implementation. I think like we're working on like different transports, different languages. Like there's no reason you can't use this from like a Go or a Rust or something like that. Nice. But it's very exciting because because the experience is in your worker you'll define what's called like an RPC target which does all your API calls. Okay, you call it the API surface. Best thing about it don't care about HTTP whatever. Uh you just write function calls. You can define an O handler which handles the O for it. And because it's pipeline it means that it'll execute for the lifetime of that session. Whoa. It has it stays alive. Yeah, because it all happens in one call, right? Even crazier if you use the websocket transport. Yeah, you can do it like for multiple but like on one websocket connection. It's so good. It's so good. Wow. Yeah. Uh so the the experience is you write that and then you import captain web and you start talking to that endpoint from your browser. There's no defining I'll do like a request body post get. No, forget about it. Just wow. just like go to town because we've gotten so used to that abstraction that that feels like something that you have to do. I have to post to this resource and then on the other side I have to run this function that does but you just run the function and this is how I do batching. This is how I do Yeah. Forget about no this is uh uh this is going to be really good. I want to make of course I want to make a react wrapper for it. Yeah. uh and honestly anyone can I want to try using it uh a totally different thing uh and we'll talk about Tanstack in a second I know that but uh I've been playing with Tanstack DB which is one more in the it's not exactly a sync engine but it definitely has the pieces available for you to build a sync engine and it'll probably shine like with Captain Web like instantly. So I'm very I'm so excited to play with these things. By the way, honestly, I think I've taken the week off and I already have like two side projects just playing with the stuff we announced. There was so much stuff announced. I didn't even know that it was like coming. I was like, "Okay, cool." Like, this is awesome new So, Cap Captain Web, I think, is a fundamentally new thing that you can use and incrementally add to your existing apps right now, whether or not you use Cloudflare workers. And I think it's some KBG. It's like not very big. You should just It's not heavy or anything. It's really cool. You should absolutely like try it out. And I I saw Yusuke has already done some hono work with it, too. So, there's like a hono version of this thing. I just saw the drop that was like last night. Nice job, Yusuke. Nice job. Awesome. So, let's talk a little bit. I saw there was um the the last time we talked, the very last time we talked, we talked about some vibes. We tal we had sandboxes. We have sandboxes coming. Everybody's needing to have sandboxes and building stuff. I saw a thing that landed that I haven't fully even wrapped my brain around and it's called Vibes SDK. Is that is that what what landed? Vibe SDK. Vibe SDK. Okay. By the way, uh I think during developer week, of course, we announced the new Cloudflare India engineering office right in Bangalore. And of course, I went and hung out with them in June and it was May May in May and June. And it was amazing. Those guys are nonstop, bro. So, YBSDK is a mostly India centered thing. Like this was built mostly in the India office. They do like a ton of AI stuff. Also, they have a couple of like really great designers. I've been enjoying the hell out of. So, they did the X42 playground. They did SDK and then they also did the landing page for netdoll.com, which by the way, Cloudflare has a stable coin. Yeah. I'm like I didn't know we were doing all these things but sure I guess but no so they did WB SDK and of course just so we're clear like the design is one thing but WSDK is full-fledged internally we've been talking about oh should we have a little codegen platform etc. Yeah. And yeah, I think the answer there is still yes. But these folks did the meta thing which is you know what we're just going to build end toend platform. So if you want to build your own your own lovable v 0ero bolt whatever whatever this is the starting point and the thing about it is that it's not 400 lines of code. It's a lot. Okay. It has to it comes with like its own gallery so you can show how to do these things. It shows how to play. It shows how to have previews, running previews. By the way, built on agents SDK and sandbox SDK. Very very proud of it. They gave us like such good feedback. We we fixed a bunch of things just for them. Oh wait, wait, wait. This this runs on this one runs on the SDK. Yeah, this uses agents SDK, sandbox SDK, and of course containers. So this is you can take credit for this. I take credit for all of it, dude. It's Sunil P's birthday week at this point. Like I'm tired. I'm like how they're very very grateful to have me well taking credit for their work. So you know let's let's let's I want to actually let's clap at that a little bit right like we build on our tools right our team is building on top of the tools that are building on top of the tools. So like we we have that like dog food effect right of like the tools get better because of that. So I'm sure you got a lot of feedback for that cuz that and it's cool. I I saw I ran a couple of these. I made a magic eightball. I was like make a make me a magic eightball app that remembers and it did it. I built the whole thing out. I built the whole thing out. I did DVD screen saver. That's my favorite thing to do. You know that DVD logo. Yeah, that's that's what I did. One shot, by the way. No, no mistake. It got it rightly right. So cool. Uh yeah, it it it's it's very gratifying to see people using um agents SDK and sandbox SDK. because the truth is in production, right? And Cloudflare of course has a nature of shipping stuff early especially when they're like innovative innovative ideas but there's absolutely nothing like building on production to actually expose the pros and cons what can we do better etc etc and it was really really nice working with the India people on this it was absolutely cool in fact the person we were working with is actually interning in Washington right now but he was part of the India India effort and multiple people in India is what it is but it's very very nice to see. So Vibe SDK is end to end like previews uses containers deltas tool calls all of those things and it's like barely done like as you can imagine the next thing I want to do is yeah I want to hook up like MCP servers to this so that the agent knows it can do these things while building these apps right yeah because the thing I want to do is uh I keep I don't know if I'm pretty sure we spoke about it on some episode of dry run imagine having access to internal information like your databases and stuff and saying build me an interactive report like literally something with sliders and graphs and stuff that I can now share with my team and my group and stuff. It's not just about like landing pages even though it's very very good at landing pages. The thing is going to become like a monster builder thing. I think that's what that's that's what this is unlocking, right? That that we and we did talk about this about the barefoot coder stuff, right? About like I see this thing and you know I think people are getting braver, right? like like employees uh you know maybe somebody's on the marketing team or the sales team and they're diving in now. They're diving into chat and they're using Gemini or whatever app they have locally at their place that they're allowed to use and they're using it and they're building stuff and soon I think I think we're getting to the point where like you know what I'm just going to build an app. this thing could build an app for me. And we're getting there, right? Like I I feel I feel the shift coming. And I think that that for me that's super I I I love that thinking about like how many times in my life, oh, Craig's the computer nerd. Go talk go tell Craig your idea. It's like no, look, do your idea. Like you where you're at that time now where you can actually take your idea and and like build the thing. I can't wait. I can't wait because I' i've heard some wild ideas that I've never seen made, right? Because I didn't have time to do it before in the past to build them or help teach them how to do it. I think it's crazy like the the world of web development or rather the accessibility this didn't exist like one year ago like they were already there but like things got so coding agents get got like so much better. Yesterday I saw a tool by um it's called AMI or ANI. I don't know if you've seen this. It's it's a modality for building web pages that I wanted forever. I used to talk to Steve from TLDRA about it but this guy just built it out. And the idea is that you should be able to rightclick on like you're looking at a web page that you're building, not the code, and you right click on elements that you want to change. It pops up a little text window there, and you should be like, "Yeah, change this thing now. Change this thing, etc., etc." Instead of like looking at it, then going to an or taking a screenshot or even asking it like, "Look at the browser." No, instead directly on the page. There are these new modalities that are emerging and I'm like, "Wow, wow, finally." Okay. Yeah. This is this is the game. Like that's like a Google doc almost, right? Like you're just editing the thing like you want it to look before you put asking for changes. I I'm like very very excited about that. I think that's super rad. The vibe SDK thing. So you kind of said it's kind of like a factory like you you you want to every company could have their own here build your thing on your platform that Yeah. Because if you think about it right like especially in bigger comp No, I I say bigger companies but this is going to make it accessible to smaller companies, You always want there is infinite appetite for software especially if you consider that a lot of software maybe you just might be like for one specific use case and you don't want to pay $20 a month like for that or it you want it just for 6 days like you just want it for a very short period of time. Yeah. And either you buy third party software or you hire a software engineering team and then like they're like smelly engineers who barely do anything like whatever. Wow. I'm like, is this a hate crime against myself? Like I'm a software engineer. I think maybe you smell like oranges cuz you have oranges all over your face. I have a very low opinion of myself and by extension all software engineers at this point. He's extending it. So uh you yeah everybody should have a little thing internal to their group organization company where they can build out little things for themselves that they connect to their own data resources and ship it internally like behind Cloudflare access or some O or something like that. Yeah. The more I think about this maybe we should take V SDK and like make make it for like mom and pop shops right non techy companies who like yep take it run with it do whatever you want. That's Hey, we've got we've got the creator of Supermemory here, Supermemory.AI saying she's a fan of the show, Davia. Davia's uh Super Memories. I I've been noticing that they've been shipping a bunch of like new features lately. One is Super Memory now works out of the box with the AI SDK, which is nice, which is of course the most popular AI framework out there. Framework, library. Uh I've always told you I considered the jQuery of like AI right now. Yeah. which we could never decide if that was a framework or a library. I think it's a library. It's nice to see Dravia like really grinding. Davia and his team of course because even we've been thinking about like oh our agents should have memory as well beyond just SQL storage. You want semantic memory and we want to make sure that we match super memories API simply so that people can use super memory when they want to. Like we just have to make it like that easy. Nice. So I uh cheers. Okay, fine. Enough enough enough talking about Dravia. I do this. That's just it. Every three weeks I think about Dravia. I praise him. I talk about how he taught me how to use cursor. And I'm done, dude. At this point, he should be paying me for for this stuff. I think Hey, let's talk a little bit. I We talked if you want to, you can go check out uh Super Memory, right? Super memory is out. Open is that? Yeah. And and it's and it's out there. I think that it's out there, right? It's usable today. Yeah. Speaking speaking about open source, we did some sponsoring open source during birthday week. Do you remember what we did? So happy dude took so that's just it. They picked four projects which I really really love. Two of them are JavaScript frameworks. Tanner Linsley's Tanstack and Fred Shirts Astro. Both great great work. I was telling you about this. The thing I like most about Tanstack and I think this comes mainly from Tanner. It's um he's the most he's the combination of extremely technical like he's like he knows his like really well but also he's the most pragmatic person I've seen like who builds these solutions because he he he's not off in ivory tower building only framework he has been building like real products like for years high performance not just basic like HTML pages and stuff no he's like he builds like machines and applications and stuff so Cloudflare is sponsoring both of these things now Astro as well as tanstack and I couldn't be happier because you know this right like even though cloudflare has made uh done a bunch of work and we have a whole post about how all the work we have done in NodeJS compared for the last year and it's again night and dayv files work process works node http works do you know you can run expressjs on cloudflare workers now you can it's the craziest thing bro you can take an expressjs app and add one line of code without changing any of the existing code and it works out of the box. It's amazing. Wow. So even though we do that, there's usually a little bit of work to make these things run natively. You know, a while ago we worked with the React Router team to make like Remix React router work out of the box and that was because of the work we collaborated with Vit on their new environment API. So we're kind of bringing that to Astro and Tanstack as well. And the way we're doing it is we are chucking a bunch of money at them. We're like, "Here's some money. Make it work." Again, this is the open source dream, right? Like you're like, "Yep, you do this and it becomes better for like everyone else, but also it works well on Cloudflare." Yeah. Yeah. And sponsorship, sponsorship always helps, right? Like I think that's so cool. So cool to have that and push that. I've been wanting to build with Tanstack. I've heard so much good things about it, dude. Like Tanstack start is their flagship thing. It's their meta framework. But the thing I want to give I want to give a shout out to is Tanstack DB. You know, I'm like a fan of like sync engines. We also sponsor liveto by the ineitable Johanna Shikling. Tanstack DB is not all the way to being a sync engine but it does give you the pieces to do that. And like I said when it comes to pragmatism right like I've been playing with it and I like using it with third party APIs which is how most of the applications in the world are built. Like one of the problems with sync engines are they say hey just connect this to your database. And you go to any Fortune company they're like yeah we're not letting JavaScript developers touch our databases. Go to just go to hell. like who the hell are you to come talk to us like this? Did your manager approve this meeting? Get out of get out of here. Um, so Tanzac DB is particularly interesting because it works. It's very flexible working with third party APIs etc. So it's on my list of in fact like I think I'll be playing with it more this week. Anyway, so those are two projects. The other two are not JavaScript frameworks. They're both very very ambitious projects. One is Andrea's clinging ladybird browser. M you know how everyone who tries to build a new browser nowadays it's basically a Chromium folk right right which don't get me wrong the reason they do that is because it's millions of lines of code so Andreas Exactly. So Andreas has decided yep I'll write all those lines of code like it is literally from scratch like he writes the C the rendering engine CSS all of that it's been going on for I want to say 3 to 5 years now. I want to say three, but it could be longer. Is that based on the movie? Do you know? Isn't there a movie called Ladybird? There is a movie called Ladybird. I have no idea if it's I'll have to research. Yeah. Um, and we're so And you know what? It's so the kind of thing that Cloudflare should be sponsoring, right? Like of course Cloudflare, the internet company should be sponsoring creation of a new open-source browser, helping build a better internet, right? That like makes sense. The other project is DHH of Ruby on Rails fame, Is making a Linux distribution and it's called Omari and people love it. He's very much in the love it or hate it. The the premise is yeah, you don't need to use Mac OS, etc. You are developers, you should learn to own your software, etc., etc. And he's making a distribution called Omari, which I see a lot of people trying on Twitter and they end up loving it. People are loving it. And I see it all over the place. It sounds like the kind of thing Cloudflare like sponsors if I understand right. Look, if you're doing a Linux distribution, this means you have images worth GBS up somewhere and throwing Cloudflare in front of it is the best thing you can do to keep it efficient and fast. And Cloudflare saying, "Yep, this is the thing we want to invest in makes it free for them." So it means suddenly the distribution of Omari becomes that much faster, easier, cheaper so that the team can focus on building great software just the marriage of the worlds. It's especially es and especially for birthday week too, right? Give it back to the internet, helping build a better internet. Yeah. Awesome. So cool. Cool to see that thing go. I think I'm ready, man. You had a banger come out on Friday. I think I'm ready to hear about it. I am I am ready to hear about what your brain is on here and let's let's go. Let's hear it. That phrasing is interesting because I feel high every time I actually think about it. So it's called code mode. Code mode, right? You want to talk about code. That is 100% what I want to talk about and I think people want to hear about to be clear the idea came from like Kenton and by nature it came from DSP who spoke about it. But there's some prior art to this. Last year, Apple came up came out with a paper that they call Kodact. And the idea being, hey, LLMs aren't trained on like tool calls. That's not a thing they're trained on, right? They managed to make it work, but they're not trained on it. You know what they're trained on? They're trained on terabytes of source code. LLMs are good at writing source code. In fact, that was, I think, the aha moment for a lot of people in 2023, right? Holy this just spat out a React app with JSX and it worked. Yeah, we didn't. What do you mean a large language model is generating code? And turns out that it's actually really good at and things. My god, dude. Like in two years, actually it's almost two years to the day chat GPD. Oh, that's true. Things are like coding agents are like the PMF use case for LLMs. There are others, deep research, etc. come to mind. But coding is like fundamentally a model has to be good at code nowadays. So the way that tool calls, what I call tool calls work with LLMs is you start with some context and you tell the LLM, hey, here are some tools I have and this is the structure of the arguments you can pass to it. And it's usually passed as like JSON schema by the way, which says this is the name, this is the description, these are the arguments, these are the types. And the LLM takes that and it returns back, hey, by the way, you should call this function with these arguments, right? And you should call this after that you should call this function with these arguments etc etc and it comes back we take it we read that out call the function take the answer go back go back to the lm's like okay now that you've done this you should do this so there's this back and forth etc yeah the loop you know that process that I just discovered you know what regular people call it they call it code like hey take this argument run it take this take the results from this pipe it to this one etc etc right so instead you tell the LLM um you're like hey you have one tool okay okay we call it code mode okay this tool can do all these 12 things that you can this thing so all you have to do is give me a description of the code that has to be written not even the code okay the code mode tool takes that and it generates code for that function description so you're like hey find me all issues so you use like something like git mcp find me all issues related to websockets and cross reference my Gmails for anything that had to do with websockets whatever like across tool calls and here and code more you you take all the tool definitions that you have particularly the MCP tools right like all MCP tools are self-describing by the way the the solution that we came up with works with regular tool calls as well not just MCP by the way okay that's the fun thing about it I I'll go into detail about that so you give it this thing as a TypeScript as TypeScript types in the context you should see the I think we have it in the blog post examples you it literally generates TypeScript types for those tool definitions given JSON schema it spits that out and then it writes code and okay it writes code so what Cloudflare workers famously has not had eval you've not actually been able to run code in in a Cloudflare worker like like dynamic code right dynamic code so so take a string and this is this is working code I want you to run this you just couldn't do that and the reason we haven't done that many many reasons but the big one is like security like so eval is evil that's what Crockford used to say so so code mode actually hides probably a bigger announcement inside it which is what we call dynamic isolate loading dynamic worker loading I call it dinos or super eval we have a number of like phrases for it angler JSON calls it a worker loader and the idea is that it's like eval but it's like better so you can basically define a worker as the JSON object just like you would define Wrangler JSON. So you can say compatibility date, compatibility flags and then you can define the code. Okay, you can define multiple modules but for the sake of this conversation, let's say you can define one string of code. Okay, and then you can decide what environment variables are exposed to it. So you don't have to expose everything from your original worker. You can define what functions are available to be called inside the worker. Do we call this exposed bindings? I don't know. I don't know what the terminology is. But you can say, hey, here are some functions that you can call. And then you can guarantee you can also control all outgoing fetches because this is the most Cloudflare thing. You're a security company. Don't forget, And by default, you actually want that outgoing fetches to be null. Like you don't want any outgoing fetches. If you want to do any requests, you only call the functions I call you. Inside those functions, I'm calling fetch. I'm doing a bunch of things. I'm really connecting calling MCP tools. That's the 99% use case, right? Yeah. Yeah. Yeah. So, yeah. Code mode generate. So, the code mode tool generates the code. It runs it inside an isolate where the only things it's given access to are these tools that you have proxied down into it. No outgoing fetches and it runs. And our initial results are extremely promising. So first thing you can imagine is the context gets completely squished because you don't have to hold all those intermediate JSON results in the middle. Okay. All of that. Yeah. Yeah. Right. It's just off to the side. Only outputs are in this. It's faster because there's no back and forth with the LLM now. It's happening like in the same thing. It's happening in that dynamic worker or wherever it's whatever that dynamic worker is doing. Right. Yeah. By the way, uh that's the thing. I want to now run captain web inside an MCP server and I want my code mode to call these tools with promise pipelining. Yeah. Yeah. So that wow like all of these things come together at the same time, bro. All of them just come together. So dynamic isolates is what runs it gets you the code. So like I said, initial results are super promising, but it is a deep research area. Yeah, there are so many trade-offs to it, right? like oh what if you don't have output schema for an MCP tool that became that's part of the schema only since like I want to say like 3 months ago. Oh wow. What happens if the LLM fails? How do you yield back? You need to start wrapping all these function calls with invariance now. And the way DSP describes it is you go away from doing uh this code mode inference. You just if it throws an error then just give it back to the LLM and continue with the LLM. There's like so many things we can do. So this is like a multi-month project but easily I'm just so excited about it because what happens the way that we designed what happens to call if it fall if it fails what happens with the tool call if it fails currently like what do you same loop you currently mark it as an error and you tell you you almost pass the error back to the llm and it says oh sorry I'll try something I'll do it again yeah so same same pattern same pattern exact that's what I'm saying so if you look at the API we designed the first our first implementation lets you use it with AI SDK apps but we'll make it work with everything else later. You can take an existing AI SDK app and they have a little tools object, okay? And you can basically wrap that with code mode. That's the only change you need to make that wrap that tools object with code mode and say go to DOM and it'll so you get you get an object back. You get an you call code mode, you get an object back behind the scenes tools. Oh, that's so cool, man. That's so cool. Our base expectation and we still need to make it good enough to do that is that it becomes faster and smarter, And then we start doing some other like mad science on top of that. That's that's the plan. Nice. People can go play with this now. It's out. It's live. Import mode from agents/code mode/AI. Oh man, it's available. You can I got some fun to do. I got some fun to do. What What's your What are you um What's the biggest dream? What's the one that you're like I want to first of all what's the what's the obvious one obvious use case and then I want the senal pie in the sky don't don't start with the pie in the sky you often start with the pie in the sky what's the obvious use case here what is this giving me so no so that's just it the the the base expectation is that any existing app you should be able to make faster and smarter without changing models and it'll probably make everything cheaper actually yeah am I saying it becomes faster faster, better, cheaper. I think you did. I I don't know if you're allowed to have all Maybe you finally got all three. I must be wrong, right? Well, like I said, it's not good enough to do that out of the box, right? It will very soon you'll have all three. maybe it will. Okay, so faster, better, smarter. Okay, faster, better, smart. Uh, faster, better, cheaper. But I think it unlocks it's it's like you're asking me, hey, why is JavaScript better than JSON? I am. You know what I mean? I am like there are things that are so unimaginably hard to express with a DSL like JSON and then that you have to build your entire system around but when you have access to be able to write code there is emergent behavior that you can't even plan for right people are going to use this yeah you know it's not even like about people you're saying you're giving the LLM the opportunity to start expressing itself in a world where coding models are getting better like That's true. Cloud 4.5 came out yesterday and it's the best coding model on the planet right now. Yeah. Until the next one comes out in a couple weeks. Isn't that so cool? I love this this cycle that we're in where it's like, "Oh yeah, check this out. Oh yeah, check this out." So fun. Oh my god, it's tiring. That's why I need a week off. Awesome. And then and then let's go. What's something that you like I feel like this there are things that you would be like, "Ah, I'm not gonna even try that. that that'd be too gnarly to do with all the MCP tools together. But I think you you hit it a little bit where you're like, "Do all of this stuff. Go check my emails. Go do this. Go from one call." So, we are going to lean more deeply into this addressibility thing. Okay. I think we're going to announce something in October. And I'll be like I I don't even want to hide it. Okay. Uh I think we want to do something serious around real time next audio video. Nice. I'm not saying this is exactly what we'll do, but you know how we have on email, on connect, on request. You saw I already implemented call my agent. I saw so cool. Yeah, that I mean that that was like almost open AI specific, but I think we want some version of that baked into every agent which we don't have right now. Yeah, I think that's the world we're headed to, right? Yeah, I think so that I so that I think is going to this addressability thing is going to be a thing I chase for the rest of my life, but it's actually like getting like really good. I'm loving it, dude. I'm And I'm loving that like even just web hooks into it. Like web hook yourself into an agent that agent gets better. Yeah, it's so cool. So good for web hooks. So there is that. There's other like foundational stuff. H I have to remind myself it's been so long since I've worked. I've been off for two days, bro. Like the world has changed. It's been way too long. I think we were competing with an OpenAI announcement that I I still don't know what it was. I don't know what they did, but I think I'm going to guess Sora, too. If someone can tell us in the chat what OpenAI announced. What were you watching before you came? Yeah. Let's see what else did we miss from our announcement, dude. That's just it. There are just so many announcements. There's so many. There's so many. We're making everything self. So there is one post called here's everything new about Cloudflare's developer platform that two years ago would have been like 3 days of announcements by it's amazing it's like bonkers dude like it's just it's too much to keep up with you announced emails by the way as an email service now that's right I I totally huge that's huge that's like huge news you can now like every time I every time I put a piece of content out they're like win email win email oh my god dude yeah so for context uh people might know we've had email workers that you could receive email and you could reply to those emails, but we have never actually had a thing where you can send the first email before, Well, now you can. It's time. You can just send out like a ton of emails. Go for it. Private beta, I believe. I believe it's launched in a in an upcoming private beta, but like it's that's right. Yep. It's here. It's here and you should think about it. And if that was like holding you back from not jumping on the stack, it's time to jump on the stack. And I hear that. I hear that. I'm ready. I'm ready to do this as soon as you guys get emailed. I'm ready to come because I mean imagine how good that feels, man. Imagine that just like a binding and you're like binding email. Send like it's such a and it's there. Yeah. And you don't worry about it in the same way that you don't worry about the other stuff, right? The same way that you don't worry about how I'm going to host this thing or how fast I'm going to get to that. You just don't need to worry because we want you code which is nice. I keep like I think bindings are one of those things that are clearly divisive in the Cloudflare developer ecosystem, but man they make like the idea of a binding being the thing that you use to talk to services is just so so powerful that I've been thinking about this like I think we have already been there but it's still only been very few people taking advantage of this. Cloudflare is a platform for platform. Mhm. like workers for platforms a year ago was enterprise only paid users a little while ago and even then it's built for a particular use case now with dynamic isolates you can build a crazy version of workers for platforms that even we didn't think of right like there's some fundamentally new things like code mode like and code mode is not even userenerated code it's like LLM generated code dude I to that point you just you just there's another announce announcement that happened that was part of this with the enterprise get everything like you don't need to do an enterprise plan everything's going to be self-s served now self-s serve yeah yeah and that's huge because I know that a lot of people want that I know that people like oh man I wish I could use this feature of the inter well you can you know so I got a couple of DMs about this saying oh is this pissing off your enterprise customers or your sales team and you have to understand the exact opposite first of all enterprise customers love selfs serve and it's how Cloudflare used to be like properly back in the beginning. Secondly, it turns out that it actually increases revenue if you make it easier to buy their stuff, right? Yep. So, yeah, that's dude, that's too much to cut. I told you like I thought the premise of this episode would be we run out of time to talk about everything that's new and we we are 2 minutes from close is what it looks like. And you got a Frasier episode to watch. I'm sure I'm going to watch 12 in a row. That's what I'm going to do. Nice. And you bro, dude, you deserve it. You deserve it, man. That that we found a new South Indian place and we ordered like a bunch of food. Like I'm going to eat biryani today after six months. I'm like quite excited. Oh, you haven't had a Oh, because you took your break cuz you you went all in. Exactly. I went all in in India. Like I was just like not I lived in I was in Hyderabad. That's where my in-laws are from. I like I just like no biryani for a while. But now I'm like I have the hankering. It's time. It's time. Nice. Nice, man. Well, enjoy enjoy it. Enjoy the rest of your vacation. Thanks for coming on. By the way, a quick note. Yeah. You and I are hanging out with each other in about a week and a half, two weeks. Yeah. Yeah, we are. Cloudflare Connect in Vegas, baby. We're going to be in Vegas doing Vegas stuff. Probably coding in a in a nice airond conditioned place. I mean, honestly, we should do an episode of dry run, like live dry run from like like with each other in one room. That would be nice. Oh my gosh, that'd be amazing. That'd be amazing. Especially because there'll be all so Cloudflare Connect by the way for folks listening in. My favorite thing about Cloudflare Connect is it brings people from all the offices together. Okay. And these are all like my favorite people that I see just and then rectangles on my screen the whole time. And like I said, I'm 41. This is just bringing it back to the beginning of the episode. So I don't do drugs anymore and I can't spend like money on all the shows. I was thinking of going watching the Eagles at the dome, you know, the big sphere thing. Wa. Yeah, those tickets are like $600, $700. I'm like, no. So, my other plan is to uh just do a food thing. Do you want to join me? Like, I want to do like a 100% restaurant hopping. That's the plan. Let's do it. And we'll do dry run. Nice. Let's do dry run from different restaurants. Done deal. Done deal. 100%. Awesome. So, good to see you, Sil. Thank you everybody for tuning in to this dry run and we will let you know the next time this is happening. They're not on the regular, but they are always fun. So, we'll see you soon. Thanks everybody for hanging out. Thanks, guys. Bye.