How I AI - OpenAI Dev Day 2026: The releases that actually matter

0:00Today, I spent the day in San Francisco at OpenAI's Dev Day, and it was a fun one, not just because Tebow let me smash the Codex reset button for you all. I was there from the keynote throughout the day, and I have good news for you and bad news for you. The good news is OpenAI released a lot of stuff.

0:19The bad news is OpenAI released a lot of stuff. There was a lot jam-packed into the Dev Day keynote. Everything from OpenAI's answer to RockBot and Muse to platform components that developers are really going to use felt like every two or three minutes the team was announcing something new. I was able to test some of it early and I want to share from you the highlights from the releases so you know what to pay attention to depending on what's important to you and also maybe three or four things that I've spent a little bit more time with and have come to an early opinion on so you can see what I think about all these new releases. Okay so the big release of the morning, the big bang thing, first thing up in the keynote is

1:06dots. Dots are in always on long running agent that can work across chat GBT, across codex in its own computer, on your computer, on your phone, whether through text or through call, even in your Slack to get work done for you. And I was able to test dots pretty early. In fact, so early, it's hard for me to give you all a full review because it's very clear that the OpenAI team is building and building and building on this.

1:36every minute, every hour, making it better. I think what I want to get across to you is like, where do bots sit in this ecosystem of like grok bots, very popular muses, getting some traction, instinct is still out there, you know, texting people. What are dots? What do I think of them and where do I think they're going? So again, dots are your agents. And I asked the team, do I get one dot or many dots? And right now we are issued a single dots. So if you're on pro business enterprise, a couple of the key plans, you should have your dot in chat GPT in the codex app right now. So this is my dot. Her name is Bay. She's a pink blob with glasses and googly eyes. And Bay has her own computer. So as you can see here, there's a machine that your dot can use or you can take over and use it yourself. It's loaded with, of course, a browser, but

2:32Also a bunch of apps, things that are probably pretty interesting to developers. In addition to their computer, you can give your dot access to your local computer. So again, sort of this like always on in the cloud, anywhere bought that can work.

2:48locally, or it can work in its own machine. Some interesting things that they're pushing with dots is the kind of like multi-channel experience of a dot. So you can of course use your dot in the chat GBT desktop or mobile app, but you can also call your dot. So they've actually made this not voice mode with your dot. They're really calling it call your dot. It rings, it picks up.

3:14I'm curious. It's like an interesting, unique interaction, user experience pattern. I'm not sure that I quite get all the interactions between transcribing voice, live voice, and then calling, but you know, you do UBAY. And then of course, because we're all enterprises, we're all teams and we're all on Slack, the ability to install your dot in Slack. Now, one of the things that I find most confusing about dots is just like, where does it sit in the ecosystem of all the other chat GBT surfaces, um, and all the codec surfaces. So, you know, dot can do work. They position it as a sort of like replica or delegate of you. So it's sort of like your main thread. Um, and so you have like kind of like one master dot that is responsible for all your work can be proactive towards you. Can remind you of things can do work on your own, but it can also kick off.

4:09Codex threads and I think chat threads are kind of like one of the same and do work on your behalf. And so, you know, I think they still have to figure out the information architecture. I want to do a full dot review, but I want to do it when it's baked. And I know that it's really going to work, but it is worth paying attention to. I will say that early takes are the work itself that these dots do is good. Like I had to go shopping for me.

4:37it found the right shoes. I had it code something for me, it coded it well. It's proactive in exactly the right way, which is I was trying to figure out my kids weekend schedule and whether their swim classes conflicted with another thing we were trying to do with them. And then this morning it said, hey, do you want me to look for November ones? Here's your options. So I say the bones of your dot, which is a very weird thing to say, are good.

5:03There are a bunch of rough edges around the user experience. I think there's a bunch of rough edges around dots position in all the primitives that you have going on with chat and codex. I think it's very confusing to understand what's a dot thread, what's a chat thread, what's a codex thread. But I think the surface area is moving quite fast. And I think people are going to have to decide what they think about using their dot.

5:32Where do I think I'm going to use it? I'm probably going to respond to its productivity. So dot is going to be able to pull me in if it is proactive and suggests using my chatter codex memories, useful things it can do for me. I think that's how an open AI agent gets my attention is it pushes interesting things to me and I start to engage with it a lot more. I will say right now, early take, and again, I'm not doing a full dot review.

5:58I'm still sitting and using my grok bots for work. I just like defining micro agents for work just like I would hire someone. I like to hire an agent for a job. So I'm not really a one, one agent to rule them all person. And then I think the user experience of muse is just a little more consumer friendly, a little bit more approachable. Um, the avatar is super cute. So I'm going to give it a whirl.

6:27But I'm not going to give you all a full review until I really feel like I understand the differentiating features of this. And I can tell you exactly where I think it fits in your stack. So it's like early innings. It's got all the makings of something that's good. The actual work it does because it's powered by these open AI models is really good. And it's pretty smart with memory. I'm just not a hundred percent sure yet. So we're going to hold off a couple of weeks. I'm going to come back to a review here. All right. So.

6:56Dots big review. What else is big? I think one that's underhyped and I said this on X is chat GBT space. Space is a place in chat GBT where you can work on documents, artifacts, slides with humans and with agents. And I think this is what companies have been waiting for. We have been waiting for an AI native document.

7:25slide HTML collaboration platform with all the right sharing built in with all the right data controls built in with all the like agent native kind of aspects of this built in. I mean, honestly, I built this at chat PRD early on because I knew that people and agents wanted to collaborate on the same document. And so the opening I team has built spaces into that same concept. So if you see what spaces can do, it can create pages and create documents.

7:54by which you can collaborate with both your human friends and your dot, your agent friends. Slides, again, another surface area for businesses where a lot of collaboration happens. And I know that, you know, chat, gpt, these other tools are really great at creating slides, but not really great at editing and collaborating with slides. And so this is a big win. And then all the like good stuff around sharing permissions.

8:21etc. One of the things I love that my dot did one moment of delight that I didn't touch on in the overview before is it made a space for me called your personal scratch pad. And it just created a space where my dot and I could just collaborate via doc on things we have to do. And I don't know if they read my mind. I have a very Lucy goosey approach to my to-do list. I'm never going to be like an organized table notion boy I just want a stream of consciousness list of bullet points and comments I can make on things I need to do that I can check off with me and my agents and I actually built this It's called Claire's notebook. Let me pull it up really quickly So what's really funny is I actually built this for myself a couple weeks ago. I built this collaborative Document where me and all my agents codex groc muse

9:15could all collaborate on our to-do list because I was working across a bunch of agents. So I did invent this, invented here this collaborative doc. But a good example of a space, again, is this place where you and your agent can just keep a running list of to-dos, decisions, notes. It also created documents for me.

9:34I'm prepping for a talk. I have how I am recording plans. So what's coming up next. And again, what's nice about this is it's not just a doc. It is, um, you, you have the ability to at mention your doc at mention chat, GBT and get.

9:50updates to the dock. And then you can just imagine this across slides and other artifacts. So this is really like a little bit of shots fired on Google, which again, is just watching this AI opportunity go by. They have all the goodies and yet open AI meta have all beat them to the punch. We got to figure this out. But I do think spaces are one of those things that Enterprises really want. So I'll really be watching to see who actually adopts spaces. Will you see companies move more and more to these open AI hosted documents or not and how kind of the push and pull between some of these source of truth business collaboration platforms like Slack, Google Drive, Dropbox, et cetera, play with spaces.

10:37The other thing that is related to spaces that I think is really interesting is the updates announced to sites and sites in case you don't know is sort of like opening eyes built in website app builder that can be deployed. You can sign in through chat GPT and then anybody can access your web app. It's sort of like bridging that gap between deploying something locally and something you can share.

10:59You know, they pulled sites into space, so it has nice sharing and permissions. But the one thing that they added to sites, which I think is really, really, really smart.

11:09is you can now bundle connectors and plugins into your site. So let me just give you an example. Let's say that you want to create a dashboard, a custom dashboard, pulling data from your snowflake. You have a snowflake plugin through your chat GPT app. And you want to use that same data in your shared reporting. Well, you can now use that plugin to power the data.

11:31in your site. And then what's really interesting about this is if you share it to somebody on your team, they can log in and they can use their connector. So if they have access to the same data, great, they see the report. But if they don't have access to the data, then those controls come in and they can't view the same thing that you can. This is truly the number one problem I hear from enterprises that we work with trying to figure out what to do with all these vibe coded internal tools, what to do with all these vibe coded platform.

12:01what to do with all these vibe coded prototypes, what to do with all these vibe coded reports. Everybody's like, what do I do with this information? And I think this sites plus plugins is open AI's answer to this. I am really curious again. I think there's this competition between like Claude artifacts, open AI sites. Where is the enterprise source of truth going to be?

12:24And I think you really have to compete on the things that matter to companies which are like easy access to data, governance and controls, permissions, you know, ease of sharing and then quality of these artifacts. So I think it's really interesting coming up next week. We actually recorded it at the event. I did a live episode with Kath, the product lead on sites where she's going to show us all the like magic insights.

12:47But this is something that I think you should, if you are an enterprise considering chat GPT as your platform for collaboration that I think is quite nice. Now I've covered two three big things, which is dots, agent space, like collaborative workspace sites, just like a nice little quality of life thing here. Let's talk about the things that I actually care about. Model models and platform. That's what I care about. Your girl is a software engineer at heart.

13:16I am excited about models. I am excited about infrastructure and I'm excited about platform components. So let's talk about what those releases were. It was actually really funny. One of the first things Sam Alton said is, you know what we constantly get feedback on? We just want faster models cheaper. And it's like, of course, we all want models faster and cheaper. And they did release GPT-61 Sol. This is almost Astra intelligence at soul speed and really, really cheap.

13:51cost. So it's $2 per million input tokens, $10 per output token, which is much different than Astra, which is $10 per million input tokens and 50 per output tokens. So it's a lot less and as a good one. And I love the sole models. I have loved the sole model since it came out. It's just a workhorse. It's sort of like my middle of the line, most engineering tasks model that I work with.

14:16I do love Astra the very most. And so because I will pay for the tokens, I'm like happy to be an Astra. But if I were being more cost-conscious, I would definitely spend time with Sol. Sol is super awesome. And I think it's just going to be a welcome addition. But I'm excited about two other things that I want to show you. You all know that it's Jeff Week this week on How I AI. And you know what? It's also Open AI Dev Week. And they announced decisions API. So they announced their little Jeff, Jeff competitor. This is basically Luna with constraints. And so it's going to have Luna intelligence on a predefined set of answers and it returned decisions very fast. Now that sounds like a fast follow to Jeff, but there's more. I was able to test a little bit of the decisions API and it has

15:11Vision. It has vision. So we get the speed, cost of like a decisions API, a jev style model with eyeballs, with computer eyeballs. And I want to show you an example of where I think this is super, super useful. So I have an episode.

15:30with our friend John Lindquist on Jeff that we recorded. It's about a 40 minute episode and we need to make thumbnails. And every time I make thumbnails, I have to scrub through the video and find when we're not making awkward faces. And I can do this with some models are actually quite bad at it, but it takes a lot of time because we basically like clip every two, five, 10 seconds. We try to find places where our faces aren't awkward. And so.

15:57I built this with the decision API. It took less than, I don't know, 10 seconds. It was like very, very fast. And it went through a hundred frames and found all the ones where we were not looking awkward. Like, look, we look so happy. It's really cute. It's really hard to find photos where two live guests do not look weird. And the decisions API did that for me. And this has actually been a real pain point for me is something I couldn't solve with Jev because Jev doesn't have vision. Okay, also very important with Jev, I built hot dog not hot dogs. Okay, so if I select this picture of a hot dog and I it is 100% confidence in

16:43less than a second that it is a hot dog. So again, AGI is here decisions API. You all know how bullish I am on Jev. I think this is like the missing piece and a lot of our AI architecture. And so I'm really excited to see open AI announced this. They haven't released it yet. So TBD on when it's fully released, I got a little bit of early access testing, but when it's released, I will definitely do a head to head eval decisions API versus Jev and tell you what I think.

17:11So those are kind of like two models that were very excited about a soul six one decisions API, but what's the one that I really want? I can't afford it, but I want it ultra fast. So ultra fast, you know, there was fast. It is ultra fast. Now, I don't know if you know this, you can run your models in codecs on normal mode, on fast mode, which is two times as fast or on ultra fast, which is.

17:40eight times as fast. Now it costs six times as much. It's expensive. But GPT-6 Astra ultra fast is available in work codecs and the API. And I got to test this also a little bit early. And this is the one that has making me feel the future. You all think I would put Astra on like extra high reasoning and let it rip through my bug backlog, rearchitect something, build something new. No.

18:07I wanted to see what someone could do if they were using ultra fast via API as part of their stack. So what I think is really interesting is if you get very high intelligent at almost real time experience, you can build some AI things that I think you couldn't build before. And like a good podcaster, you can build games. And so I want to show you two games that I did with Astro ultra fast that I think are just really interesting. I think the latency is still like.

18:36little bit slow for what would feel like a real time app, but it's pretty magical. And I hope this just kind of like opens up your mind to what 8x, 10x, 20x, whatever's coming soon at the highest frontier intelligence can do. This is called the other pencil. It's an AI human collaborative sketch pad. And so if I go in here, and do some wave. Then Astro is going to come behind me and draw SVGs that match what I do. And so let's see if I put like a circle here with a smile. Oh, no, I made a little chicken. It's very cute. It's like almost too fast for me. Let's see if I do a flower here, maybe what it will do next. And I don't know if you remember this from my Astro review, but

19:23Astra's really good at drawing SVGs. And again, this is something that I just feel like you couldn't do real-time before that is super cute and very fun. Oh, look, I got a little ladybug. But let's take it a step further. So this was real-time SVG drawing with Astra. I think it's super cool and something you can do before, but let's take it a little further. So this is a little Starship. This is a 3D app that I built and has three characters. It's Pip, Momo, and Sprout. Now, This was 3d built by Astra pretty fast. I didn't do ultra fast, but it was built pretty, pretty quickly. So Astra can definitely code an app like this, but here's where all Astra ultra fast comes into play. So if I type in here and I want to use those other rooms and I say, let's build a bathroom for our friends.

20:16Then what happens is uses Astra ultra fast to render these new 3D objects super fast real time here in the app. So it's done a really detailed job here. There's a little rubber ducky. There's bubbles in the bath. Pip has gone over to the bath. So you can actually build this sort of like real time game. My kids were doing this yesterday. They were doing so much stuff. So let's say let's all go on vacation to a tropical island and it will completely change the scene of this little game. So look, there's a little island it made with a coconut tree and some sand and all my buddies are coming over to hang out on my tropical island. And you can also change the physics of the game. So let's say remove gravity. It's time for a float party and it will remove gravity and like again,

21:12It's very, very fast. It's a couple seconds to do all these changes live. These are all rendered through Astra Ultra fast and my kids were playing this for like 20 minutes last night. Now, real talk, it cost me like $97 or something to run this for 30 minutes. So it was not cheap. This is a very expensive game, a little expensive demo for you all. But I just think how cool this is to be able to do these like real time code rendered games. It has a keeps a big long log. These are all the changes that we made to to the planet, all the changes we made to the ship. And again, like this is a cute little example. But I do think if you can start thinking about like what real time super intelligence would look like from a user experience perspective, there are some pretty cool

22:08things you can build. So from a model perspective, really excited about sole six one because it's fast and cheap, really excited about vision and the decisions API and really, really, really excited. My wallet is not excited about ultra fast. There were a lot of other things announced. I mean, again, there were just so much like agents platform computer use in the agents API.

22:35all the codex primitives enabled for developers. There are updates to how plugins work. Rumor has it that you can even monetize at some point your use of plugins. They've announced some changes to the chat gpt plans, including a new pro 500 plan. There was a bunch of developer primitives released so that you can build with the same infrastructure and tools that Codex is built on, cleaning, using the agents API with computer use. There was just so much announced today. But if I were to tell you to pay attention to a couple of things, it would be give dots a world. Tell me what you think full review coming later. It would be if you're at a company and you're really struggling with collaboration on AI generated tools, either with humans or agents to take a look at space and sites. And then the models, the models are just so good. And as a developer, somebody who both builds with these models and builds.

23:26on these models. I am very excited about the decisions API with vision and very, very excited about ultra fast just because it makes me really imagine what the future of AI products can look like. This has been my very fast open AI dev date recap highlights for me of episode with Kath from the sites team coming this week. And I can't wait to hear what you've tried, what you're excited about and what you think I should cover next. Thanks for joining.

23:54Thanks so much for watching. If you enjoyed the show, please like and subscribe here on YouTube or even better, leave us a comment with your thoughts. You can also find this podcast on Apple Podcasts Spotify or your favorite podcast app. Please consider leaving us a rating and review, which will help others find the show. You can see all our episodes and learn more about the show at howiaipod.com. See you next time.