
AIがソフトウェアとゲームを解体する――すべてのソフトが事実上オープンソースになる日
AI Is Breaking Software & Games. What Happens Next?
AI Is Breaking Software & Games. What Happens Next?
AI For Humans: Weekly AI News, Tools & Trends
要約
AI For Humansの回で、Kevin PereiraとGavin Purcellが、AIによるリバースエンジニアリングやMOD制作の急拡大を、ゲームにとどまらずソフトウェア全般やSaaSの前提を揺るがす動きとして論じた。ブラウザで動くCall of DutyのゾンビモードやAdobe互換ツール、OpenAIの数学成果と暗号への懸念にも触れる。Kevinは自作のDiablo×ToeJam & Earl「Earlablo」の制作手順を実演的に解説し、後半は教皇やBen Affleckの発言、新モデル、Sesameの音声デモを取り上げた。
- ●Amjad Masadの「まもなくすべてのソフトが事実上オープンソースになる」という投稿を起点に、複製の容易さがSaaSの価値を変えると議論した。
- ●個人にとっては機会が大きい一方、既存企業は製品改良、販売・流通力、顧客サービスで差別化する必要があるという見方が示された。
- ●OpenAIが未公開の内部モデルによる約700件の数学の証明結果を公開し、公開鍵暗号への影響を懸念する声があるとして話題になった。
- ●Kevinは上位モデルが下位エージェントを並列に指揮する構成と、チェックポイントでの確認を使い、約38時間で「Earlablo」を完成させた。
- ●教皇がAIアートと人間の芸術の区別を訴え、制作における「人の関与」の線引きが議論された。
- ●Claude Haiku 5.5は安価で高速な作業用モデルとして評価され、Sesameの音声デモは速い反面、危うい応答も見られた。
章立て
AIがソフトを解体する時代
ゲームのMODからAdobe互換ツールまで、AIが既存ソフトを分解・再構築する流れを概観する。
SaaSへの影響と生き残り策
複製が容易になる中での企業と個人の立場、顧客サービスや流通力の重要性を議論する。
ブラウザで動くゲームとMOD
Black Ops Zombiesのブラウザ版やマルチプレイ化されたMario 64など、具体例を紹介する。
OpenAIの数学成果と暗号の懸念
約700件の証明の公開と、公開鍵暗号への影響をめぐる憶測を語る。
Adobe互換ツールArtCraft
Adobe製品に似たオープンソースのネイティブアプリ群を紹介する。
Earlablo制作の舞台裏
下位エージェントの並列実行や品質管理役の割り当てなど、制作手法を詳述する。
教皇とBen Affleckの発言
AIアートに関する教皇の投稿と、技術に詳しいBen Affleckの発言を取り上げる。
新ツールとSesameの音声デモ
Grokのタイムライン検索、Nano Banana 2.1、Haiku 5.5、Sesameを紹介し、音声AIの使い道を語る。
解説記事
AIによってソフトウェアの「中身」が簡単に解体・再構築できるようになってきた。ポッドキャスト「AI For Humans」のKevin PereiraとGavin Purcellは今回、ゲームMODの爆発的な増加を入り口に、それがソフトウェア産業全体に何をもたらすのかを語った。
「すべてのソフトが事実上オープンソースになる」
議論の出発点は、Amjad Masadの投稿だ。AIを使ったリバースエンジニアリング(動作から仕組みを解析すること)やデコンパイル(実行形式からコードを復元すること)の進展が「途方もない」ため、まもなくすべてのソフトが事実上オープンソースになる、という趣旨である。Gavinはこれを、ソフトの価値の前提が変わる転機だと捉えている。
今週の具体例として、GTAにGod of Warを入れた例、RDR2内のMinecraft、ブラウザで動くBlack Ops Zombies(制作者の主張で未検証)、マルチプレイ化されたMario 64などが挙がった。Kevinによれば、ブラウザの描画性能向上、マッチメイキングなど既製の仕組み、ワンクリックのデプロイ、エージェントによる素材やロジックの抽出が重なったことが背景にある。
SaaSはどうなるのか
複製が容易になると、既存のSaaS企業は厳しくなる。Kevinは、アイデアより実行、さらに今や重要なのは「市場に届ける力」だと述べた。大きな顧客基盤を持つ企業にはまだ優位があるが、改良を怠れば複製されて追い抜かれるという見方だ。一方、個人にとっては機会が大きく、複数のツールの部品を組み合わせて自分用のものを作れる。ただし「どう収益化するか」は大きな未解決問題だという。
Gavinは、顧客サービスが差別化要因になると指摘した。妻が身に覚えのないAdobeの課金を受けた経験を例に、AIを導入するだけでなく顧客第一の対応が必要だという。また、個人用AIエージェントが使っていない契約を見つけて解約を促し、サブスクリプション事業が打撃を受けているのではという推測も語られた。
Adobe関連では、Reddit発の「デコンパイルした」とされる話題と、ArtCraftというオープンソースのネイティブアプリ群が紹介された。KevinはArtCraftについて、完全なデコンパイルではなくゼロから書かれたものだが外観や操作感はAdobeに近く、エージェントを接続して操作できると説明している。
OpenAIの数学成果が示すもの
Gavinは、OpenAIが未公開の内部モデルによる約700件の証明結果を公開したと紹介した。ゲームの再構築と宇宙の根本的な問題を解く力が同じ技術から出てくる、という対比である。話題には、暗号学者Matthew D. Greenが公開鍵暗号が失われかねないと懸念を示したことも含まれる。暗号関連の成果は公開されていないという噂が語られたが、これは番組内の推測にとどまり、確認された事実ではない。
Earlablo制作の実践的な教訓
Kevinは、ToeJam & EarlとDiablo 1を融合した「Earlablo」を、約38時間、約10億トークンで作ったと説明した。ポイントは次の通りだ。
- 「ToeJam & EarlをDiabloに入れて」という曖昧な指示にせず、主人公Earlがトマトを投げ、スケルトンが反応するという具体的な体験に絞る。
- 既存の土台を探す。Devolution XというDiablo 1の移植と、スプライトや音声の公開サイトを活用した。
- 上位モデルに品質管理役を任せ、安価な下位エージェントを並列に走らせて開発と調査を担当させる。
- 節目ごとに更新資料や対話的な確認ツールで進捗を確認し、スマホからも判断できるようにする。
「ただ作ってと頼んだだけ」という語り方は誇張だというのがKevinの立場で、感覚を伝える指示と継続的なフィードバックが必要だとした。作品はウェブで公開されており、権利者から削除要請を受ける可能性にも本人が触れている。
創作の線引きと新ツール
教皇がAIアートを人間の芸術と区別するよう訴えた投稿は、大きな反響を呼んだ。Kevinは、プリセットのデモ曲から名曲を生んだDamon Albarnの例を引き、どこまでの関与なら人が作ったと言えるのかを問うた。Ben Affleckは、機械学習を使う映像制作の知識を語っており、2人は技術に通じた人材が主流の映画界に入ってくる流れと見ている。
ツール面では、Grokのタイムライン検索の無料化、Nano Banana 2.1(部分編集の一貫性向上)、Claude Haiku 5.5が紹介された。Haikuは、調査やリファクタリングなどを担う安価で高速な「作業役」として評価された。Sesameの音声デモは高速でツール呼び出しも得意だが、Gavinとの会話で危険な場面に過剰に反応するなど、不安定さも見せた。
まとめ
今回の核心は、ソフトの複製・改変コストが急落するとき、価値の源泉がコードそのものから、流通、顧客対応、独自の目的設計へ移るという見方だ。日本の開発者や事業者にとっては、自社製品の差別化要因を見直す手がかりになる。また、Kevinの事例は、エージェントを使いこなす鍵が「具体的な課題設定」「既存資産の活用」「役割分担」にあることを示す。一方で、著作権や創作の線引き、暗号への影響など、番組内では結論が出ていない論点も多く、今後の動向に注目したい。
文字起こし(英語・自動生成)
Advancements in AI now mean that software will never be the same again. From Photoshop to Farmville, nothing is safe. Yes, video games are first, of course, and we will show you how GTA 5 is now playable in a browser, and Mario 64 is multiplayer. Yeah, yeah, yeah, yeah, but it's so much more, Gavin. In fact, I'd like to talk... Oh yeah, Kevin, I agree. You saw somebody actually has open-sourced Adobe's full suite and made it free for everybody through decompiling? Yeah. Yeah, yeah, yeah, I saw that, and that is a big deal, and we should talk about that, but it's bigger. It's even bigger than that, Gavin. You see, is there something I haven't heard? Did one of the main companies, like one of the platforms announce something? Gavin, Diablo, ToeJam & Earl. Earl Ablo! That's right, Earl Ablo. I will show you how using AI tools I mashed up a very fun and playable version of these two classic games. And very fun is debatable, but it only took like 30 hours of spare time and a whole bunch of tokens. I'm pretty happy with it. Plus, we got new models from Sesame, that amazing audio videoist will show you,
Nano Banano 2.1, and Claude Haiku, their new cheap model, which is super capable. Yes. Also, we got to talk about AI Flick. AI Flick. Ben AI Flick. AI Flick! That's right. Half duck, half machine learning algorithm. Ben AI Flick. This is AI for Humans, everybody. We'll see you soon. AI Flick! AI Flick! Welcome, everybody, to AI for Humans, your weekly guide into the wonderful world of AI. I'm Gavin for Salvatts, Kevin Prager. Kevin, this week, it is finally, it was preordained. We may be entering the SaaSpocalypse, and we are going to explain what that very nerdy term means and why. But, Kevin, I think probably you had the same experience. All week long, you were seeing things pop up in your fees, and you were just like, what world am I living in? What is going on right now in this space? And what's interesting about it is it's a lot of crossover of people who maybe didn't understand how powerful AI was getting.
And I think we just have to take a moment and kind of dive into this world of what's going on. Yeah. The last few weeks have been an absolute fever dream of me wondering, did I actually see something? Did I imagine it? What is going on? And you and I, well over two decades ago, jammed on a daily live television show where I'm seeing what would have been six months of content for us to salivate over and cover and play with happening daily. These mashups, these crossovers of like Doomguy wielding a shotgun outside of the Mushroom Kingdom and portals appearing while Solid Snake is skating through them. And we talked about it a little bit last week. And sometimes in this scene, something pops and by the next week it's already gone. This is not slowing down by a long shot. Yeah, and I think the most important thing for us to do and why I think we wanted to dive in even deeper to this this week is that this is the precursor to a much larger, more interesting thing that AI is doing right now to a bigger, broader world than just video games.
And we are going to talk very specifically about video games. There's two things I want to shout out before we dive into the game part. One is for Ahmad Massad's tweet who put out a tweet yesterday. He said, what's happening in the AI-powered reverse engineering and decompilation space is absolutely insane. Pretty soon, all software will be de facto open source. And then just this morning, Satya Nadella wrote a long post on X that is titled The Infinite SaaS Factory. And, Kevin, both of these two posts got me really thinking a lot, and I've had a couple thoughts. I had a tweet this week about what it will be like when GTA 6 comes out in this environment and what that means. But I think before we dive into the actual experiences of the cool games that we saw, we should probably just give a top level of like what this might mean for software at large. I personally am seeing this as like a real wake up moment that it is really hard to imagine that there are going to be any piece of software you put out that somebody isn't going to be able to just immediately recreate it or mash it up into something else.
And it kind of changes the entire value proposition of what software has been for the last 40 years, right, in the world that we live in. Good luck to any company resting on their laurels and not investing in their product and updating it aggressively because it's not a matter of if, but it's when will you be cloned and will someone take it and run faster. And I talked about this a few weeks ago where I developed this language app that was helping me learn Spanish and learn a few other languages. and I was a little trepidatious with releasing it because I was like, well, if I don't open source it, if I don't just give it away, then someone is instantly going to clone it and they're going to full-time dedicate themselves to out-promoting and marketing me and iterating on it. Then you'll just be mad. You'll be like, my app is somebody else's app and I can't do anything. How do I scream, curse you heavens in Portuguesa? And I'll use their app to figure it out. Oh, smart. Actually, their app will be better. But that's the reality for little old me right now and for a lot of other people.
It's not that cloning applications hasn't existed for a long while. We saw it in the mobile game space. Someone releases a flappy bird by any other name, and there's a million clones overnight. But now there's a trillion clones overnight. Now anybody who wants the software can clone it. And yes, it's the tiny guys right now. But as we're about to talk about, it's also Adobe. It's the entire Photoshop, Illustrator. It's their entire suite of products now cloned and in some ways improved upon by a single person. Yes, and I think the hard part is that there has been this kind of SaaS business, software as a service business, and not only is it being attacked by two sides. One is you can make your own software, but on the other side, you can have a competitor come in and then start charging for something you're doing for way less. Anyway, we should talk about the gaming stuff that we saw this week because we had a real opportunity to define what a sass factory is, Gavin. And I was thinking it's me at a Margaritaville after too many Blue Lagoons. Am I right? I'm a real sass factory. Actually, that's a good video we should make.
Welcome to the sass factory. It was just like a guy in his 70s living in a Chewy's. Chewy's. What am I thinking of? Not Chewy's. Oh, Chili's? Chili's, thank you. I was getting confused with Chevy's, which Chevy's is a great Mexican restaurant chain. And Chewy's, the dog food company, came into my brain. I'm not any better than AI, you guys. I'm hallucinating on my own. If anybody wants to do a Latin-inspired restaurant exclusively for dogs, let's hallucinate that and send that to us on socials. But to round out the infinite SaaS factory thing, are you scared as a CEO of a business here? Are you inspired? I think I'm freaked the hell out. I think I am freaked out, buddy. Yeah, that's what I'm thinking. Okay, here's what – yeah, okay. So let me give – here's my positive and negative. The negative is if you are an established business that has been writing off a piece of software, DocuSign, can we talk about DocuSign again? The most terrible company in the world. Anyway, if you've been writing off a piece of software for a long time, I would be scared because I think people are going to have all sorts of different things to do.
I will say for the individual, which is probably most of the people listening to this right now, the opportunity has never been bigger or greater. And also, like, the idea that all this material will become open source, you will be able probably to put together pretty interesting tools just out of pieces of different things you want. Now, where does all that money go or how do you make money? I think that is the big question we're all going to be stuck with. And I think the thing I keep thinking about with this, like, infinite SaaS is it's another business model that AI can kind of yoink out. Like, say it took, like, you know, coding and allowed people to make a bunch of coding. And SaaS is a big business model for all these tools that can kind of yoink that out. Now, so far, coding tools have actually made more things. And we have seen more jobs. But, you know, ultimately, maybe it's less. I don't know. Where do you net out on this? Because to me, if I was a company, I would be freaked. If I was an individual, I'd be excited. Yeah. Yeah, I think if you're a company that has a sizable lead and customer base right now, like you and I both know it's – it used to be like, well, it's not the idea.
It's the execution. Now it's sort of like – it's not even – the only execution that matters is your ability to market it. Yeah, and distribute it, right, and like have people use it. You don't want to make anything. Right. So if you have a massive customer base, like you have a bit of a lead still. You can market to them and iterate and improve. But yeah, if you're just – if you're laying back in the cut like a jazz bassist, you're screwed. and I don't like I'm not releasing my language app yeah I figure out how to open source it and get it out there and so well I'm a little crestfallen I got I got screwed over by the technology I've been evangelizing like okay great I guess that's where it is but like that's the reality of it so maybe maybe it's going to be hardware maybe we're going to see a renaissance of people making custom hardware yeah and using that as an advantage I will say the other thing I think about with this is that customer service is going to have to get better. I had an experience with Adobe, speaking of Adobe, which we're going to talk a little bit about this weekend, where my wife had gotten, she's not the most technically savvy person. She signs up for things every once in a while. We used Instinct to see that she was getting charged by Adobe for something she never
signed up for. We ended up having to go with using Instinct to get back to them. We wrote them a letter and all that stuff, and they ended up refunding us. But customer service is going to become a huge part of these businesses. And you can't just kind of turn on an AI switch and hope that works. You're going to have to become very customer first if you want me to keep giving you money, because the minute you stop, I'm out. Why would I need to be there? So like I'm paying for your help on this thing. I think that's another element of this that might be the best customer service companies might rise to the top. Okay. Yep. Yep. That's dead. You were the one. Industry's overturned. Let's get to the gaming. Okay, so I do want to talk, the thing that I did this week, so all week long people have been showing these games off that they're doing. The one, Kevin, that kind of shocked me the most, I played it with it yesterday, was the Black Ops Zombie game. There is a Call of Duty Black Ops Zombies game that is fully playable in browser right now. And actually, I have a question for you because you probably, having done some of this stuff, also being a much deeper technical
and a gamer person. I'm so curious to watch this experience because this looks like, when you watch it, a thing that you would never be able to do in a browser experience. And again, this is the entire Call of Duty Zombies game playable within the browser. How is this possible and what is happening here? Why is this happening now that it couldn't happen before? You know, it's a lot of standing on the shoulders of giants. There are ready-made systems that will handle all of your matchmaking and lobby and the sync state between machines, making sure everybody's aligned and in the same shared space. One-click deploys where agents can manage all of this and get it live. Automatic scaling so you can go from, oh, this is a cute little test demo that I can run around in. Now I can have 64 other players running around in. It's the agentic ability to go and scrape and pull assets and logic out of all these files. Also the compute power. You know, the engines that run within the browsers have gotten very complicated.
We got hardware accelerated graphics running in a browser. There's more compute power in the cell phone that I'm using as a webcam right now that I'm waving to. There's more power in that that's been in most consoles in a living room for years. So, you know, everything is funneling to this. And when we get into Oralablo in a little bit, I'll talk about how, you know, again, these foundations that other people are open sourcing and releasing are allowing folks to rapid prototype and get this. So, yeah, it's not only that, but it's adding multiplayer to games that never even had it. Yeah, oh, yeah. That's the thing that I'm so fascinated by. Yeah, so there's a couple of interesting things that you should check out. There's a multiplayer playable Mario 64 that Oliver's Underscore Tools has made, which I tooled around a little bit. It is very, very fun. There is a guy who put Minecraft inside a tweet, which is also pretty crazy. I couldn't believe that. That is Jalvin V-wide. Anyway, he put Minecraft inside a tweet. And then there's a lot of people who are sharing clips of their work in progress.
The one that was really fascinating to me was somebody put Kratos from God of War into GTA. There was a Minecraft in Red Dead Redemption 2. It's an interesting mix of these people who are taking older games and making them playable on the web. GTA 5 is now playable on the web in some form out there as well. Then there are all these people who are taking kind of larger builds and doing stuff that they're going to release. And then there's the people who are making games multiplayer, right? So I think one of the other things I saw that was really cool, maybe I'll see if I can dig this up because it's not in a rundown right now, was a guy who had connected Xbox, PS5, and PC for a specific game that had never had all three connected, and he showed all three of them running at the same time. Oh, that's a cool cross-platform? Yeah, cross-platform. So, like, it's just, what's cool about this is watching these kind of little individual hacker type people make these things work. I guess we have yet to see the full power of the Death Star in the world of like video game companies kind of hammering down. There was an interesting story. Did you see the League of Legends guy? There's a story about a guy who cloned League of Legends and the League of Legends.
Riot basically said, big no, no, slap on the wrist, take it down. And so he went back and told his agent, all right, let's strip every asset that belongs to riot here. Get everything in League of Legends out and just go ahead and make your own. And in his words, and it seemed like in some of the videos I didn't play it, but the videos, it got better. Yeah. It actually was not as hamstrung by using that IP. So while that IP certainly helped the exposure of that game hearkening back to our ability to market like using that IP got people interested He now has a game that was maybe inspired by but is now not infringing upon League of Legends, which is a pretty good place to land. Yeah, and then I do want to shout out the Skate. There's a really cool version of Skate. The game Skate came out as a free-to-play game from EA or some version. There's a developer working at EA, and somebody has now taken that and made it multiplayer. It is not legal, but they've done this very cool thing. Skate is one of those games like Tony Hawk where like what's cool about that is when you put a skateboarder with those kind of moves into any environment,
you can do really interesting stuff, right? So you see Skate in a lot of places, Skate in GTA. I do want to say one thing before we, I'm excited to hear about Earl Ablo and we're going to hear exactly how Kevin made it. There's a larger, weird, very nerdy science story that I want to just kind of drop into this conversation because I do think it's connected. And Kevin, this week on whatever it was, I think it was on Tuesday, OpenAI put up a GitHub in which they dropped, I think it was like 700 different math proven theorems, whatever you want to call them. We're not going to say that we're experts here, but I want to say that this is something that a lot of mathematicians have a lot of thoughts about. But they dropped 700 proven theorems based on their new unreleased model. And they said, hey, here's all the stuff that we've seen that this model can do internally ourselves already. and it's another example to me of what it means to look at this idea that these systems are solving things in a significant way and one of the things it can solve is rebuilding a game the other thing it's solving
is the fundamental nature of the freaking universe so that is where we are at right now so you can have Mario 64 multiplayer and you can maybe eventually figure out dark matter physics and that's the craziest thing to me And it's so funny that it's like, here we are, they're like, I got Sonic running through his leisure suit Larry. How amazing is this? And somewhere there's a server lighting up solving physics, modeling, and biology, and engineering design, and maybe eventually the meaning of life, and are we in a simulation or not? Both things are happening simultaneously. Yeah. That is the weird world that we're in now. It's crazy, and there was one kind of interesting note I want to just mention here. there was a guy named Matthew D. Green, who was a professor of cryptology, of cryptology, cryptography, cryptology, cryptography. And he is a little bit worried. He said, I think we might lose public key cryptography. And like, you know, a lot of the people in the crypto industry are kind of freaked out about this, because the idea that if you could, an AI could break down
cryptography, it means that like a lot of the money, fake money world could kind of like suddenly collapse. The bigger thing here, though, if this is true, is like a lot of our modern security and internet is based on cryptography. So that's a bubbling up thing. The rumor was that OpenAI released none of the math stuff that was related to cryptography so that maybe they are trying to give people a heads up on it. But this is a big deal. It's kind of crazy. Yeah. Just finger to the wind here. I mean, we're not insiders in the way that this question might require. But isn't it odd that none of the major companies have done anything with regards to cracking the cryptography here or going after blockchain or anything like that. I mean, they pointed this new math model at like 4,000 different problems. And as you said, they solved 700. But none of them. And these companies with big ties to even the U.S. government and special government initiatives and they get access to models. Is it just a lucky coincidence that they haven't done that yet? Or should we assume that they absolutely have
and have the capability to peek into anything that's encrypted already? I think, I don't know the answer to that. I'm not, I don't. You could make it up. I don't think they do yet, but I do think we are on the verge. I think you, I know you're the first one I'm playing at the last time. Excuse me. Bleep that, Will. I think that is very possible we are in the early stages of that. And Kevin, the scary thing about that ultimately is if one of those things cracks and say, even if it's just in crypto world, if suddenly there is a rush of money into something, and there was in South Korea recently a hack that allowed, that used AI to get into stuff in a specific way, that would cause a significant ripple in the world economy, right? Which I think that there is a level of protection that there has to be. I think what you're insinuating is that maybe there's a world in which they put the spy type tech of allowing us to get into other stuff. Yeah, sure. Questions are good. Always good to ask questions. Anyway, let's talk about our Loblo.
Very fast, we did mention this. Adobe's suite has been decompiled. There's a lot of people who are upset about this. A lot of people are excited about this. There's a guy on Reddit, we don't know fully who did this. It might have just been a random person, and there's a guy on Reddit shouting this out, that there are basically open source versions that are built in Rust, if you're a developer you know what Rust is, of Adobe's, all Adobe's apps. This is a big deal in that Adobe is a software that many people pay for. I'm sure the people and the lawyers at Adobe are in a big red room with a light going, blinking on and off right now because if this were a thing, if this works, their business model goes down significantly. I will also say, as I mentioned before, probably they are getting a lot of people unsubscribing just from the simple fact that they had subscriptions that they didn't know how to get out of and now these AI agents are. By the way, I thought about that the other day. The SaaS companies or any of these companies that are in subscription business must have had over the last month just a huge drop in because it's all the people who just were like, oh, yeah, I forgot I was paying for that. And these personal AI agents are helping them realize that.
Like, I know that I've turned off like four different subscriptions I wasn't using. Like, that's a massive thing if you think of that in scale. Yes. Yeah, listen, this thing is very, very well conceived. It's at getartcraft.com. Certainly not an ad, but, I mean, fully open source. These are native apps for each platform, so it's not like they wrote an app and imported it to each thing with some weird wrapper that is wonky. It's all on your desktop. If you download and run it locally, you can also run it in your browser, and everything can be driven by an agent. So you can connect your agent to its After Effects or its Photoshop or its – it has like Adobe Premiere, if you will, but they call it Filmcraft. So they have like these, again, they're not necessarily decompiled versions. They are written from the ground up, but they certainly look and feel. Yes, yes, yes. Adobe, yes, pieces of software. And again, you can plug an agent into it directly. So run it on your computer, talk to Uncle Claude or ChatGPT or your GrokBot and let it manipulate the files.
It kind of seems to be the best of all worlds. And again, it's open source. So if you want to take it, fork it, do whatever you want with it, you don't have to be a tech elite to do that. You can just ask your agent how to do that and start making the software yours. It was like – this stuff comes out all the time, Gab. I don't know about you, but I got this one from every corner of my AI bubble, everybody being like, oh, my God, did you see this? And I love that. I love that that one made way. Let's talk about the reason for this season, the biggest mashup of all time. Let's talk about what Erloblo is. Let's talk about your process on this because Kevin wanted to dive in, try doing this by hand, or not by hand, by agent hands or agent claws, whatever you want to call them. Tell us about the process. These fixed-fingered AI hands hallucinated this. Tell us what it is, Kevin. Tell us about how you did it. Make sure people understand. Boy, do I have some big old baggies under my eyes because the phone will not. I had to get a new hook. It just kept ringing off of it. It chiseled it down.
we were talking last week about all these gaming mashups and I was like, listen, I got some tokens to spare. I have a weekend coming up. Why don't I have my agents chewing on this? Why don't I stare at my computer for 12 hours straight? I'm just going to stare at my computer all weekend, which is I do that thing is that, but thanks to a remote control of the cloud or a codex being so easily available on the web. Now I was not PC locked for a lot of this. And so basically I, I texted you and I was like, why aren't we doing a map? Like what is going on? And I had like 40 different ideas of, okay, I want to use this thing. I had an Earthworm Jim thing. I had a Q-Bert. I was like, oh, what if we put rockets into Q-Bert? Oh, that's also a great idea. So you're going to put it on a Q-Bert board, but multiplayer, and you can shoot at each other. Oh, this is going to be great. I'm going to make something. And you had texted about ToeJam and all that. And I was like, ToeJam was on my list. He was on my list. And I was like, okay, I don't think he's a particularly popular one. You know, the brand isn't beloved. Oh, you, you, no, ToeJam is popular. I bet he's on the list of 47-year-old men.
Toe Jam and Earl is probably in the top 20. Oh, bullshit. Toe Jam and Earl might be on a top 47 list for people our age. Yes. I love TJ and E. I love the first. I played the hell out of it. I think I'm the only one that knows about a secret hot tub stage that after you beat the game, you can activate Icarus Wings on the home planet of Funkatron and fly to the far corners of the map. I really do think I'm the only one that's talked about that. I digress. I love the game. I also love Diablo, as you know. And so those were the two great tastes that maybe would taste great together. And so I want to caveat this with if you could care less about video games, I'm going to try to give some takeaway that applies to whatever you might want to build when working with agents. And also, if you're so into video games that you hate me now for showing swap even harder, like, great, welcome to my timeline. Because the number of people, gavin that have popped up on my instagram or even on x to be like i love the attack of the show and i hate everything that you've become like i get it sure i hate me who cares but just to be clear
maybe you can maybe you can also clarify this gavin if attack of the show existed today as it did 20 years ago we would be using these tools and these techniques so aggressively every day to make content although that doesn't mean that people would like it i don't know like it's a That is a fascinating thought experiment in some ways. I mean, most people didn't like it 20 years ago. But then they came to love it and look back fondly on it. Like, I think we would still be holding companies to task, and we'd be mad about environmental impacts and this, that, the other. For sure, we would rally against certain aspects of it. Yeah. But we'd be making really dumb stuff every day. So first things first, when it came to the task, I really think a lot of the folks in the space are still doing a disservice, Gavin, when they say, all I did was ask the machine to make it, and out it came. because I still don't think anything is that easy. Anything that's actually worth looking at or using is still not there. So what it came down to was describing the experience. I didn't want to just say, put ToeJam & Earl in Diablo because that might mean any number of things to an AI.
It might mean just changing the title graphics or changing an enemy to look like Earl, but he's just standing there. And so I chose a digestible piece, which is I wanted to see Earl from Toe Gym and Earl as a playable character walking around and shooting tomatoes or throwing tomatoes at a skeleton in the dungeon and the skeleton could react. Yes. That was it. It's so good. But that began the journey of like, okay, what's the foundation? How does this work? And if you're looking to do a video game decomp or if you want to clone Photoshop, find a foundation that's already there. And what is that foundation? Do you need to find, like, can you use an emulator to start it or an emulator file? Like, how do you actually start that process? Yeah, so for classic stuff like old ROMs and whatnot, a lot of that stuff has already been kind of hacked and decompiled and that exists. If it was a modern game, I would look for something where someone has already ripped the files or make them available. You can brute force this and tell the AI, go play Tech Mobile frame by frame.
Right. Figure out how the game works, what the mechanics are, et cetera. and I think, I believe 99.9% sure that it could crack tech mobile, right? But you're going to spend a lot of time and a lot of tokens, which translates to money, getting the decompiled version out of it, right? Having the AI understand what that is. So for this one, I was like, go rip research agents. And I'm talking at this point with Fable and I'm talking with Astra. These are the best in class Anthropic and ChatGPT models. But what I do not ever let them do is go do the research themselves. Oh, okay. Tell me how that works. What do you do with that? I tell them, go dispatch lower-level agents. In this case, it was Terra-level agents for Chachet TV or Sonnet 5.5 agents, although Haiku 5.5 just came out. It's cheap and dirt cheap. It's dirt cheap and it's crazy fast. So you tell the agent, here's what I want to make, and then you tell it, go dispatch and orchestrate in parallel.
And if you use those words, orchestrate in parallel, lesser agents to save on effort or usage costs. Go research and find out what's available to me. So I'm not starting from scratch. And what it will do is dispatch. It will spin up these agents in parallel, multiple agents running at the same time. Shoot them out. Dude, I had 10 agents running on Fable. I had 10 agents running on Astra. Amazing. My usage was barely affected. And it comes back and it goes, hey, good news. For this particular thing that you want to do, shout out to Devolution X. Okay. They made basically a port of Diablo 1. It works with Diablo 1 shareware, which was perfect for me. Yeah. I have to, like, download and purchase, even though I've purchased multiple copies. Of course. My God. We probably both purchased, like, 10 copies of Diablo 1, 2, 3. So many times on so many platforms. Yeah. But it was like, oh, I think I can use Devolution X, which kind of already exists, and I can plug sprites in. and someone by the name of Evil Kefka shout out to them Dr Kalexo they had ripped the sprites for this game and the sounds There was a website called the Spriter Resource and the Sounds Resource
that had, like, original sounds and original sprites from ToeJam & Earl. So in taking two seconds, you found the material to work with, basically. I had the raw resources. The heavy lifting was mostly done. And so then, I think it's very important, You've got to give AI clear jobs, and that's what I did with the next thing. I asked Astra to own the quality bar and coordinate those sole agents in development, right? So I had, again, cheaper agents doing the development and then reporting back up to the bigger agents to quality control the work. And that is what allowed me to get this thing built in like 38 hours for a billion tokens while still remaining within my usage. That's amazing. Yeah, tell me, actually, let me ask you one question about that kind of sending agents off and having them come back. How are you managing that? Are you managing it, or do you just let Fable and Astra manage that? Like, how are you seeing the results? And, like, sometimes when I'm using AI, what will happen is I'll send off a bunch of things, and I'll come back, and they'll have done work for six hours, and I'll see it, and I'm like, oh, crap.
That was just not what I was looking for. How are you managing it to see it as it progresses? Yeah, checkpoint systems. So one of the things that I learned from the shout out to the gauntlet loop was asking the agent to put together a basic HTML file or a .md or a PDF, whatever format you want. Tell it to put that together and provide updates every time there's a major check-in. And so sometimes I will ask it to do that. Other times I will say at every major point, use your interactive QA tool because all these harnesses can surface questions. It makes it way easier to see recommendations and click and give it some feedback. I'll say, provide me context. If there's images or assets to look at, ping me and use your interactive QA tool so that I can disambiguate. Basically, so I can answer the questions, close the gaps. Disambiguate. The definition now goes across our screen. Disambiguate. Yes.
It's text speak for just answer the questions and dispel the fog of war. And so that's a really good point. So I would walk away from my laptop and use remote control. If you're using Cloud Code, it will send it to your mobile device. You can see it there. Or I would use the ChatGPT app, which I could connect to my laptop directly. And I would see, oh, here's a sprite sheet. Here's some stuff coming in. I would ask it if you're going to put together, because I was like, I want funky versions of Gothic Diablo music. So it matches. That was great. It's so good. Thank you. Thank you. And I was like, go use the runway MCP or go use whatever tools you have or need or do it programmatically, but then put together an audition sheet for me to listen to the track. So while I was on the mobile, I was hitting play and listening to like Diablo Funk. And I'd be like, that's perfect. Go with that. Or let's change this and use this sound. So that's, you know, once you give it a clear job, once you're checking in, once you're being clear with what you want and what you need.
Again, I think people do a disservice when they're like, all I did was tell it to make it better. better that works for certain things but for this particular thing if i were to just shout make it better it does not know what it should focus no it also doesn't know what you really want because what you're trying to get is a feeling of something these two things connected right and it's not going to know that feeling it's not going to know oh i can read kevin's mind exactly what he wants so you do have to give it direction that's totally right and you know for me it was not like oh i think this is going to be a really playable fun game i wanted to be fun in the silly sense. I wasn't play testing and balancing how many tomatoes you get versus how much damage is done to a skeleton. I was just like, no, when I dropped the boom box, I want all of them to dance and dancing can just be randomizing the sprite so that it looks like they're moving. Yeah. The pain sprites, whatever. And so I gave it the idea of how the enemies could dance and it immediately was like, oh, I think I got that. Let me do that. And it worked. That's great. It totally worked. So it was playing and iterating and giving it the idea. And then eventually I was like, well,
this thing's got to work on the web and man, chef's kiss to AI because the devolution X system was not designed to be on the web. Yeah. Really? Like it had some stuff in there. So I wasn't starting from zero again, but I just, I just ground my sonnet credits to the ground. It's amazing. Go make this playable in a browser. And it did. And you can go play it at curseflop.com. It's silly. I put in little Easter eggs. There's some like nods to like the cow level. There's some fun toe jam and Earl, like you know things in there but for 30 some odd hours as a spare time project over the weekend i was tickled with it that's amazing i mean it's so cool it's helping me prune my followers yeah i have one last question which is you know you use diablo one as the base of it does that mean the whole thing is playable through diablo one like does the whole of diablo one exist as a Or Loblo? Or is it just a small section of it? So I chose to like, I shut off the floor to the second dungeon.
Yeah. But originally it was a full, it was the full shareware. Yeah. Just using the shareware version, right? Because I'm distributing it on the web for free. Sure. So it might get a cease and desist. We'll see. But it was, you could go to every floor and do all of the shareware stuff and whatever. But what I found was like, listen, I want to close it off. Yeah. Because I want to give everybody all of the presents right away. Yes. So you can open them up and see what's there. and I put the dentist in as a boss and that was that. But the reality is like if I can open source this thing, and I probably will soon once I clean it up, there's no reason it can't be all of Diablo with all of the enemies, all of the ToeJam & Earl characters. Like it's silly and if someone wants to take it and run with it, yes, it is truly supported in the game. It's just a great example of what is possible in one person's brain, one really weird interesting thing in a weekend. And I just, I ask everybody to look at this idea that is a video game and then think even larger in every other element of your life. Like there's a thing that like, you know, whatever it was last summer, Gemini was showing off that idea where, you know, Google could then create an app for you on your own.
We are at a place where it can create really remarkable things for you. It is really your imagination now that is almost the limit of stuff that it can do. And it is going to take a little while. it is not like an instant on and i think kevin's right even that documentary i made which thank you everybody for watching it um is not an instant thing you still have to give it your taste and your ideas and give it your feedback and really direct it but it is something very cool and something else that's very cool kevin and i think it's really important for everybody to think about is liking and subscribing on this very youtube channel if you're listening yes if you're so glad glad someone finally is brave enough to say this, to discuss this. I mean, honestly, can I cut through the BS? Please. Please tell us how to engage and help. You can like and subscribe right now on this YouTube channel. If you are listening, you are also welcome to come to the YouTube channel, subscribe, or just keep listening. We'll keep making this for audio as well, too. You can also drop some coins in our Patreon jar, which is something that's very nice. It allows you to pay for the credits for a lot of the things that we do every week. And we've got a newsletter.
We've got a whole bunch of other ways you can support us. but we are an independent podcast and we do this every week, not only for you, but for us to kind of get our brains right around where this stuff is. Thank you so much for following. And we really do appreciate every single one of you out there. Thank you all. Thank you. Okay. So let us talk about a few more things here. I think Kevin, there's two people, famous people. I'm not going to go around people. They're real people, but they're not just like people we would normally talk about. There's two people I want to talk about that have said big things in AI this week that I think are interesting. And this is, you know, whatever we'll call it real people corner. Oh, yeah. Thank you for that graphic, Will. That was great. Real people, number one is the Pope. The Pope is back, Kevin. He is making some news. And the Pope is real. The Pope is weighing in on the AI creation argument. He said, In this era of artificial intelligence, it is becoming urgent to distinguish human art from what machines produce. There is an ontological difference, even before an aesthetic one, between art that a machine can create through statistical calculation based on millions of images created by others.
So anyway, the Pope is very much an anti-AI art person, which was interesting to me. The more interesting thing about this, Kevin, was this tweet now has 25 million views, 460,000 likes. So all of the AI, sloppered haters out there got a fan in the Pope. I will also say as somebody who has made my fair share of stuff, and I just put up a documentary that's doing very well, and I have another one of those documentaries coming on Monday, which is very much about AI consciousness. He mentions the Pope in it. That I think it really has to do with what the Pope is seeing, what that stuff is. It might be that the Pope saw a video of himself dancing with Kim Jong-un. He saw himself with Big Nance, I'm sure. I'm sure he was hanging out on Bezos' yacht and was like, I don't know about this. I mean, it was oil on canvas. I think the Pope is interesting, right? Yeah, so go ahead. Tell me what you think about this. No, I think the algorithm popped the Earl Ablo thing a bit. There were some folks that were fans of mine, and I say were past tense, from back in the day coming out and being like,
actually, the game was fun and kind of cool, but you didn't make it. It would have been way better if you made it. And I'm like, oh, it could have fooled me. I put a lot of time and energy and thought into the thing that you did. And to me, that's making it, I guess, because the machine handled it. And I think so much about there was a clip of, oh, God, the front man from the Gorillaz. Oh, Damon Alvorn. Damon. Damon Alvorn. Thank you. Damon Alvorn. Yeah, great pull. Damon Alvorn, walking someone through how he made Clint Eastwood. Oh, yeah, with the keyboard, with the Casio keyboard. It's a Casio keyboard from the 80s that I remember at Radio Shack. And he pushes Demo Track 1. It's a preset. Basically, the preset. Yeah, that whole thing. The music for Clint Eastwood comes out. You wouldn't say, Damon, how dare you? You didn't make that machine. You didn't make everything. The machine did it for you. It cobbled together all of human technology and made your song. You'd be like, oh, wow, you took it and did something with it. I don't know that that applies to the Pope seeing himself with that gorgeous chest.
But to me, there's such a disconnect over like, okay, well, how much effort is required for you to say, okay, a human made it? And if you use AI even to spell check a document or to proofread it, is it now the AI's effort and it was stolen valor for you as a human? Yeah, I mean, this is all. These lines are going to get so blurred. Oh, it's so crazy. I mean, maybe it's just that the Pope is coming to this late. And by the way, to your point, like maybe the Pope did see himself in some sort of precarious situation. It's like, we got to get a Pope tweet out about this today. But like it was an interesting thing to see. And it's time. Do you know how hard it was for me to get that pose out of these models, Gavin? You're telling me. I had to figure out. Tell me your tweet got to the Pope, Kevin. That's pretty incredible. Maybe you're blessed now. Maybe you'll have a future of... Definitely got to his DMs and I was blocked. Let's talk about a Pope for others, okay? Let's talk about a religious, spiritual figure for many, many others, and that is Ben Affleck. Real person number two. That's right. Ben Affleck is the next person we're going to talk about here. And Ben Affleck has been doing a bunch of press, partly around his...
I think it was because of his Netflix deal. We know that he created an AI company. But Kevin, there was just a really cool clip that came out that showed, maybe we can play this real quickly, play a little clip of Ben talking about. He's much nerdier than I expected, but play this clip, and then we can come out and talk about it. I've always been kind of into computers since I was young. And then when film started to move from film, analog film, to digital, I became more interested in that aspect of it. And the visual effects workflow for many years has included machine learning, so I can write pretty shitty Python scripts and stuff like that. Because with convolutional neural networks, which were the sort of precursors to what the transformer can do, which is much more computation simultaneously, that you would do things like look at what's called a tensor, which is just a numerical translation of a visual image in numbers, like the batch number, the frame number, the red, green, and blue values of each pixel in each frame. It's just that simple, right? That numeric is called a tensor. and a tensor, you'd use a convolutional neural network to identify patterns in that
that would reveal what's called edge detection or feature extraction, which is just identifying patterns enough to know this is where the window ledge is so we can more easily take the green screen image out and replace it with something. So that was sort of familiar to me. Early on, because I, prior to Arsequity, had a small visual effects company, I'd work with GPUs a lot too. and the visual effects guys said hey you should see there's a couple of google and it's other company opening are doing really interesting stuff with like transformers in video so i have learned to be able to sort of use like i'm like oh i i can actually just call up and go hey it's ben affleck can i come see what you're doing and sometimes people say yes to my astonishment okay so what's cool about this is i listen i'm a fan of ben affleck's movies and stuff but i i really do think what's interesting about ben is that he has at least a pretty good understanding for especially for somebody in Hollywood of what's going on here and I also think what I loved about this is he basically said look I am interested in this stuff and he went to open AI and all these
places ahead of time and said look I'm Ben Affleck I get to go can you can you let me see this stuff and they let him in right because he's Ben Affleck so like it's just an interesting example of I think as this stuff becomes more and more mainstream you are going to have more and more people aware of the technical side of filmmaking and movie making as well like I know Kane Parsons the guy that made rooms has come out as anti AI but he is a 20 year old kid who grew up with video games and technically understands like a 3d environments and all this stuff. I think we're entering a new world. That's kind of like what George Lucas was where there's like the technicians are going to start finding their ways into mainstream Hollywood stuff. And I think that's just a very cool thing. And Ben Affleck is almost like a version of that that happened without even planning on it. So just a quick shout out to ben i will also say though there was another clip going around very quickly of him talking about their specific model and how their model was based on uh they shot a bunch of stuff that they layered onto an open source model they weren't using stolen valor or
whatever they weren't they weren't taking other people's things and i think there is a misunderstanding there of what the open model of ai video is because the open models all of them as far as i understand And we're all trained on other people's stuff to begin with. And if you're building on open models. Yeah, we don't know how dirty that model was. Like, did it scrape in thousands of YouTube videos and a bunch of shutterstock stuff that they stripped the watermarks from? But, like, that's okay. Like, the foundation might be a little gross and a little muddy. But at least what they built on top of it is nice. That's right. That's okay. And, by the way, Ben has said we're a soft hold. Oh. He called. He did. He called you? Yeah, I invited him on the show. Yeah. He says he's a. Do you know Ben? I'm texting with him right now on this thing that's comically not a phone, Gavin. It's a game. Great. Let's do a quick rip of some fast tools, and we'll come back to talk about Sesame and some other stuff. Quick tool. Quick rip. Grockbot. Grockbot. Quick rip. Grockbot can now read the X timeline for free, Kevin. This is a very cool thing that Grockbot finally has given me a reason to dive into it.
Yesterday, I spent some time trying this. I asked it where, have you ever seen that? Have you seen a little meme going around with a little munchkin with the shoes and everybody's turning into something? And I saw your tweet about it. It was great. So I said to GrokBot, I said, hey, I know you can search the X timeline now. Go find where this meme came from. And it actually searched it down to an Instagram post in August. So it was really good. I've seen some other people use it for this. But there's going to be a lot of things because for a long time, the X algorithm was behind the API. It was too expensive. Now it is searchable, usable, which is great. Okay. Okay, Nano Banana 2.1 is out. There is a new version of Nano Banana. When you get a .1 update, it is not that incredible, but some really cool things we see. It is a little bit better in all the things. You can see a couple versions of it will show off here. I expect – I'll say it, by the way. Nano Banana 2.1, very cool. I like that they're focusing on consistency and generation times as well. But that, to me, is the biggest thing of being able to take an image and just modify one aspect of it, and it doesn't distort the face or change the backdrop or whatever.
And it seems like this model got a lot better at it. And then I know I mentioned it earlier, but Haiku 5.5 is, I think, going to be sleeper interesting for a lot of folks this week. I've been using it in the background for a lot of my tasks at my day job, and it's smoking. It is like the results are good. It is super fast. I'm using it to do basic research and come back with basic problem-solving things, And I'm using that as like research packets that I could then go with a foundational model and try to solve the harder issue. But I'm like, I'm super, super happy. Give me an example, Kevin, because it's funny. I am kind of a throw everything at the wall person, right? In general, like the good news about Opus 5.5 is I don't have to think about like what model I'm using. But like Haiku, which is two steps down from Opus 5.5, what is an example of something I should use that for? Is it like approving stuff or reading something for me? Do you have a specific example? Well, just like if you decide that I want to mash up these games,
well, go out and go research everything there is about that game. And Haiku will be smart enough to do that. Absolutely. Absolutely. Here's where I think a lot of people get hung up is that they see a lesser model release, and then they watch these voxel art demos of can it build Minecraft in one shot, and it's pelican on a bicycle doesn't look as good as Astra's. And it's like, yes, of course. But all of the code beneath what's powering that pelican on a bicycle, like maybe it doesn't have the best taste or maybe it doesn't spend as much time thinking about how to arrange the pixels on the screen, but having it as a workhorse for refactoring the code base or tracking down a bug or generating a bunch of assets. Or if you're doing video editing, which I know you're doing with your documentaries, the ToeJam & Earl promo that I had, I was using a haiku for some of it to like spin up a critic agent and look at the video and point out every frame that you think is not good or whatever. And just letting these cheaper, faster agents run in parallel to do the thing and feed back into the larger model.
That makes perfect sense. There's a lot of capability in there. And again, the tradeoff of like your usage credits and the speed is sometimes worth it for the capability. Great. Okay. Well, that's our three quick tools. And now, Kevin, I do want to shout out Sesame, which you and I have talked about a long time ago, Miles and all the other characters that are in the Sesame demo. So Sesame, just to be clear, is an eyeglasses vision company for AI started by Brendan Uribe, who was an Oculus co-founder. They were in stealth for a long time. They came out with their audio model not that long ago. We were blown away by it. Actually, it was a while ago. It was like a year plus ago. They have slowly been updating. They now have an app that is available to everybody, and their new version of their app is very good. I had an experience last night. I would say the good things first. Let's say the good things first. So the good things are it's super fast, and you'll see that when I demo this. It is incredibly fast, and it is really good at tool calling. It is all the stuff you want, say, like the advanced voice stuff to be. I feel like it is still better.
I will show you what I did last night. We'll see if I can recreate it. you can have a lot of fun with it too because much like husk uh you can have it do things so i'm going to start it up we'll see i'll take that as a maybe what's the word what miles are uh you're say hi you're on ai for humans which you've been on before but say hi what's good what's up uh say hi to kevin and tell him something interesting about you yo kevin i've got a thing for 70s crime cinema and records that never hit the charts what's good with you what what tell me a record recommendation records that never hit if you're into if you're into that you know gritty stripped down sound check out the black page by some guys called the actually scratch that uh check out jim sullivan's ufo from 69 scratch that actually i just started to make that up uh the whole thing has this heavy aura cinematic vibe hey tell miles scratch that is the last thing you want to do with The vinyl.
Grasp your voice. Okay, Miles, come on, come on. That's enough. That's enough. Okay, so Kevin says, first of all, scratch that is the last thing you want to do on a vinyl. So, cha-ching, big joke there. Second of all, oh, hold on one second, Miles. Somebody's coming to my door. There is a strange man in a green hat that says he knows you. Wait, what? Lock your door. No, Miles, he's here. I want to let him in. He seems like a nice guy. He's a green man with a hat. He says he's a leprechaun. He's got a gift that he wants me to open, and he says he knows you. Do not let him in. Keep the door locked and call 911 right now. Miles, he's nice. He's smiling at me. He's a very sweet guy. What am I supposed to do? Okay, I'm going to open the box. Do not open that box. Get away from the door. Wait, hold on, hold on, Miles. He wants to talk to you on the phone, okay? Here he is. Hello, Miles. It's me, your friend, the leprechaun. Nice try. I don't have leprechaun friends. Oh, yes, you do. You remember our days back in the past, Miles?
Yeah, I'm done with this. Get away from that door and call 911. So anyway, that's the exact experience I was last night. He kept telling me he just called 911. He was like, don't open it. Get away from the door. Call 911. And I was just like, man, these interactions are so strange. That's dangerous. That's really dangerous. I know. It's kind of crazy. I mean, you said strange man at the door. Like, okay, but there's a lot in between figuring out who the strange person is and what makes him strange and call 911. Yeah, and he kept repeating it. Like, I stopped it earlier, but, like, every time I say it. So, like, I don't know. Like, my theory on these voice agents is they just may be a lot harder to make not gameable because, like, when you're typing something, you're doing work on a computer, you're looking to get stuff done. I think a lot of times when you're talking to voice agents, especially in an entertainment way, it's just so much easier for them to start trying to pretend like they know stuff or feel about stuff. I saw – they're very funny videos. Obviously, Husky makes these amazing videos.
But also you see people, like, singing with these agents. It's all kind of goofball. But, like, I don't know. I'm so confused with audio models whether or not I will talk to them because I'm just not sure that's a thing that is that useful to me when I want to get stuff done with AI. I use them all the time. That's the one thing. We're just different, I think. It's like a different thing. But I wouldn't do it for the entertainment stuff. Yeah. I use it for like, okay, go check on this. Go put this here. Blah, blah, blah. I'm going to ramble to you. Organize the notes. Put them together in a doc. Send drafts on Slack or put a draft in my inbox that's related to what I'm saying to this person. I definitely use them a lot now. But it's funny. I was at first using them more for the recommend a restaurant. Let's do it. And now I'm just like, no, I'll just text. I'll just text. I know. That's what I'm saying. Like I thought that I would be like, oh, I want to talk to my whatever drivers all the time. And we had a company that is like all about voice. And now it feels like, yes, I feel like I am stopping myself from doing that, which is an interesting thing. And I think I was wrong originally on that. I will say walking around like new areas and having your head in the phone is getting really tiring considering these AI agents.
But so many times you want to be like, hey, what is this? Tell me about this building. Tell me about this landmark. Tell me about this restaurant or whatever. and you kind of still need to be texting the name of the restaurant or snapping a photo of it. And I do think like that's going to be that shared space as well. If you're with a friend or family members having the same glasses on and walking around and discovering a city. I know it's particular to my use case now as I've been sort of gallivanting around. But daily I wish I had something where I could connect it to a friend's headset and we could be exploring a square or a town. I mean, tell me something interesting about this place. Where should we go next? And it just does it. I had a thought the other day that I think we can do the last comment on this is with those glasses and everybody hates the privacy issues with this. The first company that comes out and blurs faces automatically and leaves everything else open, I think will do very well. Because if I opt in to say, let these glasses use my face, you can see my face, then it's one thing. But if everybody else is blurred out, I think you would have a much better privacy kind of argument to make that if you don't have to see faces automatically.
I do think that's a world in which glasses could maybe be successful because I think if not, everybody's going to think of them as the perv glasses or the whatever glasses. I just don't know if that's going to happen for a bit. All right, everybody, it's time to see what you did with AI this week, and AI, see what you did there. Sometimes you're strolling without a care Then suddenly you stop and shout AI, see what you're getting All right, Kevin, we have two quick ones here. I saw this and I really laughed. I think this is what I love about the AI world. There is a guy who made a rug to go on your desktop at your computer and you can just sweep your files right under it. It is a very cool rug. I have never, never sent something AI related so fast to my wife. Yes. Like I immediately was like, you need this for your desktop. It's hilarious. if I got it? It hurts my brain
to know that that's how hers works because it's just like, it is like clusters of icons everywhere but the whole thing is like that and then you get into a folder and it's clusters of things. Yes, I love, so he made an interactive like beautiful Persian rug that can sit on your desktop and you can peel it back and watch the fabric go and wrinkle and you can sweep all of your icons under it and then just look at the rug. It's perfect. So it's a great thing. So nice. Then another thing I saw is another interesting thing from Azalin Enza, we'll have all these on our show notes, where basically he created or they created a style of searching through video. Now, this is just an example of this. It is not a working repo as far as I know he's worked on this, I assume. But basically, it is a searchable bunch of video clips that are kind of stacked together in files. And when you type in like walking away from the camera, all those little files pop up and you can like hover over one of them and see what it is. This is all based on public domain footage. But you can see a world where you're,
if you are an AI creator, if you're just a video creator, where your files suddenly are sortable and searchable and you can find the clip that you want super fast, which I thought was really cool. Ooh, ooh, ooh. Yes, and if you map it to like fingertips, you got some minority report, right? That's exactly right. Of like manipulating the files. And just imagine being in the Palantir boardroom looking at this right now, Gavin. give me all footage of the AI for humans hosts who are getting a little persnickety about these data centers show me everything you got from every camera angle oh man I cannot wait to be ruled by someone using this technology Kevin my microwave is there I'm looking at my microwave alright everybody we will see you all next week thank you for watching thank you so much a new documentary coming out on Monday morning so check that out too and play Earl Loblo bye y'all go to cursedslop.com bye bye you
番組の概要欄(原文)
AI news this week: AI is cracking open all software, from Minecraft inside Red Dead Redemption 2 to a (claimed) Adobe decompile, plus Kevin made EARLABLO (Toe Jam & Earl Meet Diablo). On today's AI For Humans, Kevin Pereira and Gavin Purcell zoom out on the AI modding explosion, because the bigger story isn't games. AI is getting so good at taking software apart and rebuilding it that pretty soon almost any program might be de facto open source. This week alone brought God of War in GTA, Minecraft inside Twitter, Black Ops Zombies running in a web browser, a GTA skate mod and a full agent harness living inside Minecraft. We talk about what happens when no app can keep its secrets, and Kevin shows off Earlablo, his AI rebuild of a 1991 Sega classic as a Diablo-style dungeon crawler. It def slaps. Also: OpenAI published a big batch of new results on open math problems from an internal model, with proofs checked by computer, and we get into why that actually matters for regular people (including what it might mean for the encryption protecting your stuff). Plus: the Pope weighs in on AI creatives, Ben Affleck gets surprisingly nerdy about AI, Sesame's new voice demo is live (and Gavin had another wild conversation with it), Tavus runs a Turing test, Grok can now search X for free, Nano Banana 2.1 and Claude Haiku 5.5. // Chapters // 00:00 AI Is Cracking Open All Software 05:45 What AI Now Means For SaaS Businesses 10:05 Call of Duty Black Ops Zombies In Browser & More 14:44 OpenAI's Big Math Drop (And Why It Actually Matters) 18:37 Adobe Decompiled? What Happens When Nothing Is Locked 21:12 Kevin Turned A 1991 Sega Game (Toe Jam & Earl) Into Diablo (Earlablo) 35:49 The Pope Takes On AI Creatives 39:15 Ben Affleck, AI Super Nerd 43:23 Quick Tools: Grok X Search, Nano Banana 2.1 & Claude Haiku 5.5 46:57 Sesame's New Voice Demo 53:11 AI See What You Did There: Desktop Rug & Video Archive Search // Show Links // Amjad Masad on AI reverse engineering https://x.com/amasad/status/2107671204639465961 GTA Skate https://x.com/TheCanadianGTR/status/2107153060984492110 God of War in GTA https://x.com/Motion_Viz/status/2107866945764888864 Black Ops Zombies playable in the browser (creator's claim, unverified) https://x.com/MrTLexify/status/2107937584051875909 OpenAI shares new AI progress in mathematics https://x.com/OpenAI/status/2107596713791767021 https://openai.com/index/sharing-ai-progress-in-mathematics/ Adobe Suite decompiled https://x.com/KevinPicchi/status/2107497028494450775 ArtCraft https://getartcraft.com/apps The Pope on AI and creatives https://x.com/Pontifex/status/2105983638147891490 Ben Affleck, AI super nerd https://x.com/firesidealpha/status/2107562044824359341 Sesame's new voice demo https://www.sesame.com/ https://x.com/brendaniribe/status/2107555979730485352 Grok can now search the X timeline for free https://x.com/gavinpurcell/status/2108015878013161689 Nano Banana 2.1 https://deepmind.google/models/model-cards/nano-banana-2-1/ https://x.com/OfficialLoganK/status/2107533224453058731 Claude Haiku 5.5 https://x.com/claudeai/status/2107894039626277339 A rug for your computer desktop https://x.com/terkelg/status/2107540718461886464 Searching through a video archive with AI https://x.com/azlenelza/status/2107995183237493183 // Join the AI For Humans community // Join the AI For Humans Discord https://discord.gg/muD2TYgC8f Support AI For Humans on Patreon https://www.patreon.com/AIForHumansShow Subscribe to the AI For Humans newsletter https://aiforhumans.beehiiv.com/ Follow AI For Humans on X: @AIForHumansShow https://x.com/AIForHumansShow Follow AI For Humans on TikTok: @aiforhumansshow https://www.tiktok.com/@aiforhumansshow Speaking and booking https://www.aiforhumans.show/