Going beyond CRUD with AI - This project has consumed me

So, for the past few months, I've been building one of the most complex pieces of software that I've ever personally used as a user, and I've been using Opus 4.6 and 4.7. The software is called Fusion Q, and it is for pool players. So, I got a pool table right here. And what it does is it takes a projector above the pool table along with a video camera that is fed into a PC with an Nvidia GPU and it does live real-time ball tracking and projection onto the table. And I decided to make this software something that other people can use now. In fact, I even had a pool professional, a professional pool player, Rodney Morris, who's in the Hall of Fame, come to my studio and check it out. So, I want to start documenting the process of building this because it's almost finished for users, but also how I'm going to market. Is it going to be successful? I don't know. We'll see. I'm going to show the software here in this video, so check it out. All right, everybody. This is the app so far. Super exciting. Um, before I dive into the drills and stuff, when you install this, it's several gigabytes. So, you have to download several gigabytes worth is because there's a lot of stuff happening. There's a lot of things to, you know, that happen behind the scenes. And there's also a calibration process, which is a one-time thing based on your environment. I'm not going to go into details about that, but essentially, uh, when you set this up, let me make this a little larger so we could see what's happening here. You have a hardware tab. This is where you specify the overhead camera location. You can use a USB cam or an HDMI. All this stuff, by the way, is going to be made really easy to use, especially if you're on online mode because there's an AI integration that you can use to chat with the system that has access to your system specs. It can help you diagnose things and, you know, things go wrong and all that good stuff. Particularly important for like the initial beta testers. Um, optional microphone. This is where your display is for your projector. It's just treated as another monitor. Um, and we also have a ball detection model. don't have to worry about that stuff just yet. And then the calibration process right here. Um it's a multi-part calibration process where you specify, you know, where your rails are. The system needs to know exactly where the rails are. Um like I'll show I'll show you just this one real quick. If I hit uh start, you'll see me there. But if I change to my table, we can see right here uh it shows you the table. And then there's rail lines here. Mine's already calibrated, but if I hold shift and like the down arrow key, you can see it's actively allowing me to fine-tune where the rails are. Hit tab, move over, specify all four sides. You can rotate things if your camera's off access or, you know, all that stuff. So, you just go through this. You specify your pocket locations. Uh, so like mark each pocket, that takes two seconds. check ball detection to see if the base AI model is good enough at detecting your balls in your environment. If if not, then we actually train a neural network. Yeah, I walk you through all this stuff. It's not that bad. The whole process like 40 50 minutes and it's one and done. All right, more on that in the future. Now, dashboard. Let's say you have it all set up and let me switch myself back. And I, you know, there's going to be two different states, drills and games. Uh for now, let's just focus on drills. And I'll show you how cool the drill system is. So for drills, your drills and community, there's two different tabs here. And these tabs, uh community becomes available if you play in online mode. You can also play this whole system offline. You just won't have have access to other people's drills or the ability to publish your own drills that you created. Um and I'm going to show you real quickly uh before we create our own a couple of the different modes. And one of the modes that is really cool is called snooker. All right. So what's cool here is when you click on an actual drill, it shows you latest videos that anybody has created and uploaded and sh decided to share with the community of them attempting that drill. So in the future there might be like 50 videos of people attempting this drill, maybe asking for feedback because you can comment, leave likes and all that stuff. It's like a social network. Now, if I hit edit drill, I let me zoom out the UI so we can see the whole thing. You can see that we have the balls down here. We can just drag these suckers onto the table if we want. Now, notice snooker uh the drill type is snooker drill. And so, this the way this type of drill is created is you have one object ball, one Q ball, and then you can have any amount of these asterric balls. You just drag any amount that you want. And you need at least one. And the idea here is for this particular layout, we can see we have multiple layouts all over the place. The idea here is you hit the Q ball into the object ball, this one ball, and the goal is to try to get the blocker balls between them. Snooker. Let me show you what this exact drill actually looks like in practice. All right, so here is that snooker drill mode. These I have this in random mode. So essentially, it's going to just randomly show me any of the layouts. No particular order. So here's the object ball. Any ball goes there. All right, goal is get the four between the one and the queue. All right, that one's a very simple type drill. Although I jacked it up a lot when I first tried it. 50% blocked. Although for all intents and purposes, it's fully blocked. Now, because I made it, it's not going to make me shoot it again. It's going to move on to another random. So, goal is to get those three between the object ball and the queue. Very simple. Another drill mode that I have created is called the wagon wheel drill mode. So, if I click on this drill and hit edit, essentially, again, this is just one object ball and let's say we want to focus on rail shots, right? Trying to really get dialed in on these rail shots at different angles. So, the first shot is your zone one right here. That's where you you go for your first shot. Zone two, and by the way, we can move these all over the place and add as many as we want, wherever we want. Then you go to zone two. If you miss it, it makes you redo it. So, it makes you reinforce your learning until you get it right. And it tracks how many attempts and how many percentage you that you made. Check it out. All right. So, this is the wagon wheel drill mode. So, you can see there's uh these are kind of hard to see. I have to make them a little bit more obvious, but here's the first one. Just got to pocket this and make it. All right. So, now I get to go to number two. All right, number three. So on and so forth. Very easy until you get to these outer ones. Oh, now I'm glad I missed because now I'll show you. It forces you to redo. Oh, no. I just said a keyword. I I literally just said redo. The system listens to that and it thinks I want to redo. But nonetheless, you get the point. Essentially, what we're just doing is going through uh the different spots and then it forces you to reshoot that same spot until you make it and it keeps track of all your stats here. And also on the main uh stats dashboard depending on if you're putting on a TV or a monitor, wherever. There's also a random drill mode. And so once again, this is just one object ball for this mode. And you can see we have a large CQ ball. I What's really cool is like whenever you place a CQ ball, you can either be, hey, it has to be at this precise, you know, small point or as large as you want it. Uh that means you could place this Q ball anywhere. And then this right here is a landing zone. And the system will just take the size of your landing zone, like if you're really good, maybe it's small, and throughout each round, it will just randomly position this thing anywhere. So, it's really cool. It's I a concept called target pull essentially. So, I Let me show you that one real quick. So, that right there is the layout for this one that I created. And what I do is I can put this Q ball anywhere in here to focus on a specific angle. Put the one ball here. Goal is this is called target pull. Basically I to get the Q ball to end up here. So show me neutral. Okay. So if I hit a ball just like a nice neutral pace. It should end up here. Add right English. All right. Let's try it. Oh, that was nice. Look at that. All right, so now we're going to try it again to a different angle. Oh, all the way back. Show me neutral. Add right English. Remove English. Okay, there we go. Hide cub path. Are you serious, Gary? Did you literally just miss redo? This allows me to repeat the same layout so I can make my adjustments. It'll show me the same spot. I'm probably going to miss it again. Come on, Gary. Focus. That looks good. Oh, come on, dude. Seriously. So, here tomorrow, the next day, I'm actually going to be bringing this to my brother's house as the first user. I have other pool players locally wanting me to set this up. So, we'll see how this cascades. It may just become to a dead end. It might be difficult to set this up in a lot of different environments. I'm not really sure, but I'm excited to really get it out there and see if it could be a success. I'll be sharing more details soon. I will see you all soon and goodbye.