How I made a Pokedex for Real Life with AI / GPT4o
Ғылым және технология
A new Pokemon journey begins as I try to create a real life Pokedex. Using OpenAI GPT-4o Omni and AstraDB Database, here's how I made the impossible, possible!
Astra DB (Datastax todays sponsor):
www.datastax.com/
*Due to OpenAI Pricing, I am unable to run this demo project indefinitely, you can clone your own version for testing, you can do so below:
github.com/adriantwarog/Poked...
00:00 - A Real Life Pokedex
00:44 - Inspiration - Why I'm building a Pokemon Pokedex Project
01:58 - Planning - How to build a Pokedex and Competitors
03:13 - Research - Pokedex Aesthetics and Design
04:25 - Design Preparation
05:30 - Sketching out Ideas for the Pokedex Design
06:20 - Design Mockup - Color Typography
07:53 - Design - Figma High Fidelity User Interface
09:38 - Programming - Next JS Frontend and Backend
10:10 - Database - Using DataStax - AstraDB
12:47 - AI - Integrating ChatGPT with OpenAI GPT4o model
14:42 - Camera - React Camera Capture Images & GPT4 o Analysis
16:55 - Statistics - Creating Stats Map with Data Graphs
17:36 - Voice - Recreating Pokedex Voice using AI
18:48 - Authentication - Next Auth Sign in for Users
19:42 - Database - Leaderboard and Saving Pokémon Entries
20:18 - Database - Vector Database with Astra DB
21:32 - The Pokedex for Real Life Complete
Tools that help me make this Pokedex include: Cloudinary, Fakeyou, OpenAI, Datastax AstraDB, Next JS, JavaScript, React JS, HTML, CSS, Figma, Concepts app, Remarkable, VS Code, etc.
Github Repo: ( Open Source Pokedex RL )
github.com/adriantwarog/Poked...
#pokemon #astradb #gpt4o
Want to learn more? ⭐ Check out my courses! ⭐
📘 Teach Me Design - Course: www.enhanceui.com/
📚 OpenAI + GPT - Course & Templates: enhanceui.gumroad.com/
Software & Discounts:
📦 Admin Templates and UI Kits: bit.ly/themeselection15
💻 Screen Recorder: screenstudio.lemonsqueezy.com?aff=po745
✖ Editor X: www.editorx.com/adrian-twarog
🚾 Webflow: webflow.grsm.io/adrian
🌿 Envato: 1.envato.market/yRZjz2
🌿 Envato Elements: 1.envato.market/LP0OJZ
🔴 Elementor: elementor.com/adrian/?ref=23140
Computer Gear:
⬛ Monitor: amzn.to/3f9DOQI
⌨ Keyboard: amzn.to/3eA5UFD
🐁 Mouse: amzn.to/3xVJO8l
🎤 Mic: amzn.to/3hgCfms
📱 Tablet: amzn.to/3ewt7sa
💡 Lighting: amzn.to/3vOZeZY
💡 Key Lighting: amzn.to/3f6qP2f
Camera Equipment:
📷 Camera: amzn.to/3uCv4J9
📸 Primary Lens: amzn.to/3vT6wMm
📸 Secondary Lens: amzn.to/3tyqWIX
🎥 Secondary Camera: amzn.to/3o2zCGi
🎙 Camera Mic: amzn.to/33tCz9l
🎞 USB to HDMI: amzn.to/33yW9RE
Пікірлер: 361
This is literally the coolest way of using the gpt4o vision ever! Amazing job! I am currently number one in the leader boards with my entries!
@AdrianTwarog
2 ай бұрын
Success!
This is how AI should be used. To leverage passion projects into reality.
@AdrianTwarog
2 ай бұрын
Agreed!
@Kongongongg
Ай бұрын
Don’t be police of fun please
@JohnLewis-old
Ай бұрын
@@Kongongongg What are you even talking about?
@alex.g7317
Ай бұрын
@@KongongonggOI! ITS THE FUN POLICE! 📢🗣️🗣️🫵
@alex.g7317
Ай бұрын
Just wait till your hear someone complain that he didn’t pay anyone to record every line in the Pokédex
Bro a Pokédex with all recognized real life species of animals would actually be dope. And can only capture via camera instead of through photos on-system, and can use AI/lidar to tell if it’s a photo of a real life thing instead of a photo of someone’s computer screen. 🔥
@AdrianTwarog
2 ай бұрын
Exactly!
@BobderBenchpresser
Ай бұрын
Isnt that just Google Lens with a Pokémon Theme?
@Ree1981
Ай бұрын
Lidar! That's smart. I was like "Hmmm, how do we keep kids from cheating? I mean, they'll likely be able to cheat the AI, but once a human becomes involved..... nahhh, that'd take too much resources".
@unquestionabletv
Ай бұрын
@bedxntathat’s not a game
@ariffirdaus5376
Ай бұрын
@@BobderBenchpresser imagine making a pokedex skin mod for google lens
I wasnt wondering why you were building this. It's obviously because its an awesome idea!
@AdrianTwarog
2 ай бұрын
Thanks :)
Oooh x3 sugggestions : - Search by Type - Scanned Objects may have a Potential Rarity which gives a sense of acomplishment and a reason to go on the leaderboards - Auto fullscreen to complete the Pokedex feel - Custom categories for users to sort their snaps in
@HT79
Ай бұрын
How can we determine the rarity of a snap though? For example, (keeping the irl objects aside for now), a Pikachu could be worth more to someone than a charmander but vice versa for the other person.
@lilev1954
25 күн бұрын
@@HT79 its not a value or what is it worth, it's literally how often you can "meet" the object in question, so like a rhino would be ultra rare and a dog or a road sign would be common
wow this video is an absolute masterpiece, showing the whole process is really motivating and insightful
Wow first time I see something like this in youtube
@AdrianTwarog
2 ай бұрын
Haha awesome!!!
Great video and great product! Haven't gone through the source code yet and you've probably implemented this way already but, GPT has problems reproducing the same text for the same prompt unless you set a very low temperature in which case it's usually gibberish. So what would happen is different people scanning Pikachu would create different entries for it. To save on the database size and keep things consistent for everyone, what you could do is have a two layer prompt for GPT. First one will only get the pokemon/rl object name and the second prompt would get the description and stats for the name. The very first time you get a response for the second prompt, you could save it in the db. The second person who would've scan a Pikachu would get the stored records from the vector search. This will even save up on the GPT tokens. Another added benefit would be being able to poll PokemonDB for accurate stats for actual pokemons. Database, however, needs to be redesigned a bit to have two collections - one for saving the embeddings and one for saving the user snaps. Btw, do you have a Gitter or something similar to discuss this more, if interested?
@AdrianTwarog
Ай бұрын
Quite good considerations, and things I think are work building in. I think if this project had a progression plan this would be on the list!
Really awesome project and video altogether. I'm grateful youtube has recommended me your channel, it was a nice surprise. I'm eager to see what enhancements you and the community come up with.
This is the first AI Tech video that actually put a smile on my face. Thank you :)
Fantastic project and such nice presentation on the video. This deserves to go viral, good stuff man.
Dude, you are a genius and you have the cleanest desk and creative process I’ve seen.
Wow! This is inspiring! I'm trying to show my kids what the creation process looks like and how satisfying it is! Pokemon sure is a great way to do this! You always amaze!
@AdrianTwarog
2 ай бұрын
Yep idea iteration to make a project is one of the most interesting things to me!
This is One of the videos I found that actually takes us through the thought process and every detail of how a project is actually made. Thanks a lot Adrian for this, this came to me just in time. It's my first time on your channel and you just earned a subscriber 👍
You legend, this is a really ingenious way to tie all of this cool technology together. Great work!
This was awesome. Motivates me to develop my own passion project and showed me some great frameworks to use. Looking forward to future videos!
Such a cool idea, great result and as a plus a little tutorial how to structure a project like this. These are the videos i love the internet for.
And you did it while recording and creating an amazing production video you are a LEGEND! I enjoyed every single minute watching this video
@AdrianTwarog
Ай бұрын
Wow, thanks!
I’m amazed by your efficiency. great video, love the format. Would love to see more like these!
@AdrianTwarog
Ай бұрын
Thanks
Really nice project! :) a great demonstration that we can stitch several pieces without needing to know any of them in depth and make something unique.
Inspirational how far creativity and persistence can take you. Thank you for this gem of a video 🙏
@AdrianTwarog
2 ай бұрын
Glad you enjoyed it! Yep lots of persistence for this one!!
This is freaking amazing! Shared with all my Pokemon friends!
@AdrianTwarog
2 ай бұрын
Haha that's great!!! Thanks!
@bharl7226
2 ай бұрын
It’s even more impressive that you know real life Pokémon 😮
As a mobile app developer for many years, learned a ton from your video. Thanks for sharing!
Thank you for putting such creative and technical energy and effort into this project and for sharing it, amazing :)
This is insane! As a fellow dev, props on the attention to detail. I can really see the passion behind this. 🏆
I can't even describe how amazing that video is. And there is so much to learn about .
This is super cool, great explanation on the process too.
@AdrianTwarog
2 ай бұрын
the goal was to show how ideas can be put together!
This is really inspiring for a pokemon fan just dipping into the surface of computer science and design! Good work
cool project, thanks for going over your process. took a few things that i'll apply on mine.
Having the "Dexter" voice is what makes this especially perfect
I just recently encountered and learned next JS at work, as a data scientist. Doing stuff with RAG and chatbots, so this is def up my ally. I am also an ALL TIME Pokémon fan, currently playing radical red. Thank you for this MASTERPIECE of a video combining mine and I’m sure so many others love for tech and AI with Pokémon. Keep innovating, you’ve easily earned a sub!
The design... Wow GG, i wish you would talk about it more, how you implemented it. Really nice UI...
I am super surprised you haven't done TS yet! It's a game changer and once you do it there's no going back. Awesome project! I'm looking to do a project like this as well so it's really informative that you went through each step in good enough detail instead of a super high level brushthrough!
@AdrianTwarog
2 ай бұрын
I think I'm going to have to do a dedicated video of me learning it!
This is freaken beyond amazing!!! 😁😁😁
This is so cool. So excited to try it. My first project at my uni was also a C# pokedex. But it is not actually that good but I am proud for my first project. Pokemon is literally my childhood too.
Amazing to open source this. Ill definitely be adding stable diffusion to convert all images into pokemon cartoon style.
이 영상은 어떤 도구를 어떻게 멋지게 써야하는지 집중하는 것이 아니라 결국 무엇을 만드느냐가 중요하다는 것을 상기시켜주었습니다 ㅠㅠ.. 많이 배워가네요..
nice work dude!! awesome!
This is so inspiring to me. Thanks Adrian for making this video ❤
@AdrianTwarog
2 ай бұрын
Thanks lots of effort was put into this!
This is amazing i tried it out and its like my dream come true! I always have been looking for a thing like this that isn’t a 200+ dollar investment. I suggest at some point in time show both types as I noticed that the dragonite was mono flying. Keep up the amazing work!!
Bro's using every gadget and device available in the world jesus
@AdrianTwarog
Ай бұрын
I should of coded some of it in VR too!
Love it! Waiting for updates!
@AdrianTwarog
2 ай бұрын
Haha will add!
Wow, amazing work !
This is fantastic, you can even branch this concept to emulate a Star Trek tricorder, your imagination is the limit. Brilliant !
Amazing! Loved the idea
damn I was planning on doing this too. When I saw 4o get announced with the camera feature I instantly thought “wow thats a real life pokedex!”
I was telling my partner the other day that I wish there was a IRL Animal Crossing Flower, bird, Animal etc catalog you could go and fill out , and sure you could just take picture of your monitor but the fun is in discorvering things on your own imo. this hit that itch very close, first entry is already my doggo!
This is amazing! Well done. A couple ideas to build on this... One is to use generative Ai to give the creature a Pokémon like creative name and a bio. Two is use the photo and the Pokémon like name and description to generate a cartoon version of the creature image. Then the app can switch between Pokémon world and real world
@AdrianTwarog
2 ай бұрын
Both are great ideas, I like the idea of creating a cartoon like version of real life creatures!
@BrianSnyderND
2 ай бұрын
@@AdrianTwarog hey! Thanks for responding. Your work is so creative and technically excellent. It's a rare combination. Well done. 👏
I can't express how envious I am of you for being able to do this and I can't hahaha. Pretty good job mate. The video was also very entertaining to watch! Btw, what was that device where you did the sketch for the project? Cheers!
Really a very very very awesome project :D
This Guys Is A Legend Bringing Our ChildHood Dreams In Our Hand and for Free! omg Tysm For Ur Hard Work We Would Be Waiting
This is the best quality tutorial I have seen online~ I loved you show the whole process in such detail and even open source it! Thank you! I just have a question, the app as it is today costs you money to run... Specially becaude of the calls to OpenAI. How could you make a profit with an app like this? If this were to become really popular I think you would need to turn it down?
You have amazing design skills. How did you acquire these?
really cool the only thing i think would really help is if the initial line was the "dragonite the knight pokemon and the evolved form of dragonair" line at the start and then limit the response to a single sentence other than that great video i thought the use of AI in the title meant you were gonna ask chat gpt to write the code and test it as you implement it, you would be surprise how much that is going to happen in the future though i dont see it as a difference as using an API at this point its just a tool, great vid :D
That ui design is really good
i've always dreamed on this. Amazing
Great video 👍
I watched this video two times. So good!
Really enjoyed this!
Loved it!!!
I swear I was just talking about this a few weeks ago with my brother… Im glad yt showed me this
this is very cool. thank you for sharing
@AdrianTwarog
2 ай бұрын
You are very welcome
Omg! I saw another KZread video where a physical Pokédex was designed. I’m very similar to you in that -that I’ve followed Pokémon for most of my life and it doesn’t make sense for me to not follow it anymore! I really wanted to build something like this but was slacking off because of not having a process in place for this. You video seems to be great for that. I’d be disappointed if this was a tutorial xD
What a passionate project! I love the idea! This is what AI should be used for. Making simple dreames become reality
this is so cool, definitely sending this to my son.
This is AMAZING!! How many days in total it took you to make this project?
Amazing implementation!! Add an icon so that when I add the website to homescreen on iphone, I get a cute pokeball instead of "R".
big salute for making this a website!!
I really hope that eventually you can have all of the different generations of the Pokedex skins available to either buy or swap too, I'm really partial to the diamond pearl version but sometimes you just can't beat the original Dexter. That and If you swap to Dexter you get the original snark with the descriptions heh Best times. But mainly just the skins alone would be dope. Can't wait for this to be publicly available, hopefully there can be a choice when taking the picture also to either upload it to a public database that everyone can share and start collecting stuff togeather or a private one, either connected to your account and privatized. Stored locally on your own phones file or something in-between. Would be very useful to also have a option for accessibility to use for blind people if it had a basic voice command mode. Regardless all of these are just concepts I thought up halfway through the video. You might touch on some of them in the video somewhere later And I just don't know it yet. No matter what this is a freaking amazing idea and is a fellow pokémon nerd who's been there since before the gold and silver games all the way to Scarlet and Violet I'm there with you fellow nerd. Gotta catch em all will never perish, even if the dream gets harder every generation 😂
After identifying a bird, make it resemble the pokemon.
@AdrianTwarog
2 ай бұрын
Ahha probably could do that too!
Loved it ❤❤
@AdrianTwarog
2 ай бұрын
Thanks!
Man, you are the best!!!
This is AWSOME, you are Awsome, thanks a lot, this as an app would be perfect
@AdrianTwarog
Ай бұрын
haha I'm running out of openai credit!
How are you covering the costs for running the services?
I made an app similar to this before the ai era but ai really is a game changer here. There are many id apps out there but as you stated surprisingly none with pokedex style branding. Merlin Bird ID has shown me that audio capture is also a game changer. Can capture 10 birds effortlessly on a short walk. Would be cool to see that option when there is a public model available.
@AdrianTwarog
2 ай бұрын
Woah cool, yes a friend of mine that likes plans loved that you could scan and type of flower or plant and it tells you the type!
this all fun and wholesome but validate what people will upload
Awesome video! Which macbook is yours?
This app is incredible. I discovered that bananas had 5 HP with this. You should add a button that allows sharing an entry (like the banana one) with someone else.
Your though be m process behind it is amazing
Great video!
A share option would be cool, to show others how it looks after scanning something!
Now we just need a 3D printed PokeDex with this AI.
I cannot wait for this :O
Really good job it would be even better if you could make the website a PWA so you could add it to your home screen as a app so it would hide the search bar etc.
I recommend using the new Gpt4o-mini it's a fraction of the cost and should do the same work ! Nice project
@RyluRocky
10 күн бұрын
Fraction as in 1/30th of the price.
I love this. I would like to use this in my classroom. But it needs to be translated to work. I think it would be not to difficult for the AI to add a language feature?
Could you make it that it uses the primary camera by default instead of the ultra-wide camera? Also, when i touch the camera it opens my main camera app, which is nice, but after I take the photo it tells me that it couldn't finish the process because of low memory... But I'm not low on memory. Or it it RAM? I only have 6GBs (Samsung S20FE)
Been waiting for this, after using 4o gpt you can use it as a pokedex already
Amazing 🤩 it would be wild if you could get mid journey to generate a pokemon inspired image from the image inputted lol fun app tho. I see so many uses
@AdrianTwarog
2 ай бұрын
very cool idea to continue building out the concept!
insane content 👏
Love this!
This was awesome just tried it out and it works surprisingly well good job
Please make this into an actual app, I don't care how long it takes, your work is something to wait for, never give up dude!
@bramba0147
21 күн бұрын
Yes then i probely acualy get it
I wish and hope for the success of your project and hopefully Nintendo isn't going to ruin this as well
The cease and desist gonna go crazy for this project
Amazing 🙌🙌🙌🙌🙌
just a quick question, if u let everyone use your openai api key, is that means u let them consume your openai credit?
This is just amazing
@AdrianTwarog
Ай бұрын
Thanks!
What you think about the to rlcd monitor and the big me e ink they said it was good for eyes strain relief
So I took a couple of pictures with it and was pretty blown away, seriously this is super cool, but the next time I went on my pictures were all gone. I’m signed in through Google btw so I’m surprised they didn’t seem to save. Any ideas?