Object detection with ANY camera in Home Assistant - Tensorflow and DOODS

Ғылым және технология

In this video we are looking at Object Detection with Home Assistant or HASSIO using Tensorflow and an awesome community service called DOODS from Snowzach. This allows us to use Home Assistant to send motion alerts or notifications straight to our phones that can look for specific objects or people in your security cameras.
Hardware to run Home Assistant:
Raspberry Pi 4: amzn.to/2Dviwyh
Micro SD Card: amzn.to/3lqBk2v
Micro SD to USB Adapter: amzn.to/2GcAk1P
If you'd like to support me and future projects:
Patreon:
/ everythingsmarthome
Buy Me a Coffee:
www.buymeacoffee.com/EverySma...
Written Article:
everythingsmarthome.co.uk
EVERYWHERE YOU CAN FIND ME:
Everything Smart Home Community Discord:
/ discord
Twitter: / everysmarthome (@EverySmartHome)
Instagram: / everythingsmarthome
Facebook: / everythingsmarthomeoff...
#homeassistant #smarthome
________________________
Some of the links above are affiliate links, where I earn a small commission if you click on the link and purchase an item. You are not obligated to do so, but it does help fund these videos in hopes of bringing value to you!
Music:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Blue Boi by LAKEY INSPIRED / lakeyinspired
License: Creative Commons - CC BY-SA 3.0 goo.gl/1uPfiz
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

Пікірлер: 337

  • @EverythingSmartHome
    @EverythingSmartHome3 жыл бұрын

    I genuinely thought I could keep this under 10 minutes this time 😅

  • @devinhedge

    @devinhedge

    3 жыл бұрын

    No worries, mate. It’s all good.

  • @ameggs

    @ameggs

    3 жыл бұрын

    I think you found a good topic here to expand on and carry much further. Not only to help us subscribers , but possibly a good way to get your channel to blow up with popularity. Good content very well explained.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks Andy! Please let me know what else you want to see, open to suggestions!

  • @ameggs

    @ameggs

    3 жыл бұрын

    @@EverythingSmartHome I would start with expanding and taking this object recognition as far as you can. If you search for doods and Home assistant, there are not many options on here. AI / Object detection is perfect for those of use with many cameras out side to reduce storage space and false automation triggers.

  • @wizbowes1267

    @wizbowes1267

    3 жыл бұрын

    @@EverythingSmartHome See my comment below for some ideas you could follow up on. Basically performance improvements / tweaks would be great. Also I'd like to use this to replace MotionEye - but need something to tie into this to record the video stream when, say, a person is detected. Ideally buffering so starting 10 seconds before and the person was detected, and some time afterwards too. Ideally this would be video stream and not the Doods output as currently that's too slow

  • @giordanogobbo
    @giordanogobbo3 жыл бұрын

    I was looking for this video since month! Thanks for the very good video and keep on going with the channel!!:)

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    I must have read your mind 😅 thank you, I appreciate it! 🙏

  • @waynenocton
    @waynenocton3 жыл бұрын

    And 6 months later, over 15,000. Your videos are very good, if this subject wasn’t for just a few nerds, well, you know. Thanks for your efforts, very helpful videos.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Haha thank you sir! Appreciate the comments and support!

  • @Jeroen_a
    @Jeroen_a2 жыл бұрын

    A massive help this was. wow! i changed the file output to put the images in a folder /config/www/image_processing_doods/cameraname_doods.jpg. just to make it more interesting and not to clutter up the homeassistant www-folder. do not forget to create the extra folder :)

  • @pete1959M
    @pete1959M3 жыл бұрын

    Thanks for a great video mate, this opens up a whole host of possibilities. Once again thanks for introducing me to such an interesting topic

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Anytime, thanks for watching!

  • @spielleips
    @spielleips3 жыл бұрын

    This is great! I just got something similar set up using AWS object recognition, but I would rather have it run fully local. Looks like I'm off down another Home Assistant rabbit hole.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks appreciate it! Haha enjoy! Let me know how it goes!

  • @DustinWill
    @DustinWill3 жыл бұрын

    First video of yours I've seen. Garnered my subscription in the first few minutes. I like the video length. Long enough to cover the details, no more, no less. Keep it coming.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you, really appreciate that 🙏

  • @stevanobalabala
    @stevanobalabala3 жыл бұрын

    Cracking vid and really well explained. Thank you.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you very much, appreciate it 🙏

  • @fitybux4664
    @fitybux46642 жыл бұрын

    Thank you for letting me take this feature for a test drive through your demoing of it. (Wanted to know if integrating my cams are even worth it. I think that's a yes!)

  • @hatran-ir9ic
    @hatran-ir9ic3 жыл бұрын

    A good guide of Object detection with Home Assistant to me. Thanks.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks my friend!

  • @skumavideo
    @skumavideo3 жыл бұрын

    Love this! Would love a follow up showing how to setup notifications and maybe face detection?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hey, thank you! Sure I'd definitely be interested in doing that!

  • @jamess1787

    @jamess1787

    3 жыл бұрын

    Yes yes yes!!!!! Hardware recommendations?

  • @RicoPhotos
    @RicoPhotos2 жыл бұрын

    great session, awesome detail - Thank you

  • @EverythingSmartHome

    @EverythingSmartHome

    2 жыл бұрын

    Thank you!

  • @Ayce47
    @Ayce473 жыл бұрын

    Hello, i just stumbled upon the world of home automation, and then found this gem of a channel. I am planning on building the whole house with my own electronics and firmware (just wanted to let you know what type of viewer i am in case it helps with detailed analytics). I like your aesthetic very much, so maybe you could also do a video where you explain your way of choosing colours, shapes, overall design philosophy? Maybe show us something you do differently when you approach a project, for example your way of thinking about every step from idea to final "product?"

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hello, thank you for the support and for watching! I'll take your ideas on board thanks!

  • @heimdallmidgard4670
    @heimdallmidgard46703 жыл бұрын

    Nice video. Will stay here for more awesome content. Thank you.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks for the support!

  • @kennydedon
    @kennydedon3 жыл бұрын

    Love youre vids ! Subbed liked and commented ! Great man !

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you very much, appreciate your support!

  • @waelkambris6188
    @waelkambris61883 жыл бұрын

    Bravo! The speed of your video is somehow much better now... ;)

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Haha context 😜😂

  • @tonytango6676
    @tonytango66763 жыл бұрын

    Very, very interesting. Thank you

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks for watching!

  • @TexSweden
    @TexSweden3 жыл бұрын

    really great video! thanks!

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you! 😅

  • @mrabasel
    @mrabasel3 жыл бұрын

    Once again thanks for a great video. I love the great balance between technical knowledge and practical application. A question pertaining to this video; is it possible to train the system to recognize a particular person?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks Andre! And I see your question was answered by yourself! 😅

  • @humbledream2
    @humbledream22 жыл бұрын

    Thanks for the great info and tutorials. Keep-up the good work. You mentioned your platform can detect the image in 0.3sec, what hardware you are using? And do you know about what frame rate would be on the RPI4?

  • @thLHC
    @thLHC2 жыл бұрын

    Sweet! Very well done, clear, concise and very useful ! Many thanks. Is there a way to personalise the base of recognizable objects or even recognize specific persons ?

  • @tayfunulu
    @tayfunulu3 жыл бұрын

    simple and perfect !

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks my friend!

  • @bokusean
    @bokusean3 жыл бұрын

    awesome!! thanks!

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you for watching!

  • @jonathanpike5056
    @jonathanpike50562 жыл бұрын

    Great video

  • @ridohaddar
    @ridohaddar3 жыл бұрын

    Great guide.. 👍🏻👍🏻

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you for watching 🙏

  • @arnoldbencz6886
    @arnoldbencz68863 жыл бұрын

    Super video!

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks!

  • @mice3d
    @mice3d3 жыл бұрын

    Great video, I'd love to see someone do a video on setting up openalpr (number plate recognition) would be handy to open garage door, or warn if my mother in law has arrived 😂

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks! I've tried it before a few months back and it's pretty easy, problem is the results were really underwhelming unfortunately, the amount of variance using the same still image was very surprising to me!

  • @PaulRichards1
    @PaulRichards12 жыл бұрын

    dude! very cool!

  • @pepperjackshack2439
    @pepperjackshack24393 жыл бұрын

    I'd love to see how to train the models and also how you did the notification aspect of it. In any regard, here take my sub!

  • @pepperjackshack2439

    @pepperjackshack2439

    3 жыл бұрын

    Also what to troubleshoot if the object identified image doesnt show in lovelace?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks 🙏 take a look at my actionable notifications video and you'll see how to make this exact notification 😅 to troubleshoot, check the logs in HA under configuration, logs.

  • @pepperjackshack2439

    @pepperjackshack2439

    3 жыл бұрын

    @@EverythingSmartHome Ah the logs!! I was able to fix my issues, since i have HTTPS with duckdns I had to do the following, 1. set the image URL from HTTPS://.duckdns.org:8123/local/www/image.jpg to HTTPS://127.0.0.1:8123/local/www/image.jpg 2. in the config.yaml, set doods cameras to disable ssl authentication with command, verify_ssl: false Reboot and its working well. Just need to see also how to train the AI using ML?

  • @PiotrKula1
    @PiotrKula13 жыл бұрын

    I run DeepStack ai which is free docker image that can run locally. It’s a bit flakey though but this video really makes me want to try tensor flow out. Thanks for posting.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you! Let me know how it goes if you decide to give it a try, I'm interested to know the difference!

  • @BigLeafDropper86
    @BigLeafDropper863 жыл бұрын

    great video!

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks very much!

  • @Pedalrakete
    @Pedalrakete3 жыл бұрын

    Great introduction and setup guide. I would love to see a follow-up video hov to program a usecase in SmartHome and Tensorflow, e.g. IF a Human is detected with confidence rating above 80%, THEN turn on staircase lights. But IMHO the background music is not necessare, I personally prefer only the speaker in this kind of explanatroy videos.

  • @Dennis-qm4rd
    @Dennis-qm4rd3 жыл бұрын

    Thanks for another great video, although this is an older one ;-) I decided to give DOODS another go, as Frigate or Deepstack ask a lot of recourses and I don't have a Coral yet. Well, after your video it all worked out very well! I was happy to find out, that my first summary of my frontyard (before entering any names/confidence numbers) contained: 6 persons, 3 cars and .... a GIRAFFE! I ran downstairs, but unfortunately no Giraffe, LOL

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hahaha damn, no Giraffe?! That's disappointing

  • @gfsnunes
    @gfsnunes2 жыл бұрын

    Awesome tutorial. for the record, I couldn't make the generic camera work with doods images. But it worked with this camera platform: # Example configuration.yaml entry camera: - platform: local_file file_path: /tmp/image.jpg

  • @xerxel69
    @xerxel693 жыл бұрын

    Very nice video. I think I’ll subscribe if they are all this good! Ps. How about a version which does facial recognition next?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you 🙏 sure I'll look into that!

  • @theeox
    @theeox3 жыл бұрын

    So for future videos I would find it more helpful if you pip yourself and keep the screen up. I found I lost my spot a lot when you bounced from your camera to the code, but thanks for the assistance. This is really cool.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks for the feedback!

  • @rrschmid
    @rrschmid2 жыл бұрын

    really cool! Now to work out how to change my camera feed from mpeg to jpeg...

  • @vestercasper
    @vestercasper3 жыл бұрын

    Great video , thanks alot! Do anybody know if there's a way to make a non-horizontal top area line? so it is one percentage in the left and another in the right side?

  • @butidontlikehoney9326
    @butidontlikehoney93263 жыл бұрын

    Thanks for the video, really interesting! Could you recommend any cameras for indoor and outdoor to use with home assistant and face/object recognition? Thanks, Alex

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you for watching! 🙏 It depends on your needs and environment but make sure to watch reviews and comparisons and see if the camera does what you hope or expect, that's the one bit of advice I would give! Stick with brands like Reolink, Annke, Hikvision or Dahau and check image comparisons. I've got a video review with some Reolink cameras with image comparisons and I'll hopefully have more coming soon of other cameras too. Hope that helps!

  • @bennylloyd-willner9667
    @bennylloyd-willner96672 жыл бұрын

    Great topic and information as always. I would've liked to see you hold the phone in one hand and a black wallet in the other to see how Tensorflow detected the two. I got an idea to look into later (for me that is - it is very specific). I'm breeding Great Danes and have a bunch of them. I would like to have Tensorflow determine who it is on camera by, for instance, looking at the collar. Even more interesting would be having GPS trackers on them to help with determining which dog is which when there is more than one in the picture based on where they are in the pic (getting a bit complicated, but with the tech nowadays there's almost no limit). All that would of course need more than a Pi, I don't know if Tensorflow can utilize GPUs on a PC?

  • @mihumono
    @mihumono3 жыл бұрын

    Did not look that much into doods but frigate can use google coral for accelerating image processing. (yeah looked into it and DOODS also can use google coral)

  • @muslimkafa
    @muslimkafa2 жыл бұрын

    thanks

  • @EverythingSmartHome

    @EverythingSmartHome

    2 жыл бұрын

    Thanks for watching!

  • @irelandshane1984
    @irelandshane19842 жыл бұрын

    I cant seem to get this to work with my CCTV cameras. You might need to change the "ANY" in the title 😜 but I can get it to work with my WYZE Cam. I'll give it another go 👍 very good video.

  • @EE-su7mb
    @EE-su7mb3 жыл бұрын

    Hi, thank you so much for this! You explain things so well. Is there any chance you could also include a Google Coral into this setup and show us how to configure that? It would be super super awesome! :)

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you for the kind support! I'd love to one day if I can get my hands on one 😅

  • @EE-su7mb

    @EE-su7mb

    3 жыл бұрын

    @@EverythingSmartHome cool thank you. Can I get you a few cups of coffee to motivate? :)

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    If you'd like to support the channel to do more projects like then it's always very much appreciated but please don't feel obliged! Your comments and feedback are great too!

  • @alexmonras1572
    @alexmonras15722 ай бұрын

    Awsome!! Could you make a video explaining how to trigger events based on this? I want to trigger my sprinklers whenever it see cats in my plants

  • @aaliankhan4998
    @aaliankhan49983 жыл бұрын

    Hey, great video I always wanted to do object detection. I was wondering about the minimum system requirements on running a system like this. I am looking to run foods and home assistant in the same system

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    You can run it on a Pi, you just might get slower results and detections and probably will only manage to do a single camera!

  • @PM13501
    @PM135013 жыл бұрын

    Louis, this video is awesome...hats off to you!! Here is a question that is very specific to my situation, I am running Home Assistant and Zoneminder on a dedicated single rack sever (with Nvme card for hard disk). In the past I found that Zoneminder had better capabilities to handle cameras, motion detection and camera related things. But your video shows quiet the contrary, do you think it makes sense to remove ZM from the machine (since it is using same hardware) and go all in with HA?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you Pankaj! Hmm I guess only you can answer that unfortunately, perhaps you want to install it side by side and see if it has the features you need and want and then evaluate from there?

  • @philtype-r810
    @philtype-r8103 жыл бұрын

    Great video! One thing: I think you should mention that the www folder is NOT protected by auth, meaning everyone on the internet knowing the link can access the image (assuming you’ve exposed your HA with an external URL). Better set the file_out Parameter to another location and set up the camera with platform local_file.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks! Yes that's a good point, I did mention it in previous videos but yes for sure, it's definitely worth mentioning! Cheers

  • @philtype-r810

    @philtype-r810

    3 жыл бұрын

    @@EverythingSmartHome ah okay :D anyways, thanks a lot for the video and for bringing DOODS to my attention! Works like a charm!

  • @markiankolonsky7430
    @markiankolonsky7430 Жыл бұрын

    So with this object detection, can one also set up automations as a trigger? Like, if a person is detected, turn on patio lights. etc

  • @marktomlinson6922
    @marktomlinson69223 жыл бұрын

    Great walk through thanks, you have a new subscriber :), just one follow up question, how would doods handle multiple cameras (say 4) what would the config be? ( if it can do it)

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hey Mark, thanks! You just add multiple entities right below your existing entity. Just make sure you have the hardware to handle it! Hope that helps

  • @rsur2000
    @rsur20003 жыл бұрын

    Great tutorial. Can you make tutorial on how to make the notification appear on iPhone if a person show up in camera? Thanks

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks! Already did it, the very next video after this one :)

  • @waelzayed
    @waelzayed2 жыл бұрын

    I have a question that could be basic one. The docker command is not recognized in home assistant terminal!

  • @devinhedge
    @devinhedge3 жыл бұрын

    Landed here from the Reddit r/HomeAssistant post. This is a really great post and gives me another approach to experiment with. META: my last three of four online interactions have been with people having a Scottish brogue. How cool is that?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hey Devin! Thank you, I appreciate the support! Haha that's awesome, is it really that obvious in my voice?!

  • @devinhedge

    @devinhedge

    3 жыл бұрын

    @@EverythingSmartHomeNay. I’m a linguistics nut and just love “decoding” the “where in the world has this person spent enough time to be influenced by the local language/dialect?” I’m originally from NW U.S. and grew up in the rural SE so I was always picked out as “you ain’t from around here”. We hosted many exchange students in my high school years and my NW family is quite multi-cultural, so I learned about other cultures and ways they celebrate their heritage. Then I married into the House of Neal (O’Neal) and Clan Lindsay so wearing a kilt with the family tartan was seen as “normal” during certain times of the year. :-)

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Haha awesome man I love that! I always think I don't have a strong accent, particularly compared to certain areas of Scotland but I've had a few comments now so I'm guessing I do 😅 Thanks for sharing man!

  • @caiosaoliveira
    @caiosaoliveira3 жыл бұрын

    Hi. Great video. Question: Are you running HA and docker on the same server? Any benefit on separating in different servers?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hello! HA generally runs on docker unless you are using the python version. Hope that helps!

  • @PauloAbreu
    @PauloAbreu2 жыл бұрын

    How would my configuration.yaml look like for 2 cameras? I tried to duplicate the block of lines for a second camera (adjusting the camera entity, of course) but I think as they have the same indentation the last block overwrites the previous one. Any guidance would be appreciated!

  • @saforever7470
    @saforever74703 жыл бұрын

    Subscribed! Question are you able to set zones so dood only detects in certain areas?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks! Yep sure can, check the integration documentation, you can set an x and y coordinate to limit the detection area

  • @cooljey86
    @cooljey863 жыл бұрын

    Very cool video! Just to make sure I understood the setup. Do you have to run DOODS on the same device as HA? If not is it possible to run DOODS on a separate RPI so that it doesn't burden the main HA RPI?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks! You can run it wherever you want, that's kind of the entire point of the project that you can run it anywhere! Install wherever you would like then change the address in the config. Hope that helps!

  • @teslabolt007
    @teslabolt0072 жыл бұрын

    What do you have HA installed on? I am running it as a virtual box on my Macbook Air and I can't run these commands.

  • @brianipsen1285
    @brianipsen12852 ай бұрын

    What kind of hardware would be required to run DOODS - I assume it will require some CPU power to process the stream(s) ?

  • @chrisrosenkreuz23
    @chrisrosenkreuz232 жыл бұрын

    is there a way to have your vm hass run on a laptop set on a low poer state so that it makes less noise? i got it right next to my head and can't afford to set it up otherwise... Also, how low would it go? Like sleep or hibernate even an option? I know it wouldn't make much sense, still just thought I'd ask.

  • @thomasbpetersen
    @thomasbpetersen3 жыл бұрын

    Great video. what if i need to add more than one cam?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks Thomas! You can simply add another entity underneath the existing one! You'll need to adjust the file_out parameters - make sure to check the HA docs for this integration as there is an example in there of how to use it.

  • @thp1202
    @thp12023 жыл бұрын

    is it possible to get this running remotely for instance in a car? really would love to have a system that alerts me when a scanning car drives trough my street(they scan your number plate for parking) because that would save me allot of fines every year.

  • @MatthewBayard
    @MatthewBayard3 жыл бұрын

    Could you train it to detect you about a certain car or van? Like be able to tell you when UPS Van turns up? Or your own car?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Perhaps you might be able to yes, I haven't experimented with it but it should be possible

  • @stevez182
    @stevez1823 жыл бұрын

    Really nice video! Keep up the good work mate! Quick question. Is it possible to get the number of detected objects (i.e. cars) and pass that information to home assistant?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you very much! Yes all that information is already passed through by default. Hope that helps!

  • @stevez182

    @stevez182

    3 жыл бұрын

    @@EverythingSmartHome Awesome! I had this idea a while back to point a camera to the parking spots across the street where my permit allows me to park and get notifications when a spot is free in case I parked somewhere else. Not useful for long period as I will move out soon but sounds a fun task for the weekend.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Oh that sounds really cool!! Let me know how that goes I'm really interested!

  • @AMacProOwner

    @AMacProOwner

    3 жыл бұрын

    @@stevez182 Leaving a comment here for notification on an update. This is a superb use case.

  • @JamesBonsor
    @JamesBonsorАй бұрын

    Would this work on a Mac using a Hikvision NVR and cameras?

  • @BobSmith-wu2ll
    @BobSmith-wu2ll3 жыл бұрын

    Thanks for the tutorial! Is this install method on Home Assistant Core? Or hypervised (HassIO)? What difference would there be in getting this to work through the add-on store?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hey Bob, it will work on both since we are using Docker in the background. Technically the install of DOODS doesn't require Home Assistant. Hope that helps!

  • @pavolholes
    @pavolholes3 жыл бұрын

    Hi, great videos with great content! Lenght is perfect. Do you think it would be possible to trigger recording in BlueIris? I’m thinking about having a low res continuous recording a plenty of Doods motion detection videos in 4K. Thanks!

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks Pavol! It should be possible yes, I think BlueIris supports MQTT doesn't it?

  • @pavolholes

    @pavolholes

    3 жыл бұрын

    @@EverythingSmartHome Yes, it supports mqtt. And I’m hoping also http, because I prefere not to have mqtt middle-man if possible. I’m just waiting for my cameras to come so I’m preparing all for it in my head in advance :)

  • @highjack77
    @highjack772 жыл бұрын

    Great Tutorial thanks, very usefull, Have you ever tried to create a custom dataset / model for doods ? I'm currently trying to detect eggs in my chicken coop but I'm struggling to create the model, any tips ?

  • @EverythingSmartHome

    @EverythingSmartHome

    2 жыл бұрын

    Thanks! I have indeed, tensorflow models are insanely complicated to do unfortunately, I'd look for a pre-trained one if I were you

  • @tonydunne6985
    @tonydunne69853 жыл бұрын

    Hi Great video still cant get mine to run . Are you running hassio in docker or running portainer in home assistant

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hello, thanks! I don't use portainer no and yes Home Assistant is running in Docker. If you need help jump over into the community discord and I'll be happy to help out!

  • @lordnex924
    @lordnex9243 жыл бұрын

    This is exactly what I’ve been looking for!! Hopefully my RPi4 8gig will handle it all. Nicely done sir! Question: I looked on your sit for a written version so I could check the configuration easier, but could not find even this video linked yet. Any chance you could through the config variables into a file for us please? Easier to look back and make changes with. Secondly, can you get this to detect specific people? Like it would know if it’s me or my family with a confidence of 90% so unlock the door? Thanks again man and keep up the very cool work!

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you, appreciate the support! Sure I'll try and get that up for you! Unfortunately no not possible with this I don't think but you might look into OpenCV if you want to try to recognise specific people. Hope that helps

  • @lordnex924

    @lordnex924

    3 жыл бұрын

    @@EverythingSmartHome Well I was able to get it up and running on my 3 outside Wyze cameras. Now these are Wyze Pan Cams with the newest rstp firmware installed and then an rstp stream in Home Assistant through an ffmpeg camera. I can get the streams Into HA ok but they can sometimes loose the rstp stream and I have to reboot the camera. I have each of the 3 cameras output to their own file. And then only look for people and cars. I then setup a basic automation that if the image_processing.sidedoorcam changes from “0” to “any” to send a notification to my phone. Now I just need to figure out how to attach the processed image to the notification. It does seem to be a bit slower with rstp but that might also be an issue with the beta firmware and instability that Wyze has right now. Hopefully we’ll see more native Wyze support in the future as the price point for these cameras make them too attractive not to be functional with HA. Currently with 3 cameras processing at 5 seconds each my RPi4-8gig is running between 20-30% processor utilization. Even though that’s low it doesn’t seem to be able to process the images any faster. I’ll have to look into optimizing and setting up custom detections. Of course I’m running my entire HA environment on the same Pi so I can’t have all the processing power for image rastorization. It’s currently running about 50 various devices on my property and more are coming lol. Eventually I’d like it to recognize me and my family and if our phone is also in the geofence to unlock the door and play an announcement. Anyway, please let me know what you think or if you have any ideas or suggestions. I’m also wanting to tie the cameras motion detection into a sensor I can use in my Home Alarm. I’m using the one in HACS under automations. And thanks again!

  • @lordnex924

    @lordnex924

    3 жыл бұрын

    @@EverythingSmartHome ohh one other thing. I added the DOODS component directly through HA add ons by just adding that guys repository. Doing so I notices he has another app up there called RSTP 2 Proxy. From what I can tell it should take and recreate an RTSP stream from any ip based camera and seems to allow for some image tuning prior to processing the image with doods. I’m going to look further down this path as all of my cameras rely on rstp and currently @Wyze has basically no support for this minus their beta firmware. Have you had any chance to look into this or any other software that might preprocess the image prior to output as a stream? I know motionEye also has a similar feature but is such a processor hog

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hmm your camera's shouldn't be dropping the streams if they are just RTSP, hopefully you can get that working first. For performance tuning you can modify the settings inside the DOODS container to tune for performance, you can also change the models used for detection and change cores, image width etc which should hopefully help

  • @lordnex924

    @lordnex924

    3 жыл бұрын

    @@EverythingSmartHome do you happen to have any documentation on that by chance? Right now I’m just trying to get the image into a iOS notification. One of the things I’ve found is that DOODS doesn’t actually write a file unless it has a detection. So even if the scan_interval is set low, if it currently doesn’t detect anything, the generic camera appears offline or static.

  • @noshybabs
    @noshybabs3 жыл бұрын

    This is really good but it would be good if you could show is an example using RTSP.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks! There is no way to use a direct RTSP stream on it as far as I know, but you need to create a camera first inside Home Assistant with an RTSP stream and then use that camera, which is what I demo'd in this video.

  • @noshybabs

    @noshybabs

    3 жыл бұрын

    @@EverythingSmartHome i managed to get it working with a camera but I can't get the nice moving doods image like you have here.

  • @denisgrabocka1269
    @denisgrabocka12693 жыл бұрын

    Hi there i just run across your yt channel and i must say great way of explaining things .. i am running HASSIO as a VM on unRAID any ideas on how do i implement this ??? How do i do the docker part ?? Thank you

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks for the support! You can follow the same steps in the video and it will work 😅

  • @alex_ortiz
    @alex_ortiz3 жыл бұрын

    Wow! This is a great video. I have looked into this topic a lot recently. I've considered zoneminder in a docker container with the event server, but would prefer to have this setup. Then I can use ZM or motion to record constant video. Is there a way to use a notifier to trigger the doods detection. For example have motion or another service notify doods to start when it detects motion instead of doods processing images every couple of seconds?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank Alex, I appreciate it 🙏 hmm that's a great question, love the idea. It would depend on your camera and if it supports the "motion" sensor within HA. I suppose you could hardwire your own motion sensor as an alternative. Or you could fire an MQTT event in from Zoneminder to start it

  • @gadget7894

    @gadget7894

    3 жыл бұрын

    @@EverythingSmartHome ... i never knew this was an integration untill seeing this video !! so did some digger and on the HomeAssistant page it does list a way to only activate a scan when motion is detector.... basically making scan interval very large, and then calling it as a service, when motion is triggered ( of course you would need that in place, via a different method like via MQTT etc etc) ive not tried but the setting are there at bottom of this page .. www.home-assistant.io/integrations/doods/

  • @isamyousaf4995
    @isamyousaf49953 жыл бұрын

    Amazing video! Is there a way of having a log of the detections?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks! You could log via the photos or use the HA log book/history to view the sensor history, or bring it into Grafana to log it further. Hope that helps!

  • @isamyousaf4995

    @isamyousaf4995

    3 жыл бұрын

    @@EverythingSmartHome Thank You👍

  • @lovenvik
    @lovenvik Жыл бұрын

    Whery nice tutorial! my doods cam suddenly stopped on a image and wont refresh, have tryed to make ah new name to the jpg file but that dont worked.

  • @xbmcnut
    @xbmcnut3 жыл бұрын

    Great video, thanks. Is the DOODS Docker install method possible on a HassOS based system if accessed as root over SSH on port 22222? I was fizzing when I saw you pull a new Docker container on Hassio but assume your running that on Ubuntu?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hey Pete, thank you! Yes you can do this on Home Assistant OS if you login as root, or you can do it on Ubuntu or fedora or anything that runs docker. You can run it on a separate machine you for home assistant is machine too! Hope that helps

  • @xbmcnut

    @xbmcnut

    3 жыл бұрын

    @@EverythingSmartHome Thanks for the prompt reply. While I knew Hassio ran as Docker containers, I had not thought to leverage the power of my NUC i7 by directly installing other containers. I use Docker on my NAS but assume DOODS is going to suck plenty of juice so better off on faster hardware. I see there is an add-on version so might go that route first.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Yeah it's a good little addition to be able to run some containers, hopefully the performance is good enough but there is some parameters you can tune to improve performance

  • @xbmcnut

    @xbmcnut

    3 жыл бұрын

    @@EverythingSmartHome thanks. I'll give it a whirl.

  • @andrescalapt_
    @andrescalapt_3 жыл бұрын

    Hey, I'm loving your videos but... can you add the written article withhhh the article? Or right the commands in the description? Oooor add a search button in your website? Thanks Great job mate, cheers

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hey! Yes I hope to get back to the written articles at some point, unfortunately they are a lot of work along side the video and I don't have enough time as I'd like but I'll do my best!

  • @mindiakhechumashvili5453
    @mindiakhechumashvili54533 жыл бұрын

    Can you help me? how to add rasp camera on the same raspberry where hassio is? Can't find any documentation, i added integration like urs, like in forums, but nothing worked. Before i had hass on docker and installed jpeg... something and worked, but cant access camera on the same device. Thank you

  • @rainyoung5558
    @rainyoung55583 жыл бұрын

    Thank you for this awesome tutorial (and other tutorials too). I've leaned a lot from you. I have a quick question (and open to anyone). My setup keeps getting a lot of the following warning messages at my HA log. Updating doods image_processing took longer than the scheduled update interval 0:00:03. According to Developer->States, it says process_time averages under 0.12. Is there any way that I could "debug" to find out what's causing these warning messages? FYI, I'm running HA+Doods with Docker on my MBP'16.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you! Hop in the discord server someone will be able to help!

  • @alexmonras1572
    @alexmonras15722 ай бұрын

    Is it possible to limit the detection to objects within a specific polygon?

  • @PoisonWaffle3
    @PoisonWaffle33 жыл бұрын

    Thanks for the excellent video! I'm trying to follow this guide but am having trouble running the docker command via the built in Terminal & SSH addon (getting the error 'docker: command not found' even though the docker command is one that's listed as an available command). I'd rather not set up remote SSH into the Pi4b that I'm running HA on, but can if needed. Any suggestions on how to do this without setting up remote/debug SSH access? Thanks!

  • @PoisonWaffle3

    @PoisonWaffle3

    3 жыл бұрын

    Disregard. I installed DOODS by adding his github repository to the add on store.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Glad you got it working!

  • @as_sulthoni
    @as_sulthoni3 жыл бұрын

    hello, would you like to share github / repository for computer vision code?

  • @TheYpes
    @TheYpes3 жыл бұрын

    Hi, thank you for the video, how can i separate file_out for two differents cameras?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hello, thanks for watching! You can add a second platform in the config with a seperate camera or you can use a template in the file name to name it the same as the camera, hope that helps!

  • @TheYpes

    @TheYpes

    3 жыл бұрын

    @@EverythingSmartHome works great, with a DVR from rtsp now trying to improve the false positives in order to use as alarm.

  • @arriewarrie
    @arriewarrie2 жыл бұрын

    hi. Would you now prefer frigate or this?

  • @EverythingSmartHome

    @EverythingSmartHome

    2 жыл бұрын

    Frigate for sure!

  • @duncandixon6203
    @duncandixon62033 жыл бұрын

    Can it detect individual playing cards such as the 8clubs

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Most likely but you would have to train your own model

  • @sevilleweathington6931
    @sevilleweathington69313 жыл бұрын

    Can I use a wyze cam v3 for this

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Sure if you can integrate it into HA then yes!

  • @nikolaberisic120
    @nikolaberisic1202 жыл бұрын

    Can i use ESP-32 cam for this purpose?

  • @EverythingSmartHome

    @EverythingSmartHome

    2 жыл бұрын

    Sure!

  • @carltresfield959
    @carltresfield9592 жыл бұрын

    Can I use a USB webcam?

  • @roystervi
    @roystervi3 жыл бұрын

    Hi is there a way to save files when pictures are detected like a nvr? as is, it doing an "file_out" but can it save each person that is detected? thanks

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hello, you can indeed save the images using the timestamp in the file name. Check the Home Assistant docs for this integration and you will see on of the examples they give you is able to save the files.

  • @ttuschak
    @ttuschak3 жыл бұрын

    H there. Nice video. Manged to get it running for one camera. Unfortunatley i can't get it running with more then one. Can you help?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thanks! Sure feel free to jump into our discord server, it'll be easier to troubleshoot there!

  • @PersonXes
    @PersonXes3 жыл бұрын

    Thanks, based on your video I found the DOODS add-on for home assistant which doesn't require to SSH into home assistant etc, so it's even easier this way. It's a shame that DOODS doesn't work for me as persons will be standing on the other side of a glass door which has a couple of white metal strips running horizontally. This confuses DOODS. I would have to train it to recognise a person with white bars in front of it :). Are you planning on making a video on training DOODS?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you! Yes I believe that came out after the video was made. Yeah I guess that's kind of understandable. I probably won't have a video training tensorflow, but...keep your eyes peeled tomorrow (shh don't tell anyone!)

  • @PersonXes

    @PersonXes

    3 жыл бұрын

    @@EverythingSmartHome haha thanks, looking forward to tomorrow's video! I remember you made some comments that you were looking Into to person recognition (i.e. recognising a specific person). Wonder whether that might be the topic 😉

  • @balloliscioincover9847
    @balloliscioincover98473 жыл бұрын

    hello sorry again, I noticed that the command "docker pull snowzach / doods" works for me in the ubuntu terminal but not in the home assistant terminal, and consequently it doesn't work, can you explain why?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Ah OK, you are meant to use it in the Ubuntu terminal not in the HA terminal, hope that clears up the confusion!

  • @TismoGaming
    @TismoGaming2 жыл бұрын

    Can this be installed if I am running home assistant using proxmox?

  • @EverythingSmartHome

    @EverythingSmartHome

    2 жыл бұрын

    Sure!

  • @inaciosung
    @inaciosung3 жыл бұрын

    Great content Lewis! Thanks for sharing it! I followed all instructions but I do not see image_processing running. I installed it in my desktop (Docker desktop on W10) and informed the ip_address of my notebook in the url field. Do you have any idea of what could be the problem?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hello thank you! Did you make sure to restart HA?

  • @inaciosung

    @inaciosung

    3 жыл бұрын

    @@EverythingSmartHome Yes, many times.

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Make sure to check the HA logs for errors

  • @inaciosung

    @inaciosung

    3 жыл бұрын

    @@EverythingSmartHome Got this error message: "Source: components/doods/image_processing.py:85" - Error while setting up doods platform for image_processing. Have no idea how to fix it.

  • @ahmedzaki2668
    @ahmedzaki26683 жыл бұрын

    hello. thanks for this great tutorial. I am using doods and it works fine with IP camera. but how did you set up a PI camera to work with HA? I mean how to stream the camera video that installed in the same PI with HA too?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    I was using an MJPG program to stream the camera from the Pi

  • @ahmedzaki2668

    @ahmedzaki2668

    3 жыл бұрын

    @@EverythingSmartHome thanks a lot. Do you use the camera in the same PI with HA.?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    I do not but if you do you can use the pi camera integration

  • @ahmedzaki2668

    @ahmedzaki2668

    3 жыл бұрын

    @@EverythingSmartHome very helpful information. Thanks 🙏🏼

  • @TwanJaarsveld1
    @TwanJaarsveld12 жыл бұрын

    it shows up onder developer tools, but doesn't show any states/detected objects

  • @jorgenvanduren7947
    @jorgenvanduren79473 жыл бұрын

    Is doods in the video running on a RPI4? You mentioned a processing time about 0.3 s, this seems not to be the case on a RPI4? Why didn't you use the Hasson addon from the doods author? This would be easier for most people instead of using docker straight from Hassio?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Hello, no DOODs is not running on a RPI in this video, only the camera is. I wasn't aware there was an add-on to be honest, I checked supervisor store and HACS and didn't see it, can you let me know where it is?

  • @markkastoun4704

    @markkastoun4704

    3 жыл бұрын

    @@EverythingSmartHome Looks like you'll have to add a new Repo by going to Supervisor > Add-on Store > Burger top right > Repositories and add github.com/snowzach/hassio-addons Then it will show up under the Add-on Store tab

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Oh cool didn't even know that existed! Thanks for letting me know. Although to be fair the docker instructions don't take long at all but still that's good to know!

  • @paulgibbins271
    @paulgibbins2713 жыл бұрын

    Thank for the video. So am I understanding this correctly, Tensorflow is bundled in with the DOODS software, you don't download and install Tensorflow separately?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Yep that's right, DOODs is essentially a web UI ontop of tensorflow and includes it in the docker image

  • @paulgibbins271

    @paulgibbins271

    3 жыл бұрын

    @@EverythingSmartHome Understood, thanks for responding, much appreciated

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Of course anytime! Feel free to hop into discord with us if you get stuck and I'll help out! Or just want to hang out with us :)

  • @juhapanu7455
    @juhapanu74553 жыл бұрын

    In which part was the tensorflow used? Only DOODS?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Sorry I'm not sure I understand the question? DOODs is a rest API for tensorflow

  • @wizbowes1267
    @wizbowes12673 жыл бұрын

    Nice video. I have it up and running on my NUC. A few comments that might be useful: If Doods doesn't detect an object it doesn't output an image at all. I spent quite a lot of time head scratching that one, and to be honest it's not really the behaviour I want - is there anyway to change this? I couldn't see anything in the component webpage to force an picture when no obejcts are found Even on my NUC performance is slow. I'm managing one sample every 5 seconds. Is the processing speed dependent upon image size, and if so if there a way to downsample the image size to speed up processing. Despite my slow processing speed, none of the cores of my CPU are maxed out. Again - anyway to speed up the processing that way? What's the threading on Doods like? If I have one camera processing one image in 5 seconds, does that mean I would need to put the update interval to 10 seconds if I add an additional camera - or would they run in parallel and make better use of the available CPU?

  • @EverythingSmartHome

    @EverythingSmartHome

    3 жыл бұрын

    Thank you, appreciate it! Yes there is away to "tune" DOODS since it is running Tensorflow, but you might need a little bit of Docker knowledge in order to access the config. Nothing too complicated but I'm unsure on how much docker you have done before. This allows you to set the width and height, set the number of cores to use for processing and also to change the models used, you might want to try some different tensorflow lite models. One other way to approach it is to add a second "lower resolution" stream to HA that is not visible, but that you can use for processing. Hope that makes sense and answers the question!

Келесі