Raspberry Pi 4 + Intel's RealSense D435 Depth Camera Step-By-Step Installation

Ғылым және технология

• Your support helps me post videos more frequently:
/ acrobotic
www.paypal.me/acrobotic
buymeacoff.ee/acrobotic
BTC: 1ZpLvgETofMuzCaKoq5XJZKSwe5UNkwLM
==========
• Find me on:
/ acrobotic
/ acrobotic
/ acrobotic
==========
• My shops:
acrobotic.com/shop
amazon.com/shops/acrobotic
==========
• Description:
This tutorial is part of a series where the goal is to build a Raspberry Pi-powered, small-scale driverless car based on Computer Vision and Reinforcement Learning. It is based on the Open Source, community-backed project: Donkey Car (www.donkeycar.com/)
In this video I go over the steps for getting the Intel RealSense D435 Depth Camera working with a Raspberry Pi 4. Starting with a newly flashed image of Raspbian OS, I follow all the necessary steps for configuring Raspbian, and installing the software to get the device working.
==========
• Related vids:
Set up the linux-based Raspbian Operating System: • Raspberry Pi 4 as a Li...
Set up Raspbian for access without a keyboard, monitor, and even a Wi-Fi connection: • Raspberry Pi 4 SSH Set... (complete) • Raspberry Pi 4 Headles... (summary)
==========
• Project parts:
Intel RealSense D435 Camera:
amzn.to/2SxXJhM
Raspberry Pi Robocar Kit (unassembled):
amzn.to/3b4f6xN (affiliate)
Raspberry Pi Robocar Kit (assembled, pre-programmed):
acrobotic.com/products/robocar
==========
• Tutorials:
The steps are outlined in the Wiki for my Raspberry Pi Demos repository:
github.com/acrobotic/Ai_Demos...
==========
• Music:
Epidemic Sound (epidemicsound.com). Standard KZread License.
==========
#RaspberryPi #Robotics #Tutorial

Пікірлер: 94

  • @JayrMagave
    @JayrMagave3 жыл бұрын

    I think this channel is on par and superior to many channels about electronics. Kudos for the author.

  • @mongolz1000
    @mongolz10003 жыл бұрын

    Mate, your channel is extremely underrated

  • @ssembeds522
    @ssembeds5223 жыл бұрын

    Thank you very much. you save me a lot of time. the process goes very smooth.

  • @marrysky678
    @marrysky6782 жыл бұрын

    Thank you for this video! it's very helpful.

  • @rezabasiri
    @rezabasiri3 жыл бұрын

    Very good! thanks

  • @asdfds6752
    @asdfds67524 жыл бұрын

    Great job! Really impressive! How much different would it be with a d435i and with Jetson Nano? Do you have any ideas? It is ridiculously messy to work with these camera. Don't really get why!

  • @jasontassell
    @jasontassell3 ай бұрын

    Thank you for making this video. Still really helpful, despite a few things being different since it was first published.

  • @wangdony3405

    @wangdony3405

    Ай бұрын

    what are things that are different, my python setup wont work.

  • @PhG1961
    @PhG19614 жыл бұрын

    Nice video, quite an achievement !

  • @datasith

    @datasith

    4 жыл бұрын

    ha! thanks philip. now the real fun begins with some computer vision applications :)

  • @PhG1961

    @PhG1961

    4 жыл бұрын

    @@datasith Indeed. Build a robot and use the vision system together with that.

  • @datasith

    @datasith

    4 жыл бұрын

    @@PhG1961 yup, yup! it'll take some time, but the plan is to mount it on my little robocar. i'm soooo looking forward to it!

  • @varshaarun9388
    @varshaarun93883 жыл бұрын

    You are AMAZING! Thank you for simplifying the process!! I’m getting an error that says GLSL not supported. Any leads on how to go on out it further will be greatly appreciated! Thanks in advance!

  • @grokwhy
    @grokwhy3 жыл бұрын

    Thank you for the video and the Wiki post. I now have the D415 up and running on the Pi 4.

  • @pisoiorfan

    @pisoiorfan

    3 жыл бұрын

    Hi what frame rate did you get? thanks

  • @grokwhy

    @grokwhy

    3 жыл бұрын

    @@pisoiorfan On a Raspberry Pi 4 8G using a D415 at 1280x720 in the Realsense viewer 2D I'm getting 29 hardware FPS

  • @pisoiorfan

    @pisoiorfan

    3 жыл бұрын

    @@grokwhy Thank you. Does the lag is annoying/noticeable?

  • @laxmanbal4740

    @laxmanbal4740

    3 жыл бұрын

    hi i am also trying to connect my d415 with Rasperry pi. But i am having hard time to get it running. can you please help me or give me your email? or can you emailed me at laxmankumarbal58@gmail.com

  • @LucaAlfredoSanzio
    @LucaAlfredoSanzio4 жыл бұрын

    Thank you for this video!. Did you measure somehow the frame rate depending on camera resolution settings? Can the resolution be downgraded to QVGA for achieving higher speeds?

  • @grokwhy

    @grokwhy

    3 жыл бұрын

    In the viewer, which is just a pretty interface to what you can do in code, you can set the resolution and the frame rate.

  • @EDGARDOUX1701
    @EDGARDOUX17014 жыл бұрын

    Esta GENIAL!! Gracias y un fuerte abrazo Argento!!

  • @datasith

    @datasith

    4 жыл бұрын

    Gracias capo, un gran saludo y felicidades for el cambio de nombre de usuario (es joda!) :)

  • @tuviejapendeja2624
    @tuviejapendeja26243 жыл бұрын

    Vamos ahi !! Un servidor desde España!

  • @datasith

    @datasith

    3 жыл бұрын

    Un gran saludo, gracias por el aguante!

  • @quentinjames981
    @quentinjames9813 жыл бұрын

    What are the limitations of running RealSense/OpenCV on a Raspberry Pi 4? I've seen some really poor frame rates (less than 5) on i5 8GB systems, so I'm curious to see how this video's setup performs.

  • @socialtech3509
    @socialtech35093 жыл бұрын

    Can we use this for interactive floor mapping?

  • @ivankay639
    @ivankay6393 жыл бұрын

    how do you apply the swapfile? how do you save that file after you changed to 2048? ctrl+o does not seem to work, nor ctr+x

  • @maxmustermann5777
    @maxmustermann57772 жыл бұрын

    Hey, my fonts are missing when I open the realsense-viewer through Vnc Viewer

  • @crunchbubba
    @crunchbubba5 ай бұрын

    the Ai_Demos_RPi repository on the video footer does not exist? what it the link for the "demos for the raspberry Pi wiki" mentioned at 0:34?

  • @romiolover6852
    @romiolover68524 жыл бұрын

    nice project

  • @datasith

    @datasith

    4 жыл бұрын

    thanks

  • @rukey3001
    @rukey30014 жыл бұрын

    Great.. I was waiting this for a long long time... What python libraries are you gonna use ? Open3D?

  • @datasith

    @datasith

    4 жыл бұрын

    Glad to hear, Shan! For now just OpenCV in addition to the standard pyrealsense2. I haven't gotten the chance to use Open3D so you're right, this might be a perfect opportunity to do so. Thanks for the suggestion!

  • @rukey3001

    @rukey3001

    4 жыл бұрын

    ACROBOTIC great. Thanks. Can’t wait for next video..

  • @wen-yuchien2088
    @wen-yuchien20884 жыл бұрын

    Good video! What's the frame rate of the depth image could achieve? (848*480)

  • @damonhtoo

    @damonhtoo

    4 жыл бұрын

    I'm interested in frame rates too. I think it heavily depends on ROI you define but I need at least 30 fps.

  • @mermichael9108
    @mermichael91082 жыл бұрын

    how do I find the 12 digit device_id of the intel realsensecamera?

  • @ar1675
    @ar16752 жыл бұрын

    Is this tutorial the same for the D455 camera? I got a problem while installing the py realsense wrapper.. it says there are some libaries missing while linking. I am using a d455 camera. Do you know this problem?

  • @user-uc3ng5nw4i

    @user-uc3ng5nw4i

    Жыл бұрын

    ตอนนี้แก้ปัญหาได้หรือยัง

  • @qzorn4440
    @qzorn4440 Жыл бұрын

    Do you have a video doing this project with an Orange Pi 5? 😎 Thank you.

  • @pisoiorfan
    @pisoiorfan3 жыл бұрын

    Thanks. Still for whatever reason the make install does not copy wrappers/python/pyrealsense2/__init__.py into wherever destination folder pyrealsense2.cpython-37m-arm-linux-gnueabihf.so goes. And it was a bit of pain to figure that out :) PS also on a 4Gbyte Pi4 compiling full throttle works fine. It saves a lot of time. $ make -j4

  • @snouzz-gaming
    @snouzz-gaming Жыл бұрын

    hi, can some help me to do some thing: i wonna do real time scan of object, so you get xy ply pictures and algorithm must put it in one 3d modell together, i cant do it.. it works with 2 ply files but not so well.... Pls help so we can meet us in discord or so...

  • @p._7555
    @p._75553 жыл бұрын

    Nice ! Why the Argentina futbol Tshirt?

  • @vegasofficial2431
    @vegasofficial2431 Жыл бұрын

    The Tbb link is no longer working. Please suggest an alternative.

  • @srijansingh9663
    @srijansingh96632 жыл бұрын

    Will this work with a ReasSense D415?

  • @mahdi6569
    @mahdi65697 ай бұрын

    Hi The GitHub page is not accessable, is there alternative page or way to use that data??

  • @anatolemombrun9250
    @anatolemombrun92502 жыл бұрын

    Hey! Thanks for your amazing tutorial. So far i've got everything done on my pi4 (running on ubuntu mate) except for the last part where i can't activate the openGL driver : it says that driver and kernel are not present on the system. Do you have any idea what may cause this ? If i dont succeed i guess i'll try to do the same on your linux distribution

  • @odysseusthephilosopher6993

    @odysseusthephilosopher6993

    Жыл бұрын

    Hi Bro. Im trying on ubuntu mate but i get errors. Can you recommend me what distro did you use? Thanks!

  • @stevedsouza842
    @stevedsouza8423 жыл бұрын

    Are you able to use the same steps for the L515 Intel RealSense Camera?

  • @amir3515

    @amir3515

    2 жыл бұрын

    yes I can confirm these steps worked for the L515

  • @hariharanraghavan7567
    @hariharanraghavan75672 жыл бұрын

    Hi @ACROBOTIC, Why does my comment gets removed? I was seeking for help to understand the problem during the installation procedure

  • @amir3515
    @amir35152 жыл бұрын

    would this work with a 16gb sd card? Update: You can install the SDK and be able to successfully install librealsense and run realsense-viewer but you will be at 100% usage and will have no free space to add the python wrapper or anything else. Can confirm that you will need a 32GB sd card

  • @giuseppepuglisi9852
    @giuseppepuglisi98523 жыл бұрын

    I must to install OpenCL, how can I do it?

  • @asdfds6752
    @asdfds67524 жыл бұрын

    Hi, I followed your tutorial step by step on my raspberry pi4. I can see the camera frames in the realsense-viewer, very fine! But when I try running the python examples in the wrapper/python directory I get an error message like: File "opencv_viewer_example.py", line 13, in pipeline = rs.pipeline() AttributeError: module 'pyrealsense2' has no attribute 'pipeline' I can run "import pyrealsense2 as pr", but it seems nothing is really working. Is there something I am missing? Please let me know and thanks again for your amazing work!

  • @user-pk8po2hp2t

    @user-pk8po2hp2t

    4 жыл бұрын

    I got this error too.....Do you fix it?

  • @superzaaclub

    @superzaaclub

    4 жыл бұрын

    I got the same problem. The fix is copy ~/librealsense/wrappers/python/pyrealsense2/__init__.py into pyrealsense2 install folder where all the .so files are. in my case it is at /usr/lib/python3/dist-packages/pyrealsense2

  • @NitinRNtini
    @NitinRNtini2 жыл бұрын

    My Intel RealSense D415 camera is working on my Raspberry pi 4, 4gb model, but the video feed is very slow and laggy. Anyone know how to fix?

  • @NSAwatchesME
    @NSAwatchesME3 жыл бұрын

    have you tried the latest real sense? and they do lidar too l515

  • @datasith

    @datasith

    3 жыл бұрын

    For now, I've only tried the D435, but as the communication protocols are similar, the Python code *should* work with the rest of the line. At the very least, you can see if the devices are recognized by the realsense-viewer, and then take it from there. HTH!

  • @user-rg2dn1ns1h
    @user-rg2dn1ns1h4 ай бұрын

    It doesn’t work when I reboot the raspberry pi. I have to unplug and replug

  • @harrisonlong644
    @harrisonlong6443 жыл бұрын

    are there other viewers for intel realsene or is this the only one? i would love to have a camera, raspberry pi and a small screen to measure depths, however i dont need the viewer gui, is it possible to just have the raw depth video feed displayed on screen or must you use the realsense viewer ??

  • @camdennagg6419

    @camdennagg6419

    2 жыл бұрын

    yes it is possible to get the raw depth

  • @zariframzan7777
    @zariframzan77774 жыл бұрын

    can i followe this steps for raspberry pi 3b+ ??

  • @datasith

    @datasith

    4 жыл бұрын

    You can, one limitation is on the USB speed. Notice that I connected the camera to USB 3 ports. Intel announced a while back support for USB 2 (which are the only option on a Raspberry Pi 3B+): www.intelrealsense.com/usb2-support-for-intel-realsense-technology/ But, you'll have to trade off the smaller bandwidth for image quality. HTH!

  • @Oscar-db8mp
    @Oscar-db8mp3 жыл бұрын

    Is there a new setup or should I still just be using the same setup for my Pi 4?

  • @datasith

    @datasith

    3 жыл бұрын

    Did you read the title?

  • @Oscar-db8mp

    @Oscar-db8mp

    3 жыл бұрын

    ACROBOTIC sorry about that.

  • @datasith

    @datasith

    3 жыл бұрын

    @@Oscar-db8mp no worries, I was going through a whole lot of comments and answered in a hurry. Let me know if you run into any trouble getting it to work!

  • @PremSai2244
    @PremSai22443 жыл бұрын

    Could not initialize offscreen context! GLFW Driver Error: GLX: GLX version 1.3 is required cant run realsense-viewer suggest a solution, please

  • @varshaarun9388

    @varshaarun9388

    3 жыл бұрын

    Same problem! Were you able to find a solution?

  • @PremSai2244

    @PremSai2244

    3 жыл бұрын

    @@varshaarun9388 hey. This has been months ago. I think I had a GitHub issue raised on the same. As far as I remember this issue is due to vnc viewer. If you connect monitor to the screen it will show the realsense-viewer. Vnc viewer uses virtual tech to simulate monitor to operating system. Only way to solve this is to update glx drivers on raspi. Eventually we shifted to Jetson platform and couldn't reproduce the problem. Will update you with the issue link if we find it.

  • @varshaarun9388

    @varshaarun9388

    3 жыл бұрын

    @@PremSai2244 Thanks for the reply. But I dont use VNC server. I have a monitor connected but I was still getting this driver issue.

  • @PremSai2244

    @PremSai2244

    3 жыл бұрын

    @@varshaarun9388 then it must be other way round. Try with vnc viewer and without monitor.

  • @DeltaWhiskey89

    @DeltaWhiskey89

    Жыл бұрын

    @@PremSai2244 this is the fix. Unfortunately, the viewer only appears to display correctly if you are VNC without a screen plugged into the pi. Anyone figure out a fix to view with an onboard screen?

  • @NSAwatchesME
    @NSAwatchesME3 жыл бұрын

    to use realsense on something like nanopi4 or rock pi 4c or tinker edge r is there specific Linux I need? can use same code?

  • @datasith

    @datasith

    3 жыл бұрын

    It depends on the system's architecture of the other boards. Since the libraries have been compiled for the SoC on the Pi, you'll need to recompile the source code for other ones. If it's the same architecture (e.g., armv7) then it shouldn't be too bad. Best of luck!

  • @NSAwatchesME

    @NSAwatchesME

    3 жыл бұрын

    @@datasith it looks like there is very limited compatibility with any dev board and even the more popular odroid has issues dev.intelrealsense.com/docs/odroid thats a shame

  • @datasith

    @datasith

    3 жыл бұрын

    @@NSAwatchesME thanks for sharing, and yup, that'd be what i expected. if you find an x86 dev board that works for you (assuming power consumption isn't an issue) then that's an alternative as well.

  • @VVaxman
    @VVaxman4 жыл бұрын

    Do you think this would work with the intel RealSense d415?

  • @datasith

    @datasith

    4 жыл бұрын

    Yup, the same library works for all RealSense devices. On the Python side you might need to make a few adjustments depending on the actual model, but the included examples are a good starting point for that. HTH!

  • @VVaxman

    @VVaxman

    4 жыл бұрын

    @@datasith Thanks a lot for the answer, i have not been able to import the correct pyrealsense module, what import have you been having success with? realsense-viewer works fine, but the Thonny IDE doesn't find the module pyrealsense2 nor does it find the pyrealsense module, do you have any idea as to why?

  • @VVaxman

    @VVaxman

    4 жыл бұрын

    It worked if i ran the program through the commandline with python3 *insert programname*.py

  • @andreacecchetto5748

    @andreacecchetto5748

    4 жыл бұрын

    ACROBOTIC So also for T265?

  • @grokwhy
    @grokwhy3 жыл бұрын

    While the Realsense Viewer worked fine, I discovered the python examples didn't. So I went back to study over the instructions, and see this line cmake .. -DBUILD_PYTHON_BINDINGS=bool:true -DPYTHON_EXECUTABLE=$(which python3) I'm assuming now, I should have replaced (which python3) with something. After some Google searching, I found an example something like this cmake .. -DBUILD_PYTHON_BINDINGS=bool:true -DPYTHON_EXECUTABLE=/usr/bin/python3.7 Is this correct? I rebuilding now, but this takes hours. Thanks!

  • @grokwhy

    @grokwhy

    3 жыл бұрын

    Well, no change >>> import pyrealsense2 as rs >>> pipeline = rs.pipeline() ... module 'pyrealsense2' has no attribute 'pipeline'

  • @grokwhy

    @grokwhy

    3 жыл бұрын

    Well, I went back and looked at the video and you are using DPYTHON_EXECUTABLE=$(which python3), so that must be correct syntax. Must be some other issue.

  • @grokwhy

    @grokwhy

    3 жыл бұрын

    The answer was already posted by Pankrit Kritkiattisak below The fix is copy ~/librealsense/wrappers/python/pyrealsense2/__init__.py into pyrealsense2 install folder where all the .so files are. in my case it is at /usr/lib/python3/dist-packages/pyrealsense2

  • @sanjiblamichhane
    @sanjiblamichhane2 жыл бұрын

    Good video should not have fast forwarded video unnecessarily. Cant read cli commands

  • @yaltipolous
    @yaltipolous Жыл бұрын

    Receiving this error during the librealsense build process /home/yalt/librealsense/src/libusb/libusb.h:10:82: error: extended character ‘ is not valid in an identifier 10 | /usr/include/libusb-1.0/libusb.h:736:4: warning: ISO C++ forbids zero-size array ▒▒▒dev_capability_data’ [-Wpedantic] Any idea what the source of this could be?

  • @raenaurdturpin6262
    @raenaurdturpin62623 жыл бұрын

    Hello - Everything went smoothly until I executed the following: "cmake .. -DBUILD_EXAMPLES=true -DCMAKE_BUILD_TYPE=Release -DFORCE_LIBUVC=true" Info: REALSENSE_VERSION_STRING=2.45.0 -- Performing Test COMPILER_SUPPORTS_CXX11 -- Performing Test COMPILER_SUPPORTS_CXX11 - Success -- Performing Test COMPILER_SUPPORTS_CXX0X -- Performing Test COMPILER_SUPPORTS_CXX0X - Success -- Setting Unix configurations -- Building libcurl enabled CMake Error at /usr/share/cmake-3.16/Modules/FindPackageHandleStandardArgs.cmake:146 (message): Could NOT find OpenSSL, try to set the path to OpenSSL root folder in the system variable OPENSSL_ROOT_DIR (missing: OPENSSL_CRYPTO_LIBRARY OPENSSL_INCLUDE_DIR) Can you provide some guidance or updates?

  • @maxmustermann5777

    @maxmustermann5777

    2 жыл бұрын

    I fixed it by installnig libssl

  • @DeltaWhiskey89

    @DeltaWhiskey89

    Жыл бұрын

    Below is the solution that worked for me: sudo apt-get update sudo apt-get upgrade sudo apt-get install libssl-dev

  • @g0oberdm417
    @g0oberdm4174 жыл бұрын

    when enabling permissions at 3.11, what would you do differently on a d435i (different port name I assume)

  • @datasith

    @datasith

    4 жыл бұрын

    So I can't test it since I don't have a D435i, but I'm 99% confident that the same command works. The udev rules are part of the `librealsense` library, and they enable USB communication for all "RealSense" devices. So try these same commands, and they should work!

Келесі