Massively Speed Up Requests with HTTPX in Python

Ғылым және технология

In this video, we learn how to massively speed up web scraping with asynchronous requests in Python, using the httpx module.
◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾
📚 Programming Books & Merch 📚
🐍 The Python Bible Book: www.neuralnine.com/books/
💻 The Algorithm Bible Book: www.neuralnine.com/books/
👕 Programming Merch: www.neuralnine.com/shop
🌐 Social Media & Contact 🌐
📱 Website: www.neuralnine.com/
📷 Instagram: / neuralnine
🐦 Twitter: / neuralnine
🤵 LinkedIn: / neuralnine
📁 GitHub: github.com/NeuralNine
🎙 Discord: / discord
🎵 Outro Music From: www.bensound.com/

Пікірлер: 31

  • @frostiiify9505
    @frostiiify9505 Жыл бұрын

    Nice! I have never worked with HTTPX, so this is really interesting to me. Would love to see more!

  • @suomynona7261
    @suomynona7261 Жыл бұрын

    I’m happy you still posting! Thanks for what you do.

  • @tamgaming9861
    @tamgaming9861 Жыл бұрын

    Ich habe mit einem 2 Jahre alten Video von dir gestartet - und hatte gehofft dass du immer noch postest ... klasse das du es tust!

  • @justas3000
    @justas3000 Жыл бұрын

    Big ups for all the stuff you do man! All videos are very clear, concise and on point. Keep it up

  • @oguzhantopaloglu9442

    @oguzhantopaloglu9442

    Жыл бұрын

    I agree, he makes videos about libraries that nobody fucking knows a thing or two about and those libraries are actually awesome

  • @ahmadowaihan9349
    @ahmadowaihan9349 Жыл бұрын

    this video was very helpful! exactly what I needed :) keep it up! (this vid was suggested to me at random lol)

  • @dot_dot_pwn2650
    @dot_dot_pwn2650 Жыл бұрын

    You're awesome dude, loving your new pace. Keep up the great work.

  • @sumitsingh-CANDY
    @sumitsingh-CANDY Жыл бұрын

    ❤ just learned new thing !!

  • @praveenkumawat2662
    @praveenkumawat2662 Жыл бұрын

    wow, it works amazingly. Thanks for sharing this

  • @benlong1062
    @benlong1062 Жыл бұрын

    This was a good one, really interesting.

  • @oguzhantopaloglu9442
    @oguzhantopaloglu9442 Жыл бұрын

    This is INSANE!

  • @davehawkins5265
    @davehawkins5265 Жыл бұрын

    Great video!

  • @InvestLarge
    @InvestLarge Жыл бұрын

    Comment for the algorithm :) Perfect video lesson

  • @noertri618
    @noertri618 Жыл бұрын

    Python 3.11 + httpx = 🔥🔥🔥🔥

  • @Jelvix
    @Jelvix Жыл бұрын

    Awesome video! We talked about a similar topic on our channel a few videos ago!

  • @tony_jin
    @tony_jin Жыл бұрын

    Thanks a lot for the video! Does "httpx" work with webdriver from selenium?

  • @2ru2pacFan
    @2ru2pacFan Жыл бұрын

    Thanks!

  • @swarnodipnag
    @swarnodipnag Жыл бұрын

    Love from India. 4th comment.. daily viewer .. python lover ❤️🫂

  • @aryankothari4634
    @aryankothari4634 Жыл бұрын

    Have you covered python queue.Queue() with threading?

  • @makankananian3838
    @makankananian3838 Жыл бұрын

    are the async requests that we gather in the same order as the URLS list??

  • @pamdemonia
    @pamdemonia Жыл бұрын

    Very cool.

  • @clxymox
    @clxymox Жыл бұрын

    very interesting, it is possible to also have the url that we are testing with the return 200

  • @connectrRomania
    @connectrRomania Жыл бұрын

    Is this efficient on getting access to different ip camera addresses

  • @AhmdsYT
    @AhmdsYT2 ай бұрын

    4:29 using httpx

  • @throwyourmindat
    @throwyourmindat Жыл бұрын

    Hi , I tried executing HTTPX POST method, but it is returning 419 instead of 200. the calls are similar to what I used to do with request.Session.. can you please create a view on POST call. what is the trick to make it work ?

  • @RavanaMad

    @RavanaMad

    6 ай бұрын

    The difference between accepting GET or POST requests is defined on the server side. GET carries request parameter appended in URL string while POST carries request parameter in message body which makes it more secure way of transferring data.

  • @throwyourmindat

    @throwyourmindat

    6 ай бұрын

    @@RavanaMad thanks it's been 7 months now. It was https post specifically. I have figured out already

  • @jaspreetsingh9688
    @jaspreetsingh9688 Жыл бұрын

    Can you solve rubik cube with python if yes then please make video

  • @miguelhyto54
    @miguelhyto547 ай бұрын

    4:30

  • @agnichatian
    @agnichatian4 ай бұрын

    books to scrape is huge malware site now

Келесі