Install Apache Airflow for Windows PC

Welcome to our step-by-step guide on installing Apache Airflow on your Windows PC! In this video, we'll walk you through the entire process, making it easy for you to set up this powerful open-source workflow automation tool on your own machine.
----------------------installation steps------------------------------
First, make sure you have installed Docker Desktop and Visual Studio. If not, lets do it now!
Get Docker: docs.docker.com/desktop/insta...
Get Visual Studio Code
Download the following file: airflow.apache.org/docs/apach...
Open Visual Studio Code
create a new file .env and add the following lines
AIRFLOW_IMAGE_NAME=apache/airflow:2.4.2
AIRFLOW_UID=50000
docker-compose up -d
create Admin user using below command:
docker-compose run airflow-worker airflow users create --role Admin --username admin --email admin --firstname admin --lastname admin --password admin
-----------------------------------------------------------------------------------------------------------------
Apache Airflow allows you to schedule, monitor, and manage workflows with ease, and having it on your Windows PC can be a game-changer for your data engineering and automation projects.
Follow along as we cover everything from the initial setup to running your first Airflow task. Whether you're new to Airflow or looking to install it on your Windows PC, this video has got you covered.
Don't forget to like, share, and subscribe for more tutorials and tech guides. Let's get started with Apache Airflow on Windows!
-----------------------------------------------------------------------------------------------------------------------
Check out our full course topic wise playlist on some of the most popular technologies:
PySpark Tutorial:
• Apache Spark/PySpark T...
SQL Full Course Playlist-
• SQL Full Course
PYTHON Full Course Playlist-
• Python Full Course
Data Warehouse Playlist-
• Data Warehouse Full Co...
Unix Shell Scripting Full Course Playlist-
• Unix Shell Scripting F...
-----------------------------------------------------------------------------------------------------------------------
Don't forget to like and follow us on our social media accounts:
Facebook-
/ ampcode
Instagram-
/ ampcode_tutorials
Twitter-
/ ampcodetutorial
Tumblr-
ampcode.tumblr.com
-----------------------------------------------------------------------------------------------------------------------
Channel Description-
AmpCode provides you e-learning platform with a mission of making education accessible to every student. AmpCode will provide you tutorials, full courses of some of the best technologies in the world today. By subscribing to this channel, you will never miss out on high quality videos on trending topics in the areas of Big Data & Hadoop, DevOps, Machine Learning, Artificial Intelligence, Angular, Data Science, Apache Spark, Python, Selenium, Tableau, AWS , Digital Marketing and many more.
#airflow #installation #bigdata #dataengineering #datascience #aiintegration #dataanalytics #ampcode

Пікірлер: 83

  • @MauFeitioO
    @MauFeitioO4 күн бұрын

    my saviour! thank you, easy way to setup airflow

  • @sayemhaque6737
    @sayemhaque67372 ай бұрын

    hands down brother. I was struggling with that issue and fortunately, you came up with that and It was really very helpful for me. Thanks a lot Brother.

  • @SoumitriD
    @SoumitriD5 ай бұрын

    Excellent bhai. I was struggling for 2 days to set up airflow without docker. Finally landed here and you helped like a breeze.

  • @ampcode

    @ampcode

    5 ай бұрын

    Thank you so much!

  • @rajyalakshmiganne302
    @rajyalakshmiganne3025 ай бұрын

    great explanation!, please continue this airflow series

  • @ampcode

    @ampcode

    5 ай бұрын

    Thank you so much! Subscribe for more content 😊

  • @user-jx1rv9it2f
    @user-jx1rv9it2f2 ай бұрын

    It is very seldom that I leave any comments on YT videos, but this was beyond useful. Thanks, I don't have to jump through the hoops with Linux VM and what not, and I can simply run AF on Windows!

  • @Ace_wood
    @Ace_woodАй бұрын

    Clear installation guide. Didn't get into any errors while downloading

  • @raniabouzid8219
    @raniabouzid821915 күн бұрын

    It worked, so helpful thank you.

  • @scoobyy3112
    @scoobyy31122 ай бұрын

    Thank you so much! It helped alot.

  • @SamuelDaRocha-zw1jf
    @SamuelDaRocha-zw1jf2 ай бұрын

    great explanation, thanks bro !

  • @duongchitrungka
    @duongchitrungka3 ай бұрын

    Thank you for helping me solve my problem

  • @datasciencekuldip
    @datasciencekuldip12 күн бұрын

    very clear steps, no issue occred. satisfyied witht he installation guide, thank you.

  • @shafiulamin4128
    @shafiulamin4128Ай бұрын

    Nice one mate. Thanks a lot.

  • @rohithpatel867
    @rohithpatel8672 ай бұрын

    Thanks for saving my time!!

  • @rupesh-qq5rl
    @rupesh-qq5rl3 ай бұрын

    Thanks for making such good Content. Subscribed with a bell

  • @eyamilabraham
    @eyamilabraham7 ай бұрын

    so much helpful, ty!

  • @ampcode

    @ampcode

    5 ай бұрын

    Thank you so much! Subscribe for more content 😊

  • @hideweapon1361
    @hideweapon13613 ай бұрын

    sir thank you so much, i watch many tutos but hostloc dosnt work, u saved me 5 days :)

  • @josuedegbun6270
    @josuedegbun62706 ай бұрын

    thank you guys for this video, can you make a video for an ETL with airflow and mysql or mongodb please ?

  • @guhanathanprathish9704
    @guhanathanprathish97043 ай бұрын

    kindly do some videos related to Apache Airflow. It will be very useful to us. And thank you for this installation process.🙌❤

  • @SilverSoul169
    @SilverSoul1692 ай бұрын

    simple & straight forward, really helpful. thank you!

  • @ayushimallik1907
    @ayushimallik190723 күн бұрын

    Amazing job Aashay 🙂

  • @renvils
    @renvils2 ай бұрын

    Your explanation is good and clear , can you do more airflow tutorial please ? anyway THANKS :)

  • @jaisahota4062
    @jaisahota40627 ай бұрын

    please continue this series

  • @ampcode

    @ampcode

    5 ай бұрын

    Thank you so much! Subscribe for more content 😊

  • @JeFFiNat0R
    @JeFFiNat0R4 ай бұрын

    Thank you!

  • @nghian21
    @nghian215 ай бұрын

    thanks you so much

  • @ampcode

    @ampcode

    5 ай бұрын

    Thank you so much! Subscribe for more content 😊

  • @aliasgharmodi9850
    @aliasgharmodi9850Ай бұрын

    Hello, I am trying to donwload the file from the given link in YAML formal but I am unable to do it. It is saving my file in txt format.

  • @umerimran3833
    @umerimran38335 ай бұрын

    thanks bro

  • @ampcode

    @ampcode

    5 ай бұрын

    Thank you so much! Subscribe for more content 😊

  • @ivanachen8209
    @ivanachen82092 ай бұрын

    Hi!. is posible use Anaconda Navigator VS Code to configure Airflow dependencies and Python Librarys?

  • @DataDrivenMobility
    @DataDrivenMobilityАй бұрын

    Thank you for this video, however, i have a question, if because of security the port 8080 is blocked, how can we have access to Airflow? or is there any where I can change the port?

  • @LiamEdwards-se9yp
    @LiamEdwards-se9yp3 ай бұрын

    can you assist me further with setting up airflow and using it

  • @manuelcoaguila584
    @manuelcoaguila5842 ай бұрын

    Hi friend, one question?. You have a cours of Apache Airflow. Thanks you.

  • @depazz
    @depazz5 ай бұрын

    what are the benefits to installing it with docker?

  • @WillEDMr
    @WillEDMr18 күн бұрын

    Huuuuuge help. Thank you

  • @user-zm2fm5mr9d
    @user-zm2fm5mr9dАй бұрын

    So I've installed it and webserver works fine, but how can I create a DAG inside my dags folder in Windows? It requires airflow to be installed, is this possible for Windows?

  • @SaiPrakashR
    @SaiPrakashR2 ай бұрын

    Hi sir, i just followed your steps i'm abale to run it. but once the system is shut down or in sleep mode the airflow-init container stops running. its exiting automatically, because of that i'm getting Page not found error. even after restarting docker and containers same issue i'm saying. can you provide any solutions if possible.

  • @TheRealKingHarry
    @TheRealKingHarry2 ай бұрын

    Hey, everything is running but localhost:8080 doesnt resolve. any ideas please?

  • @prakashprakash1250
    @prakashprakash12502 ай бұрын

    No configuration file provided: not found on visual studio

  • @user-qx6zr8hy1v
    @user-qx6zr8hy1v3 ай бұрын

    i used docker like in this video it worked very easily, i was trying to solve error of absolute path with airflow db init for whole day ,, why it didnt worked after trying so much and talking about image of airflow how you got it ,, can you share .. like how you know that AIRFLOW_IMAGE_NAME=apache/airflow:2.4.2 AIRFLOW_UID=50000 these to set

  • @harshithajnharshitha7838
    @harshithajnharshitha78385 ай бұрын

    Its not taking when i give .env file

  • @abdoa7942
    @abdoa7942Ай бұрын

    king⭐⭐⭐⭐⭐

  • @zefur321
    @zefur321Ай бұрын

    Can I do offline installation?

  • @uniquemotivation2.0
    @uniquemotivation2.02 ай бұрын

    i had set up but when i am going to again use airflow by localhost8080 it's showing "localhost refused to connect " Any relevant help or fix will be appreciated. @AmpCode

  • @PaulOnosode
    @PaulOnosodeАй бұрын

    Thanks for the explanation. However I couldn't reach localhost:8080 I got 6/7 services Running while Airflow-init-1 Exited. Please how do I fix this?

  • @rocksingh007
    @rocksingh0072 ай бұрын

    Thanks and it worked exactly shown in the video . Can you please share video link as where to store the .py file for creating dags in this setup , I tried to put the .py code under DAGS folder in material but it didn't got refreshed in Airflow GUI . Please suggest.

  • @rocksingh007

    @rocksingh007

    2 ай бұрын

    :) Posting answer too , seems it takes some time to get refresh in GUI after saving .py to DAGS folder.

  • @maxyblaqdataengr.
    @maxyblaqdataengr.27 күн бұрын

    From the creation of new terminal, it shows me no configuration file provided.

  • @BasitAIi
    @BasitAIi7 ай бұрын

    Error arises while starting docker dekstop

  • @amalpp-tp8ww
    @amalpp-tp8ww7 ай бұрын

    i dont have 4gb remaining for docker, can you suggest the other method without installing docker

  • @jaydeepkarale

    @jaydeepkarale

    6 ай бұрын

    INstall WSL, UBuntu and then try on that

  • @TheRealKingHarry
    @TheRealKingHarry2 ай бұрын

    also getting invalid login error now using admin as user and password. I copied your cmmand exactly

  • @taiwoarikewusola2833
    @taiwoarikewusola28335 ай бұрын

    My localhost:8080 is working. It state that local host didn’t send any data. How can I rectify it?

  • @aswathsundarr4853

    @aswathsundarr4853

    3 ай бұрын

    turn off the firewall of your computer

  • @uniquemotivation2.0
    @uniquemotivation2.02 ай бұрын

    I have followed the steps - all good till opening VS Code and adding compose and .env file with content. But docker-compose up -d saying file not found. Any relevant help or fix will be appreciated. @AmpCode

  • @uniquemotivation2.0

    @uniquemotivation2.0

    2 ай бұрын

    please replay anyone how to fix it

  • @maxyblaqdataengr.

    @maxyblaqdataengr.

    27 күн бұрын

    Exactly the issue I’m facing here.

  • @c.shekhargupta5545
    @c.shekhargupta554513 күн бұрын

    facing an error docker-compose up -d unknown shorthand flag: 'd' in -d

  • @isharkpraveen
    @isharkpraveen3 күн бұрын

    localhost:8080 is not working :(

  • @prajwaltamang4180
    @prajwaltamang4180Күн бұрын

    my file showing txt there

  • @kibatumezgebu5398
    @kibatumezgebu53987 ай бұрын

    why is my localhost 8080 is not working to launch airflow?

  • @vidhyas4459

    @vidhyas4459

    6 ай бұрын

    I too face the same issue. Were you able to figure it out?

  • @umerimran3833

    @umerimran3833

    5 ай бұрын

    turn off firewall and retry@@vidhyas4459

  • @ilyeseljawhari4969

    @ilyeseljawhari4969

    5 ай бұрын

    that's because of the port 8080 is being used by another service , to chekck ,open CDM as addmin and type in " netstat -ano | findstr :8080 " to see if there is any service is using this port , if so , change the port of airflow web server in docker-compose.yaml file and try again

  • @aswathsundarr4853

    @aswathsundarr4853

    3 ай бұрын

    turn off the firewall of your computer

  • @1nbyte
    @1nbyteАй бұрын

    send slide , thnx

  • @yashaswinin5078
    @yashaswinin50785 ай бұрын

    it shows local host didnt send any data

  • @aswathsundarr4853

    @aswathsundarr4853

    3 ай бұрын

    turn off the firewall of your computer

  • @jmjm991
    @jmjm9912 ай бұрын

    2:34

  • @uzeyirktk6732
    @uzeyirktk673217 күн бұрын

    localhost didn’t send any data.

  • @hassanarshad8769
    @hassanarshad87694 ай бұрын

    locahost:8080 did not work

  • @aswathsundarr4853

    @aswathsundarr4853

    3 ай бұрын

    turn off the firewall of your computer

  • @ayaansk99
    @ayaansk995 ай бұрын

    local host not t working

  • @umerimran3833

    @umerimran3833

    5 ай бұрын

    turn off firewall and retry

  • @sumitrawall
    @sumitrawall5 ай бұрын

    Sir, I am facing an issue in airflow while doing a project like ""airflow.exceptions.AirflowConfigException: Cannot use relative path: `sqlite:///C:\Users\YOURNAME/airflow/airflow.db` to connect to sqlite. Please use absolute path such as `sqlite:////tmp/a irflow.db`."" can you please suggest any solution for this

  • @meetpatel2720

    @meetpatel2720

    4 ай бұрын

    Me to

  • @BoyaRakesh-cg9pw
    @BoyaRakesh-cg9pwАй бұрын

    No configuration file provided: not found on visual studio