Install Apache Airflow for Windows PC
Welcome to our step-by-step guide on installing Apache Airflow on your Windows PC! In this video, we'll walk you through the entire process, making it easy for you to set up this powerful open-source workflow automation tool on your own machine.
----------------------installation steps------------------------------
First, make sure you have installed Docker Desktop and Visual Studio. If not, lets do it now!
Get Docker: docs.docker.com/desktop/insta...
Get Visual Studio Code
Download the following file: airflow.apache.org/docs/apach...
Open Visual Studio Code
create a new file .env and add the following lines
AIRFLOW_IMAGE_NAME=apache/airflow:2.4.2
AIRFLOW_UID=50000
docker-compose up -d
create Admin user using below command:
docker-compose run airflow-worker airflow users create --role Admin --username admin --email admin --firstname admin --lastname admin --password admin
-----------------------------------------------------------------------------------------------------------------
Apache Airflow allows you to schedule, monitor, and manage workflows with ease, and having it on your Windows PC can be a game-changer for your data engineering and automation projects.
Follow along as we cover everything from the initial setup to running your first Airflow task. Whether you're new to Airflow or looking to install it on your Windows PC, this video has got you covered.
Don't forget to like, share, and subscribe for more tutorials and tech guides. Let's get started with Apache Airflow on Windows!
-----------------------------------------------------------------------------------------------------------------------
Check out our full course topic wise playlist on some of the most popular technologies:
PySpark Tutorial:
• Apache Spark/PySpark T...
SQL Full Course Playlist-
• SQL Full Course
PYTHON Full Course Playlist-
• Python Full Course
Data Warehouse Playlist-
• Data Warehouse Full Co...
Unix Shell Scripting Full Course Playlist-
• Unix Shell Scripting F...
-----------------------------------------------------------------------------------------------------------------------
Don't forget to like and follow us on our social media accounts:
Facebook-
/ ampcode
Instagram-
/ ampcode_tutorials
Twitter-
/ ampcodetutorial
Tumblr-
ampcode.tumblr.com
-----------------------------------------------------------------------------------------------------------------------
Channel Description-
AmpCode provides you e-learning platform with a mission of making education accessible to every student. AmpCode will provide you tutorials, full courses of some of the best technologies in the world today. By subscribing to this channel, you will never miss out on high quality videos on trending topics in the areas of Big Data & Hadoop, DevOps, Machine Learning, Artificial Intelligence, Angular, Data Science, Apache Spark, Python, Selenium, Tableau, AWS , Digital Marketing and many more.
#airflow #installation #bigdata #dataengineering #datascience #aiintegration #dataanalytics #ampcode
Пікірлер: 83
my saviour! thank you, easy way to setup airflow
hands down brother. I was struggling with that issue and fortunately, you came up with that and It was really very helpful for me. Thanks a lot Brother.
Excellent bhai. I was struggling for 2 days to set up airflow without docker. Finally landed here and you helped like a breeze.
@ampcode
5 ай бұрын
Thank you so much!
great explanation!, please continue this airflow series
@ampcode
5 ай бұрын
Thank you so much! Subscribe for more content 😊
It is very seldom that I leave any comments on YT videos, but this was beyond useful. Thanks, I don't have to jump through the hoops with Linux VM and what not, and I can simply run AF on Windows!
Clear installation guide. Didn't get into any errors while downloading
It worked, so helpful thank you.
Thank you so much! It helped alot.
great explanation, thanks bro !
Thank you for helping me solve my problem
very clear steps, no issue occred. satisfyied witht he installation guide, thank you.
Nice one mate. Thanks a lot.
Thanks for saving my time!!
Thanks for making such good Content. Subscribed with a bell
so much helpful, ty!
@ampcode
5 ай бұрын
Thank you so much! Subscribe for more content 😊
sir thank you so much, i watch many tutos but hostloc dosnt work, u saved me 5 days :)
thank you guys for this video, can you make a video for an ETL with airflow and mysql or mongodb please ?
kindly do some videos related to Apache Airflow. It will be very useful to us. And thank you for this installation process.🙌❤
simple & straight forward, really helpful. thank you!
Amazing job Aashay 🙂
Your explanation is good and clear , can you do more airflow tutorial please ? anyway THANKS :)
please continue this series
@ampcode
5 ай бұрын
Thank you so much! Subscribe for more content 😊
Thank you!
thanks you so much
@ampcode
5 ай бұрын
Thank you so much! Subscribe for more content 😊
Hello, I am trying to donwload the file from the given link in YAML formal but I am unable to do it. It is saving my file in txt format.
thanks bro
@ampcode
5 ай бұрын
Thank you so much! Subscribe for more content 😊
Hi!. is posible use Anaconda Navigator VS Code to configure Airflow dependencies and Python Librarys?
Thank you for this video, however, i have a question, if because of security the port 8080 is blocked, how can we have access to Airflow? or is there any where I can change the port?
can you assist me further with setting up airflow and using it
Hi friend, one question?. You have a cours of Apache Airflow. Thanks you.
what are the benefits to installing it with docker?
Huuuuuge help. Thank you
So I've installed it and webserver works fine, but how can I create a DAG inside my dags folder in Windows? It requires airflow to be installed, is this possible for Windows?
Hi sir, i just followed your steps i'm abale to run it. but once the system is shut down or in sleep mode the airflow-init container stops running. its exiting automatically, because of that i'm getting Page not found error. even after restarting docker and containers same issue i'm saying. can you provide any solutions if possible.
Hey, everything is running but localhost:8080 doesnt resolve. any ideas please?
No configuration file provided: not found on visual studio
i used docker like in this video it worked very easily, i was trying to solve error of absolute path with airflow db init for whole day ,, why it didnt worked after trying so much and talking about image of airflow how you got it ,, can you share .. like how you know that AIRFLOW_IMAGE_NAME=apache/airflow:2.4.2 AIRFLOW_UID=50000 these to set
Its not taking when i give .env file
king⭐⭐⭐⭐⭐
Can I do offline installation?
i had set up but when i am going to again use airflow by localhost8080 it's showing "localhost refused to connect " Any relevant help or fix will be appreciated. @AmpCode
Thanks for the explanation. However I couldn't reach localhost:8080 I got 6/7 services Running while Airflow-init-1 Exited. Please how do I fix this?
Thanks and it worked exactly shown in the video . Can you please share video link as where to store the .py file for creating dags in this setup , I tried to put the .py code under DAGS folder in material but it didn't got refreshed in Airflow GUI . Please suggest.
@rocksingh007
2 ай бұрын
:) Posting answer too , seems it takes some time to get refresh in GUI after saving .py to DAGS folder.
From the creation of new terminal, it shows me no configuration file provided.
Error arises while starting docker dekstop
i dont have 4gb remaining for docker, can you suggest the other method without installing docker
@jaydeepkarale
6 ай бұрын
INstall WSL, UBuntu and then try on that
also getting invalid login error now using admin as user and password. I copied your cmmand exactly
My localhost:8080 is working. It state that local host didn’t send any data. How can I rectify it?
@aswathsundarr4853
3 ай бұрын
turn off the firewall of your computer
I have followed the steps - all good till opening VS Code and adding compose and .env file with content. But docker-compose up -d saying file not found. Any relevant help or fix will be appreciated. @AmpCode
@uniquemotivation2.0
2 ай бұрын
please replay anyone how to fix it
@maxyblaqdataengr.
27 күн бұрын
Exactly the issue I’m facing here.
facing an error docker-compose up -d unknown shorthand flag: 'd' in -d
localhost:8080 is not working :(
my file showing txt there
why is my localhost 8080 is not working to launch airflow?
@vidhyas4459
6 ай бұрын
I too face the same issue. Were you able to figure it out?
@umerimran3833
5 ай бұрын
turn off firewall and retry@@vidhyas4459
@ilyeseljawhari4969
5 ай бұрын
that's because of the port 8080 is being used by another service , to chekck ,open CDM as addmin and type in " netstat -ano | findstr :8080 " to see if there is any service is using this port , if so , change the port of airflow web server in docker-compose.yaml file and try again
@aswathsundarr4853
3 ай бұрын
turn off the firewall of your computer
send slide , thnx
it shows local host didnt send any data
@aswathsundarr4853
3 ай бұрын
turn off the firewall of your computer
2:34
localhost didn’t send any data.
locahost:8080 did not work
@aswathsundarr4853
3 ай бұрын
turn off the firewall of your computer
local host not t working
@umerimran3833
5 ай бұрын
turn off firewall and retry
Sir, I am facing an issue in airflow while doing a project like ""airflow.exceptions.AirflowConfigException: Cannot use relative path: `sqlite:///C:\Users\YOURNAME/airflow/airflow.db` to connect to sqlite. Please use absolute path such as `sqlite:////tmp/a irflow.db`."" can you please suggest any solution for this
@meetpatel2720
4 ай бұрын
Me to
No configuration file provided: not found on visual studio