Simple, yet explanatory example. Thank you:)

I discovered your channel yesterday and i liked how your videos are short, organized, and cover most needed topics for Che Eng. Hope you will do videos on matlab, relating MATLAB with process control, and Che Eng process design. Thank you & looking forward to watching more videos.

Amazing thank u so much for the easy explanation and for the repo!

Amazing , that works perfectly, thanks.

Nice video! Thanks!

Hi! thanks for the video :) One question...how can we deal with the scenario where the external python script is using a package that is not installed in the Airflow environment? It will raise an error "'X' module is not found" in the Airflow UI, isn't?

@samyrhelou2580

2 жыл бұрын

i'd also like to know this!!

@manoj-ul9vc

2 жыл бұрын

Did you fix this issue.... Pls let me know

Thank you!

Hi is it possible to get task/dag duration from context

for those who suffering from name ‘_mysql’ is not defined error... here's how i solve this. - Make sure you following the instructions that he gave. pip install -upgrade pip pip install apache-airflow - Check your docker-compose version is 1.29.1 - Revise image, context, PYTHON_DEPS section in docker-compose.yml file. image: puckel/docker-airflow:1.10.9 context: {puckel/docker-airflow.git url}#1.10.9 (my comment is deleted bc of the this url.. change 1.10.1 to .9) PYTHON_DEPS: sqlalchemy==1.3.0 markupsafe==2.0.1 wtforms==2.2

@srishtiganguly6000

2 жыл бұрын

Thank you for sharing the solution. I was looking on StackOverflow and did not find a solution. The steps you mentioned worked and saved my day :)

instead of calling the script function, is there an operator that I can call the script completely to be executed?

Thanks !!

thank you

I am getting "modulenotfounderror" in DAG import errors. Can you please help me with this ?

Thanks a lot. Can you explain: - ./airflow-data/includes:/opt/airflow/includes

Hi Vincent, nice video. I am wondering if you could also make a Demo for external Docker connectivity. For example I create a job and it runs other dockers microservices. This will help to unload the server itself and putting the calculation work on other microservices. I hope you understand what I am trying to say here.

How is it that your editor has allowed you to strike off an import name and re-write a new one? What feature is this? Are there any alternates to this?

How to import files or modules which are located out of the root project directories somewhere in PC?

I am running into errors that say " NameError: name '_mysql' is not defined" when attempting to run docker-compose up. Do you know what the issue is here?

@MiShell103

2 жыл бұрын

I am getting this error too, did you ever figure it out?

Too many issues with this. The external python file simply isn't being recognised by the python_callable function.

please the pip install apache-airflow command does not work, could you tell us how you've done it

why my DAG always in the queue

Emphasis was to educate us on how to run external scripts...you did less than a minute on that...options like using bashoperator "bash_command" would have been nice.