airflow

问题 I just start using airflow and I used the command : airflow initdb to initiate the airflow db as the setup required. But I stumbled on the error : import cattr File "/home/adrienb/anaconda3/lib/python3.8/site-packages/cattr/__init__.py", line 1, in <module> from .converters import Converter, GenConverter, UnstructureStrategy File "/home/adrienb/anaconda3/lib/python3.8/site-packages/cattr/converters.py", line 16, in <module> from attr import fields, resolve_types ImportError: cannot import

问题 I just start using airflow and I used the command : airflow initdb to initiate the airflow db as the setup required. But I stumbled on the error : import cattr File "/home/adrienb/anaconda3/lib/python3.8/site-packages/cattr/__init__.py", line 1, in <module> from .converters import Converter, GenConverter, UnstructureStrategy File "/home/adrienb/anaconda3/lib/python3.8/site-packages/cattr/converters.py", line 16, in <module> from attr import fields, resolve_types ImportError: cannot import

问题 I just start using airflow and I used the command : airflow initdb to initiate the airflow db as the setup required. But I stumbled on the error : import cattr File "/home/adrienb/anaconda3/lib/python3.8/site-packages/cattr/__init__.py", line 1, in <module> from .converters import Converter, GenConverter, UnstructureStrategy File "/home/adrienb/anaconda3/lib/python3.8/site-packages/cattr/converters.py", line 16, in <module> from attr import fields, resolve_types ImportError: cannot import

问题 It was so hard to put that right title. Ok, here it goes. I was following this tutorial to install Apache Airflow on my Mac (Mojave version) - https://towardsdatascience.com/getting-started-with-apache-airflow-df1aa77d7b1b Right at the first step after performing the pip install airflow task, when I run the airflow version command I am getting the following error and then the airflow version appears - ERROR - Failed on pre-execution callback using Traceback (most recent call last): File "

问题 I am trying schedule a dag to run every x seconds. I put the start time as a past date with catchup = False and end time as few seconds into the future. Although the dag starts as expected, it does not end and goes on forever. The dag ends if I use an absolute end time like datetime(2019,9,26) but not with datetime.now()+timedelta(seconds=100) start_date = datetime(2019, 1, 1) end_date = datetime.now()+timedelta(seconds=200) default_args = { "owner": "airflow", "depends_on_past": True, "start

问题 I am trying schedule a dag to run every x seconds. I put the start time as a past date with catchup = False and end time as few seconds into the future. Although the dag starts as expected, it does not end and goes on forever. The dag ends if I use an absolute end time like datetime(2019,9,26) but not with datetime.now()+timedelta(seconds=100) start_date = datetime(2019, 1, 1) end_date = datetime.now()+timedelta(seconds=200) default_args = { "owner": "airflow", "depends_on_past": True, "start

问题 I am trying schedule a dag to run every x seconds. I put the start time as a past date with catchup = False and end time as few seconds into the future. Although the dag starts as expected, it does not end and goes on forever. The dag ends if I use an absolute end time like datetime(2019,9,26) but not with datetime.now()+timedelta(seconds=100) start_date = datetime(2019, 1, 1) end_date = datetime.now()+timedelta(seconds=200) default_args = { "owner": "airflow", "depends_on_past": True, "start

问题 Following the project from here, I am trying to integrate airflow kubernetes executor using NFS server as backed storage PV. I've a PV airflow-pv which is linked with NFS server. Airflow webserver and scheduler are using a PVC airflow-pvc which is bound with airflow-pv . I've placed my dag files in NFS server /var/nfs/airflow/development/<dags/logs> . I can see newly added DAGS in webserver UI aswell. However when I execute a DAG from UI, the scheduler fires a new POD for that tasks BUT the

问题 Following the project from here, I am trying to integrate airflow kubernetes executor using NFS server as backed storage PV. I've a PV airflow-pv which is linked with NFS server. Airflow webserver and scheduler are using a PVC airflow-pvc which is bound with airflow-pv . I've placed my dag files in NFS server /var/nfs/airflow/development/<dags/logs> . I can see newly added DAGS in webserver UI aswell. However when I execute a DAG from UI, the scheduler fires a new POD for that tasks BUT the

问题 Following the project from here, I am trying to integrate airflow kubernetes executor using NFS server as backed storage PV. I've a PV airflow-pv which is linked with NFS server. Airflow webserver and scheduler are using a PVC airflow-pvc which is bound with airflow-pv . I've placed my dag files in NFS server /var/nfs/airflow/development/<dags/logs> . I can see newly added DAGS in webserver UI aswell. However when I execute a DAG from UI, the scheduler fires a new POD for that tasks BUT the