Unable to start Airflow worker/flower and need clarification on Airflow architecture to confirm that the installation is correct

Question

Running a worker on a different machine results in errors specified below. I have followed the configuration instructions and have sync the dags folder.

I would also

Answer 1

The ImportError: No module named postgresql error is due to the invalid prefix used in your celery_result_backend. When using a database as a Celery backend, the connection URL must be prefixed with db+. See https://docs.celeryproject.org/en/stable/userguide/configuration.html#conf-database-result-backend

So replace:

celery_result_backend = postgresql+psycopg2://username:password@192.168.1.2:5432/airflow

with something like:

celery_result_backend = db+postgresql://username:password@192.168.1.2:5432/airflow

Answer 2

You need to ensure to install Celery Flower. That is, pip install flower.