Airflow Impersonation with 'run_as_user' Not Working

问题

I am trying to get impersonation working without success. I am following the instructions here - https://airflow.apache.org/security.html#impersonation

I launched airflow webserver, scheduler, and worker as sudo running under the 'airflow' user. This user is setup in the sudoers file to allow no password logins.

I created a BashOperator and a PythonOperator with the run_as_user parameter set to an existing user named 'linus' on the server. When I am logged in as 'airflow', I am able to switch users by running sudo -u linus without it prompting me for a password.

dag = DAG('test_impersonation', default_args=args)

def print_user(**kwargs):
    print('USER:', getpass.getuser())

t1 = BashOperator(task_id='bash_task', 
                  bash_command='touch /home/linus/test.x',
                  run_as_user='linus',
                  dag=dag)

t2 = PythonOperator(task_id='py_task',
                    python_callable='print_user', 
                    run_as_user='linus',
                    dag=dag)

I am testing these tasks with the following commands in the terminal:

airflow test test_impersonation bash_task 2018-03-30
airflow test test_impersonation py_task 2018-03-30

The first command (BashOperator task) fails with a permission denied error telling me it's still running as the 'airflow' user.

The second command (PythonOperator task) prints the following:

USER: airflow

I expect this to print USER: linus

Is there anything I am missing? Any help would be greatly appreciated.

Thanks for reading!

回答1:

I'm not exactly certain, but it looks like the sudo -u prepend is applied in a task_runner, which is setup by the executor, and probably runs the cli run command; while the cli test command only calls run on the task_instance in test mode, and this doesn't prepend the sudo -u.

来源：https://stackoverflow.com/questions/49580187/airflow-impersonation-with-run-as-user-not-working

标签

python

airflow