Airflow Debugging: setting max_active_runs causes limit for dag to be reached error

Question

I setup Airflow to use the DebugExcecutor, and while experimenting, I set the DAGs max_active_runs property to 3. Now it seems as though I opened pandora\'s box