If you enabled dynamicAllocation, try to disable this configuration (spark.dynamicAllocation.enabled=false). You are able to set this spark configuration under conf/spark-defaults.conf, as --conf or within the code.
See also:
https://issues.apache.org/jira/browse/SPARK-22618
https://issues.apache.org/jira/browse/SPARK-23806