Obviously I need the correct import statment to solve this problem. According to the docs for AndroidJUnit4, this should be
import android.support.test.runn
In my case this helped for release variant:
android { ... testBuildType "release" }