Obviously I need the correct import statment to solve this problem. According to the docs for AndroidJUnit4, this should be
import android.support.test.runn
Adding
compile com.android.support.test:runner:0.5'
resolved this exact issue for me.