Turn out that RecycleView saves the view position in the view layout params, so if you just want the view position from to get the right item from the list you can use this:
RecyclerView.LayoutParams lp = (RecyclerView.LayoutParams) v.getLayoutParams();
lp.getViewPosition();