There are many questions and answers surrounding getting native opencv for android building properly. Some use gradle, others use external tools. These numerous, complicate
With OpenCV 3.2 configuration could be actually quite short:
set(OpenCV_STATIC ON)
set(OpenCV_DIR ${OPENCV_HOME}/sdk/native/jni)
find_package (OpenCV REQUIRED)
target_link_libraries(native-lib ${OpenCV_LIBS})
That is it, 4 lines and no need to copy anything into your project. Just be sure that OPENCV_HOME points to the directory where OpenCV Android SDK is located.
One additional benefit of this approach - you can link with OpenCV statically, which would dramatically reduce the size of your app/library.
I use this approach in one of Github projects: https://github.com/Fotoapparat/FaceDetector