I got an email that my latest binary submission to Apple for an iOS/Watch OS app was invalid due to:
The app links to non-public libraries in PlugIns/
I was also facing the same issue. Here in my case just iMAC restart worked fine for me. Create a build after iMac restart and then create build and then upload, it worked perfectly for me.
Hope this helps...!!!