When I build a solution on my build server it generates a binaries folder and then later on copies these binaries to the final output folder. In my case some of the third party
Please do one thing, add the third party dlls to your bin folder and give reference to that dll in the bin folder.
Then build the solution and commit the results. This will copy the third party dlls in the bin folder.