MSProject Add-In doesn't include nuget reference packages during publishing

Question

I have a VSTO add-in for MS Project. When I build the project, all the required dll\'s are in a bin folder. But when I perform publish, the dll\'s, which comes from nuget, i