On Visual Studio I added application insight to a project which creates a ApplicationInsights.config and not sure what other files were added to the project.
Thing i
I would prefer to do this:
UnInstall-Package Microsoft.ApplicationInsights.Web -RemoveDependencies