I\'m mirroring some internal websites for backup purposes. As of right now I basically use this c# code:
System.Net.WebClient client = new System.Net.WebCli
You could use the HTMLAgilityPack accomplish this. You would do something along these (not tested) lines:
Here are a few examples:
Relative to absolute paths in HTML (asp.net)
http://htmlagilitypack.codeplex.com/wikipage?title=Examples&referringTitle=Home
http://blog.abodit.com/2010/03/a-simple-web-crawler-in-c-using-htmlagilitypack/