WebClient 403 Forbidden

Question

I can download this by hand in IE.

http://scholar.google.com/scholar.ris?q=info:j8ymU9rzMsEJ:scholar.google.com/&output=citation&hl=zh-CN&as_sdt=2000&

Answer 1

The key to solving this for me was to do the request once via code, a second time in the browser, log both requests with Fiddler and ensure the headers match up.

I ended up having to add headers for:

• Accept
• Accept-Encoding
• Accept-Language
• User-Agent
• Upgrade-Insecure-Requests

I hope this helps people in the future.