Download a file through the WebBrowser control

Question

I have a WebBrowser control on a form, but for the most part it remains hidden from the user. It is there to handle a series of login and other tasks. I have to use<

Answer 1

The solution I ended up using:

I did everything else as-needed to get the URL where it needed to go. Knowing that all of the login information, required settings, viewstates, etc. were stored in the cookies, I was finally able to grab the file using a hybrid of the web control to navigate then the WebClient object to actually snag the file bytes.

    public byte[] GetPDF(string keyValue)
    {
        DoLogin();

        // Ask the source to generate the PDF. The PDF doesn't 
        // exist on the server until you have visited this page 
        // at least ONCE. The PDF exists for five minutes after 
        // the visit, so you have to snag it pretty quick.
        LoadUrl(string.Format(
            "https://www.theMagicSource.com/getimage.do?&key={0}&imageoutputformat=PDF", 
            keyValue));

        // Now that we're logged in (not shown here), and 
        // (hopefully) at the right location, snag the cookies. 
        // We can use them to download the PDF directly.
        string cookies = GetCookies();

        byte[] fileBytes = null;
        try
        {
            // We are fully logged in, and by now, the PDF should
            // be generated. GO GET IT! 
            WebClient wc = new WebClient();
            wc.Headers.Add("Cookie: " + cookies);

            string tmpFile = Path.GetTempFileName();

            wc.DownloadFile(string.Format(
                "https://www.theMagicSource.com/document?id={0}_final.PDF", 
                keyValue), tmpFile);

            fileBytes = File.ReadAllBytes(tmpFile);
            File.Delete(tmpFile);
        }
        catch (Exception ex)
        {
            // If we can't get the PDF here, then just ignore the error and return null.
            throw new WebScrapePDFException(
                "Could not find the specified file.", ex);
        }

        return fileBytes;
    }

    private void LoadUrl(string url)
    {
        InternalBrowser.Navigate(url);

        // Let the browser control do what it needs to do to start 
        // processing the page.
        Thread.Sleep(100);

        // If EITHER we can't continue OR
        // the web browser has not been idle for 10 consecutive seconds yet, 
        // then wait some more.
        // ...
        // ... Some stuff here to make sure the page is fully loaded and ready. 
        // ... Removed to reduce complexity, but you get the idea.
        // ...
    }

    private string GetCookies()
    {
        if (InternalBrowser.InvokeRequired)
        {
            return (string)InternalBrowser.Invoke(new Func(() => GetCookies()));
        }
        else
        {
            return InternalBrowser.Document.Cookie;
        }
    }