I would like to put a link to a webpage in an alert dialog box so that I can give a more detailed description of how to fix the error that makes the dialog box get created.
You can't. Alert boxes don't support html. You should display the error as part of the page, it's nicer than JS alerts anyway.