Is it possible to use Java to build a web browser like Internet Explorer that will open all the web pages and display all the contents?
Yes. One of the projects in Java After Hours shows you how to build a simple web browser. It's not nearly as full-featured as IE or Firefox of course (it's only one chapter in the book), but it will show you how to get started.