Scraping an AngularJS application

Question

I\'m scrapping some HTML pages with Rails, using Nokogiri.

I had some problems when I tried to scrap an AngularJS page because the gem is opening the HTML before it

Answer 1

You can use:

require 'phantomjs'
require 'watir'

b = Watir::Browser.new(:phantomjs)
b.goto URL

doc = Nokogiri::HTML(b.html)

Download phantomjs in http://phantomjs.org/download.html and move the binary for /usr/bin