headless-browser | 易学教程

Using a headless browser with Heroku Rails Unicorn stack

阅读更多关于 Using a headless browser with Heroku Rails Unicorn stack

问题 I have seen posts that you can change the build on Heroku, to use PhantomJS with the Cedar stack, but is it possible to run a headless browser on the unicorn stack? 回答1: Yes, and someone already wrote a buildpack for including PhantomJS (the internet and open source are amazing). If you want to run headless PhantomJS on a Heroku dyno, you will need to: Switch to Heroku multi-buildpack: https://github.com/ddollar/heroku-buildpack-multi Setup Ruby buildpack for your app: https://github.com

Using CefSharp.Offscreen to retrieve a web page that requires Javascript to render

阅读更多关于 Using CefSharp.Offscreen to retrieve a web page that requires Javascript to render

问题 I have what is hopefully a simple task, but it's going to take someone that's versed in CefSharp to solve it. I have an url that I want to retrieve the HTML from. The problem is this particular url doesn't actually distribute the page on a GET. Instead, it pushes a mound of Javascript to the browser, which then executes and produces the actual rendered page. This means that the usual approaches involving HttpWebRequest and HttpWebResponse aren't going to work. I've looked at a number of

c# headless browser with javascript support for crawler

阅读更多关于 c# headless browser with javascript support for crawler

Could anyone suggest headless browser for .NET that supports cookies and authomatically javascript execution? Selenium+HtmlUnitDriver/GhostDriver is exactly what you are looking for. Oversimplified, Selenium is library for using variety of browsers for automation purposes - testing, scraping, task automation. There are different WebDriver classes with which you can operate an actual browser. HtmlUnitDriver is a headless one. GhostDriver is a WebDriver for PhantomJS, so you can write C# while actually PhantomJS will do the heavy lifting. Code snippet from Selenium docs for Firefox, but code

What is a good headless browser to run with protractor?

阅读更多关于 What is a good headless browser to run with protractor?

问题 New User here. After hours of building my smoke and regression tests, I found out after reading many cases online that phantomjs is known to be a trouble to run with protractor. Jenkins has been running phantomjs for all the tasks it has been given so far. They need these tests to run as part of ci which does not have a windowing system installed. So I would appreciate it if there is a recommendation for completely headless browser or a headless chrome(that would be most beneficial) and a

Problem in HtmlUnit API for Java (Headless Browser)?

阅读更多关于 Problem in HtmlUnit API for Java (Headless Browser)?

I am using HtmlUnit headless browser to browse this webpage (you can see the webpage to have a better understanding of the problem). I have set the select's value to "1" by the following commands final WebClient webClient = new WebClient(BrowserVersion.INTERNET_EXPLORER_7); try { // Configuring the webClient webClient.setJavaScriptEnabled(true); webClient.setThrowExceptionOnScriptError(false); webClient.setCssEnabled(true); webClient.setUseInsecureSSL(true); webClient.setRedirectEnabled(true); webClient.setActiveXNative(true); webClient.setAppletEnabled(true); webClient

How do I use Headless Chrome in Chrome 60 on Windows 10?

阅读更多关于 How do I use Headless Chrome in Chrome 60 on Windows 10?

问题 I've been looking at the following article about Headless Chrome: https://developers.google.com/web/updates/2017/04/headless-chrome I just upgraded Chrome on Windows 10 to version 60, but when I run either of the following commands from the command line, nothing seems to happen: chrome --headless --disable-gpu --dump-dom https://www.google.com/ chrome --headless --disable-gpu --print-to-pdf https://www.google.com/ And I'm running all of these commands from the following path (the default

Python Headless Browser for GAE

阅读更多关于 Python Headless Browser for GAE

I'm trying to use Angular.js client-side with webapp2 on Google Appengine. In order to solve the SEO issues the idea was to use a headless browser to run the javascript server-side and serve the resulting html to the crawlers. Is there any headless browser for python that runs on google app engine? This can now be done on App Engine Flex with a custom runtime, so I'm adding this answer since this question is the first thing to popup in google. I based this custom runtime off of my other GAE flex microservice which uses the pre-built python runtime Project Structure: webdrivers/ - geckodriver

Real headless browser

阅读更多关于 Real headless browser

I am in charge of testing an enterprise web application that makes heavy use of AJAX. I need to build a system that allows continuous running of tests without human intervention. Currently I am mostly interested in load testing but I want the same scripts used to generate load to be used in functional tests. Currently for loadtesting I am using the grinder . We record scripts and then process the heck out of them to handle among other things the asynchronous requests. This system works for now; however the scripts are delicate and I can't maintain them during our development cycle. I need to

Creating a headless Chrome instance in Python

阅读更多关于 Creating a headless Chrome instance in Python

问题 This question describes my conclusion after researching available options for creating a headless Chrome instance in Python and asks for confirmation or resources that describe a 'better way'. From what I've seen it seems that the quickest way to get started with a headless instance of Chrome in a Python application is to use CEF (http://code.google.com/p/chromiumembedded/) with CEFPython (http://code.google.com/p/cefpython/). CEFPython seems premature though, so using it would likely mean

Download files in Java, Selenium using ChromeDriver and headless mode

阅读更多关于 Download files in Java, Selenium using ChromeDriver and headless mode

As it is still not clear for me how to download files using --headless mode in ChromeDriver - selenium [Java], add here please the example of how to do so, I try to do it like that (the file downloading works properly without --headless option): ChromeOptions lChromeOptions = new ChromeOptions(); HashMap<String, Object> lChromePrefs = new HashMap<String, Object>(); lChromePrefs.put("profile.default_content_settings.popups", 0); lChromePrefs.put("download.default_directory", _PATH_TO_DOWNLOAD_DIR); lChromePrefs.put("browser.set_download_behavior", "{ behavior: 'allow' , downloadPath: '"+_PATH