webpage

I've been googling this all day with out finding the answer, so apologies in advance if this is already answered. I'm trying to get all visible text from a large number of different websites. The reason is that I want to process the text to eventually categorize the websites. After a couple of days of research, I decided that Selenium was my best chance. I've found a way to grab all the text, with Selenium, unfortunately the same text is being grabbed multiple times: from selenium import webdriver import codecs filen = codecs.open('outoput.txt', encoding='utf-8', mode='w+') driver = webdriver

I have a folder in my ftp server which contains several images. I'm trying to access and show these images in a webpage like <img src="ftp://my_ftp_ip_address/Images/imagename.jpg"/> But it asks for an FTP username and password. How can I achieve this? Also is it possible to do the same using Java? With the latest versions of web browsers ( Chrome 59 , Firefox 61 ), you cannot even use ftp:// URL to retrieve an image. And it was never a good solution anyway. The correct solution is to route the image through your webserver, hiding away not only the credentials, but also the original source of

After highlighting text, I would like to obtain the paragraph in which the selected text resides. var select = window._content.document.getSelection(); Any pointers please? cletus This is actually rather hard to do because you have to consider six cases: The selection is not within a paragraph (easy); The entire selection is within one paragraph (easy); The entire selection crosses one or more sibling paragraphs (harder); The selection starts or ends in an element not within a paragraph (harder); The paragraphs spanned are at different levels eg one is within a list item while two others are

What I want to achieve is to get a website screenshot from any website in python. Env: Linux On the Mac, there's webkit2png and on Linux+KDE, you can use khtml2png . I've tried the former and it works quite well, and heard of the latter being put to use. I recently came across QtWebKit which claims to be cross platform (Qt rolled WebKit into their library, I guess). But I've never tried it, so I can't tell you much more. The QtWebKit links shows how to access from Python. You should be able to at least use subprocess to do the same with the others. Here is a simple solution using webkit: http: