lxml

I want to fetch company name, email, phone number from this Link and put these contents in an excel file. I want to do the same for the all pages of the website. I have got the logic to fetch the the links in the browser and switch in between them. I'm unable to fetch the data from the website. Can anybody provide me an enhancement to the code i have written. Below is the code i have written: from selenium import webdriver from selenium.common.exceptions import NoSuchElementException from selenium.webdriver.common.keys import Keys import time from lxml import html import requests import xlwt

I have written a small python script to parse XML data based on Liza Daly's blog in Python. However, my code does not parse all the nodes. So for example when a person has had multiple addresses then it takes only the first available address. The XML tree would look like this: - lgs - entities - entity - id - name - addressess - address - address1 - address - address1 - entity - id (...) and this would be the python script: import os import time from datetime import datetime import lxml.etree as ET import pandas as pd xml_file = '.\\FILE.XML' file_name, file_extension = os.path.splitext(os

from lxml import html import requests url = "https://website.com/" page = requests.get(url) tree = html.fromstring(page.content) page.content -> SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:748) I run this script but I got this error. How can I do it? Since your URL is "an internal corporate URL" (as stated in comments), I'm guessing it uses a self-signed certificate, or is issued by a self-signed CA certificate. If that is in fact the case, you have two options: (1) provide the path to your corporate CA (including the complete chain of intermediate certificates

Trying to retrieve some data from the web using urlib and lxml, I've got an error and have no idea, how to fix it. url='http://sum.in.ua/?swrd=автор' page = urllib.request.urlopen(url) The error itself: UnicodeEncodeError: 'ascii' codec can't encode characters in position 11-15: ordinal not in range(128) I'm using Ukrainian in API this time, but when I use API (without any Ukrainian letters in it) here: url="http://www.toponymic-dictionary.in.ua/index.php?option=com_content&view=section&layout=blog&id=8&Itemid=9" page = urllib.request.urlopen(url) pageWritten = page.read() pageReady =

I have a very large .xml file and I am trying to make a new .xml file that just has a small part of this larger file's contents. I want to specify an attribute (in my case, an itemID) and give it a few specific values and then it would strip away all the elements except for the ones that have those itemIDs and their children. My large .xml file looks something like this: <?xml version='1.0' encoding='UTF-8'?> <api version="2"> <currentTime>2013-02-27 17:00:18</currentTime> <result> <rowset name="assets" key="itemID" columns="itemID,locationID,typeID,quantity,flag,singleton"> <row itemID=

I am running the following code in Python 2.7.3 on Mac OS X 10.6.8. import StringIO from lxml import etree f = open('./foo', 'r') doc = "" while 1: line = f.readline() doc += line if line == "": break tree = etree.parse(StringIO.StringIO(doc), etree.HTMLParser()) r = tree.xpath('//foo') for i in r: for j in i.iter(): print j.tag, j.text And the file foo contains <foo> AAA <bar> BBB </bar> XXX </foo> The output is foo AAA bar BBB Why am I not getting the text XXX ? How do I access it? Thanks Try this: from lxml import etree tree = etree.fromstring("<foo> AAA <bar> BBB </bar> XXX </foo>") foos =

I'm trying to create an xml entry that looks like this using python and lxml: <resource href="Unit 4.html" adlcp:scormtype="sco"> I'm using python and lxml. I'm having trouble with the adlcp:scormtype attribute. I'm new to xml so please correct me if I'm wrong. adlcp is a namespace and scormtype is an attribute that is defined in the adlcp namespace, right? I'm not even sure if this is the right question but... My question is, how do I add an attribute to an element from a non-default namespace using lxml? I apologize in advance if this is a trivial question. This is not a full reply but just

I am creating a new xml file from scratch using python and the lxml library. <route xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.xxxx" version="1.1" xmlns:stm="http://xxxx/1/0/0" xsi:schemaLocation="http://xxxx/1/0/0 stm_extensions.xsd"> I need to include this namespace information into the root tag as attributes of the route tag. I can´t include the information into the root declaration. from lxml import etree root = etree.Element("route", xmlns:xsi = "http://www.w3.org/2001/XMLSchema-instance", xmlns = "http://www.xxxxx", version = "1.1", xmlns: stm = "http://xxxxx