lxml

Is it possible to run Scrapy on PyPy ? I've looked through the documentation and the github project, but the only place where PyPy is mentioned is that there were some unit tests being executed on PyPy 2 years ago, see PyPy support . There is also Scrapy fails in PyPy long discussion happened 3 years ago without a concrete resolution or a follow-up. From what I understand, the main Scrapy's dependency Twisted is known to work on PyPy . Scrapy also uses lxml for HTML parsing, which has a PyPy -friendly fork . The other dependency, pyOpenSSL is fully supported (thanks to @Glyph's comment). Yes.

I'm trying to find out why lxml cannot parse an XSL document which consists of a "root" document with various xml:include s. I get an error: Traceback (most recent call last): File "s.py", line 10, in <module> xslt = ET.XSLT(ET.parse(d)) File "xslt.pxi", line 409, in lxml.etree.XSLT.__init__ (src/lxml/lxml.etree.c:151978) lxml.etree.XSLTParseError: Invalid expression That tells me where in the lxml source the error is, but is there a way to get more through lxml about where in the xsl the error is , or should I be using a different method? I'm trying to provide a service that accepts XSL

Python noob, please bear with me. I used python installer for v3.5.1 from www.python.org. My intent was to use Scrapy to run some scripts. pip install scrapy failed, as did easy_install scrapy and others. I traced the error to a faulty install of lxml. Here is the error log. I've even tried easy_installing libxml2, I'm not sure how to proceed. Building lxml version 3.5.0. Building without Cython. ERROR: b"'xslt-config' is not recognized as an internal or external command,\r\noperable program or batch file.\r\n" ** make sure the development packages of libxml2 and libxslt are installed ** Using

Just two questions: How can I check if the string assigned to a variable corresponds to a valid XPath expression? How can I return a customized error message in case the requested resource does not exist? If the XPath is invalid, you'll get an exception. If the requested node does not exist, you'll get an empty result set. For example: from lxml import etree from StringIO import StringIO tree = etree.parse(StringIO('<foo><bar></bar></foo>')) try: tree.xpath('\BAD XPATH') print '1. Valid XPath' except etree.XPathEvalError, e: print '1. Invalid XPath: ', e if not tree.xpath('/foo/xxx'): print '2

I want to perform iterfind() for elements which have a namespace but no prefix. I'd like to call iterfind([tagname]) or iterfind([tagname], [namespace dict]) I don't care to enter the tag as follows every time: "{%s}tagname" % tree.nsmap[None] Details I'm running through an xml response from a Google API. The root node defines several namespaces, including one for which there is no prefix: xmlns="http://www.w3.org/2005/Atom" It looks as though when I try to search through my etree, everything behaves as I would expect for elements with a prefix. e.g.: >>> for x in root.iterfind('dxp:segment'):

Possible Duplicate: When using lxml, can the XML be rendered without namespace attributes? How can I strip the python attributes from an lxml.objectify.ObjectifiedElement ? Example: In [1]: from lxml import etree, objectify In [2]: foo = objectify.Element("foo") In [3]: foo.bar = "hi" In [4]: foo.baz = 1 In [5]: foo.fritz = None In [6]: print etree.tostring(foo, pretty_print=True) <foo xmlns:py="http://codespeak.net/lxml/objectify/pytype" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" py:pytype="TREE"> <bar py:pytype="str">hi</bar> <baz py

How can I remove certain attributes such as id, style, class, etc. from HTML code? I thought I could use the lxml.html.clean module , but as it turned out I can only remove style attributes with Clean(style=True).clean_html(code) . I'd prefer not to use regular expressions for this task (attributes could change). What I would like to have: from lxml.html.clean import Cleaner code = '<tr id="ctl00_Content_AdManagementPreview_DetailView_divNova" class="Extended" style="display: none;">' cleaner = Cleaner(style=True, id=True, class=True) cleaned = cleaner.clean_html(code) print cleaned '<tr>'