Is it possible for lxml to work in a case-insensitive manner?

Question

I\'m trying to scrape META keywords and description tags from arbitrary websites. I obviusly have no control over said website, so have to take what I\'m given. They have a

Answer 1

You can use

doc.cssselect.xpath("//meta[translate(@name,
    'ABCDEFGHJIKLMNOPQRSTUVWXYZ', 'abcdefghjiklmnopqrstuvwxyz')='description']")

It translates the value of "name" to lowercase and then matches.

See also:

• XPath: How do you do a lowercase call in xpath
• Xpath translation function turns things into lowercase?