tld

I have a list of million urls. I need to extract the TLD for each url and create multiple files for each TLD. For example collect all urls with .com as tld and dump that in 1 file, another file for .edu tld and so on. Further within each file, I have to sort it alphabetically by domains and then by subdomains etc. Can anyone give me a head start for implementing this in perl? Use URI to parse the URL, Use its host method to get the host, Use Domain::PublicSuffix 's get_root_domain to parse the host name. Use the tld or suffix method to get the real TLD or the pseudo TLD. use feature qw( say );

Is there some where in Rails's configuration where I can globally set the TLD length to 2 (co.uk as an example) so request.domain and request.subdomain parse correctly without having to pass options? That is, request.domain(2), by default Rails seems to be set to 1 by default and it makes sense to be able to change this globally, however, haven't been able to find anything in the documentation. Does such a configuration option exist? Jonas Elfström For Rails 3.0.9 and below, there's no such configuration since the source of domain is: # File actionpack/lib/action_dispatch/http/url.rb, line 78

$ pip install tld Collecting tld Using cached https://files.pythonhosted.org/packages/fa/78/dbeaeb20db795c42deb81271fd65a35c040ce2e946024eaeef5c6b184176/tld-0.9-py2.py3-none-any.whl Collecting six>=1.9 (from tld) Using cached https://files.pythonhosted.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl Installing collected packages: six, tld Found existing installation: six 1.4.1 Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a

Does anyone know a regular expression to match Domain.CCTLD? I don't want subdomains, only the "atomic domain". For example, docs.google.com doesn't get matched, but google.com does. However, this gets complicated with stuff like .co.uk , CCTLDs. Does anyone know a solution? Thanks in advance. EDIT: I've realized I also have to deal with multiple subdomains, like john.doe.google.co.uk . Need a solution now more than ever :P. Based on your comment above, I'm going to reinterpret the question -- rather than making a regex that will match them, we'll create a function that will match them, and

i need to extract the top domain of an url and i got his http://publicsuffix.org/index.html and the java implementation is in http://guava-libraries.googlecode.com and i could not find any example to extract domain name say example.. example.google.com returns google.com and bing.bing.bing.com returns bing.com can any one tell me how can i implement using this library with an example.... ColinD It looks to me like InternetDomainName.topPrivateDomain() does exactly what you want. Guava maintains a list of public suffixes (based on Mozilla's list at publicsuffix.org) that it uses to determine

I found a lot of threads explaining how to get the country-codes in two- or three-letter format, but nothing that fits to my task. I'm heading for a way to get all the top level domains in an array or something. I know there's the CultureInfo class in C# but which could list the country codes. It doesn't include generic TLD, e.g.: "com". Here's the complete list of country codes I found . The authoritative list of all TLDs: http://www.iana.org/domains/root/db The Root Zone Database represents the delegation details of top-level domains, including gTLDs such as .com , and country-code TLDs such