Package crawlercommons.domains

Classes contained within the domains package relate to the definition of Top Level Domain's, various domain registrars and the effective handling of such domains.

See: Description

Class Summary

Class	Description
EffectiveTldFinder	Given a URL's hostname, there are determining the actual domain requires knowledge of the various domain registrars and their assignment policies.
EffectiveTldFinder.EffectiveTLD
PaidLevelDomain	Routines to extract the PLD (paid-level domain, as per the IRLbot paper) from a hostname or URL.

Package crawlercommons.domains Description

Classes contained within the domains package relate to the definition of Top Level Domain's, various domain registrars and the effective handling of such domains.