Uses of Class
crawlercommons.filters.URLFilter
-
Packages that use URLFilter Package Description crawlercommons.filters.basic URL normalizer performing basic normalizations applicable tohttp://
andhttps://
URLs.crawlercommons.sitemaps Classes focused on parsing and processing sitemaps and holding the resulting set of URLs with crawling-related metadata, such as the change frequency of a page. -
-
Uses of URLFilter in crawlercommons.filters.basic
Subclasses of URLFilter in crawlercommons.filters.basic Modifier and Type Class Description class
BasicURLNormalizer
Converts URLs to a normal form. -
Uses of URLFilter in crawlercommons.sitemaps
Methods in crawlercommons.sitemaps with parameters of type URLFilter Modifier and Type Method Description void
SiteMapParser. setURLFilter(URLFilter filter)
UseURLFilter
to filter URLs, eg. to configure that URLs found in sitemaps are normalized byBasicURLNormalizer
:
-