Uses of Class
crawlercommons.sitemaps.SiteMap
-
Packages that use SiteMap Package Description crawlercommons.sitemaps Classes focused on parsing and processing sitemaps and holding the resulting set of URLs with crawling-related metadata, such as the change frequency of a page. -
-
Uses of SiteMap in crawlercommons.sitemaps
Methods in crawlercommons.sitemaps that return SiteMap Modifier and Type Method Description protected SiteMapSiteMapParser. processText(URL sitemapUrl, byte[] content)Process a text-based Sitemap.protected SiteMapSiteMapParser. processText(URL sitemapUrl, InputStream stream)Process a text-based Sitemap.Methods in crawlercommons.sitemaps with parameters of type SiteMap Modifier and Type Method Description static voidSiteMapCrossSubmitValidator. validateSiteMapURLs(SiteMap sitemap)Validate the URLs submitted in a sitemap whether they are valid, that is below the same URL prefix as the location of the sitemap.static voidSiteMapCrossSubmitValidator. validateSiteMapURLs(SiteMap sitemap, String host)Validate the URLs in a sitemap against a single cross-submit host.static voidSiteMapCrossSubmitValidator. validateSiteMapURLs(SiteMap sitemap, Collection<String> hosts)Validate the URLs in a sitemap against a set of cross-submit hosts.static voidSiteMapCrossSubmitValidator. validateSiteMapURLs(SiteMap sitemap, Collection<String> domains, SiteMapCrossSubmitValidator.CrossSubmitValidationLevel domainValidationLevel)Validate the URLs in a sitemap against a set of cross-submit domains.static voidSiteMapCrossSubmitValidator. validateSiteMapURLs(SiteMap sitemap, Predicate<URL> validator)
-