Package crawlercommons
Class CrawlerCommons
- java.lang.Object
-
- crawlercommons.CrawlerCommons
-
public class CrawlerCommons extends Object
Crawler-Commons is a set of reusable Java components that implement functionality common to web crawlers: robots.txt and sitemap parsing, or URL normalization.
-
-
Constructor Summary
Constructors Constructor Description CrawlerCommons()
-
-
-
Method Detail
-
getVersion
public static String getVersion()
-
-