Package | Description |
---|---|
crawlercommons.robots |
The robots package contains all of the robots.txt rule inference, parsing and utilities contained within Crawler Commons.
|
Modifier and Type | Method and Description |
---|---|
static SimpleRobotRules.RobotRulesMode |
SimpleRobotRules.RobotRulesMode.valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static SimpleRobotRules.RobotRulesMode[] |
SimpleRobotRules.RobotRulesMode.values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
Constructor and Description |
---|
SimpleRobotRules(SimpleRobotRules.RobotRulesMode mode) |
Copyright © 2009–2016 Crawler-Commons. All rights reserved.