Package | Description |
---|---|
crawlercommons.fetcher |
The main fetching package within Crawler Commons, this package defines base fetching
and encoding classes, Enum's to determine reasoning behind typical fetching behaviour
as well as the base Exceptions which may be used.
|
crawlercommons.fetcher.file |
SimpleFileFetcher code which extends the BaseFetcher . |
crawlercommons.fetcher.http |
This package concerns the fetching of files over the HTTP protocol:
Extending from
BaseHttpFetcher (which itself extends BaseFetcher ) the
SimpleHttpFetcher provides the Crawler Commons HTTP fetching implementation. |
Modifier and Type | Class and Description |
---|---|
class |
AbortedFetchException
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
class |
BadProtocolFetchException
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
class |
HttpFetchException
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
class |
IOFetchException
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
class |
RedirectFetchException
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
class |
UrlFetchException
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
Modifier and Type | Method and Description |
---|---|
protected int |
BaseFetchException.compareToBase(BaseFetchException e)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
FetchedResult |
BaseFetcher.get(String url)
Deprecated.
|
abstract FetchedResult |
BaseFetcher.get(String url,
Payload payload)
Deprecated.
Get the content stored in the resource referenced by the 'url' parameter.
|
Modifier and Type | Method and Description |
---|---|
FetchedResult |
SimpleFileFetcher.get(String url,
Payload payload)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
FetchedResult |
SimpleHttpFetcher.fetch(org.apache.http.client.methods.HttpRequestBase request,
String url,
Payload payload)
Deprecated.
|
FetchedResult |
SimpleHttpFetcher.fetch(String url)
Deprecated.
|
FetchedResult |
SimpleHttpFetcher.get(String url,
Payload payload)
Deprecated.
|
Copyright © 2009–2016 Crawler-Commons. All rights reserved.