Package | Description |
---|---|
crawlercommons.fetcher |
The main fetching package within Crawler Commons, this package defines base fetching
and encoding classes, Enum's to determine reasoning behind typical fetching behaviour
as well as the base Exceptions which may be used.
|
crawlercommons.fetcher.file |
SimpleFileFetcher code which extends the BaseFetcher . |
crawlercommons.fetcher.http |
This package concerns the fetching of files over the HTTP protocol:
Extending from
BaseHttpFetcher (which itself extends BaseFetcher ) the
SimpleHttpFetcher provides the Crawler Commons HTTP fetching implementation. |
Class and Description |
---|
AbortedFetchReason
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
BaseFetchException
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
EncodingUtils.ExpandedResult
Deprecated.
|
FetchedResult
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
Payload
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
RedirectFetchException.RedirectExceptionReason
Deprecated.
|
Class and Description |
---|
BaseFetcher
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
BaseFetchException
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
FetchedResult
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
Payload
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
Class and Description |
---|
BaseFetcher
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
BaseFetchException
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
FetchedResult
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
Payload
Deprecated.
As of release 0.6. We recommend directly using Apache HttpClient,
async-http-client, or any other robust, industrial-strength HTTP
clients.
|
Copyright © 2009–2016 Crawler-Commons. All rights reserved.