public static class AsyncFetcher.Builder extends Object
Modifier | Constructor and Description |
---|---|
protected |
Builder() |
Modifier and Type | Method and Description |
---|---|
AsyncFetcher |
build()
Builds the fetcher with the options specified.
|
AsyncFetcher.Builder |
compressed(boolean compressed)
Set whether to request for compress pages and to decompress pages
after it is fetched.
|
AsyncFetcher.Builder |
connectionRequestTimeout(int connectionRequestTimeout)
The timeout in milliseconds used when requesting a connection
from the connection manager.
|
AsyncFetcher.Builder |
connectTimeout(int connectTimeout)
Determines the timeout in milliseconds until a connection is established.
|
AsyncFetcher.Builder |
fileManager(@NotNull FileManager fileManager)
Sets the FileManager to be used.
|
AsyncFetcher.Builder |
headers(@NotNull Map<String,String> headers)
Sets the headers to be used when fetching items.
|
AsyncFetcher.Builder |
numIoThreads(int numIoThreads)
Number of httpclient dispatcher threads.
|
AsyncFetcher.Builder |
proxyProvider(@NotNull ProxyProvider proxyProvider)
Sets the ProxyProvider to be used.
|
AsyncFetcher.Builder |
register(@NotNull Callback callback)
Register any callbacks that will be called when a page has been fetched.
|
AsyncFetcher.Builder |
router(@NotNull ValidatorRouter router)
Sets ValidatorRouter to be used.
|
AsyncFetcher.Builder |
socketTimeout(int socketTimeout)
Defines the socket timeout (
SO_TIMEOUT ) in milliseconds,
which is the timeout for waiting for data or, put differently,
a maximum period inactivity between two consecutive data packets). |
AsyncFetcher.Builder |
soTimeout(int soTimeout)
Determines the default socket timeout value for non-blocking I/O operations.
|
AsyncFetcher.Builder |
stopCodes(int... codes) |
AsyncFetcher.Builder |
threadFactory(@NotNull ThreadFactory threadFactory)
Set the thread factory that creates the httpclient dispatcher
threads.
|
AsyncFetcher.Builder |
userAgent(@NotNull UserAgent userAgent)
Sets the UserAgent to be used, if not set, default will be chosen.
|
AsyncFetcher.Builder |
validator(@NotNull Validator validator)
Sets the Validator to be used.
|
public AsyncFetcher.Builder register(@NotNull @NotNull Callback callback)
callback
- A set of FetcherCallback.public AsyncFetcher.Builder fileManager(@NotNull @NotNull FileManager fileManager)
If fileManager is set, all items fetched will be saved to storage.
fileManager
- file manager to be used.public AsyncFetcher.Builder headers(@NotNull @NotNull Map<String,String> headers)
headers
- a map to headers to be used.public AsyncFetcher.Builder numIoThreads(int numIoThreads)
numIoThreads
- number of threads.public AsyncFetcher.Builder proxyProvider(@NotNull @NotNull ProxyProvider proxyProvider)
proxyProvider
- proxy provider to be usedpublic AsyncFetcher.Builder stopCodes(int... codes)
public AsyncFetcher.Builder threadFactory(@NotNull @NotNull ThreadFactory threadFactory)
threadFactory
- an instance of ThreadFactory.public AsyncFetcher.Builder userAgent(@NotNull @NotNull UserAgent userAgent)
userAgent
- user agent generator to be used.public AsyncFetcher.Builder validator(@NotNull @NotNull Validator validator)
This will validate the fetched page and retry if page is not consistent with the specification set by the validator.
validator
- validator to be used.public AsyncFetcher.Builder router(@NotNull @NotNull ValidatorRouter router)
router
- router validator router to be used.public AsyncFetcher.Builder connectionRequestTimeout(int connectionRequestTimeout)
connectionRequestTimeout
- timeout.public AsyncFetcher.Builder connectTimeout(int connectTimeout)
connectTimeout
- timeout.public AsyncFetcher.Builder socketTimeout(int socketTimeout)
SO_TIMEOUT
) in milliseconds,
which is the timeout for waiting for data or, put differently,
a maximum period inactivity between two consecutive data packets).socketTimeout
- timeout.public AsyncFetcher.Builder soTimeout(int soTimeout)
soTimeout
- timeout.public AsyncFetcher.Builder compressed(boolean compressed)
compressed
- should request for compress pagespublic AsyncFetcher build()
Copyright © 2018. All rights reserved.