static Crawler.Builder |
Crawler.builder() |
Creates a new instance of Builder.
|
Crawler.Builder |
Crawler.Builder.setFetcher(@NotNull Fetcher fetcher) |
Sets the Fetcher to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.setHandlerRouter(HandlerRouter router) |
Sets HandlerRouter to be used.
|
Crawler.Builder |
Crawler.Builder.setJobQueue(@NotNull BlockingQueue<Job> jobQueue) |
Sets the JobQueue to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.setMaxConnections(int maxConnections) |
The number of concurrent connections allowed out of the client.
|
Crawler.Builder |
Crawler.Builder.setMaxTries(int maxTries) |
Sets number of times to retry for a request.
|
Crawler.Builder |
Crawler.Builder.setName(@NotNull String name) |
Sets the name for crawler thread.
|
Crawler.Builder |
Crawler.Builder.setParallelism(int parallelism) |
Sets the parallelism level.
|
Crawler.Builder |
Crawler.Builder.setPropRetainProxy(double propRetainProxy) |
Sets the proportion of max tries where a specified proxy, if specified will be used.
|
Crawler.Builder |
Crawler.Builder.setScheduler(@NotNull BlockingQueue<Job> jobQueue) |
Deprecated.
|
Crawler.Builder |
Crawler.Builder.setSession(Session session) |
Sets the Session to be used, if not set, defaults to Session.EMPTY_SESSION .
|
Crawler.Builder |
Crawler.Builder.setSleepScheduler(SleepScheduler sleepScheduler) |
Sets the SleepScheduler to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.setWorkerManager(@NotNull WorkerManager workerManager) |
Sets the WorkerManager to be used, if not set, default will be chosen.
|