Uses of Interface
ai.preferred.venom.request.Request
-
Packages that use Request Package Description ai.preferred.venom ai.preferred.venom.fetcher ai.preferred.venom.job ai.preferred.venom.request ai.preferred.venom.storage ai.preferred.venom.utils ai.preferred.venom.validator -
-
Uses of Request in ai.preferred.venom
Methods in ai.preferred.venom with parameters of type Request Modifier and Type Method Description org.apache.http.HttpHost
ProxyProvider. get(@NotNull Request request)
Returns the get proxy from the list.Handler
HandlerRouter. getHandler(@NotNull Request request)
Returns the handler to be used for a specified request.Handler
UrlRouter. getHandler(Request request)
Validator
UrlRouter. getValidator(Request request)
Validator
ValidatorRouter. getValidator(@NotNull Request request)
Returns the handler to be used for a specified request.void
Handler. handle(Request request, VResponse response, Scheduler scheduler, Session session, Worker worker)
This function is called when the request is fetched successfully. -
Uses of Request in ai.preferred.venom.fetcher
Methods in ai.preferred.venom.fetcher with parameters of type Request Modifier and Type Method Description void
Callback. cancelled(@NotNull Request request)
Method to be call upon cancellation of request.void
Callback. completed(@NotNull Request request, @NotNull Response response)
Method to be call upon completion of request.void
Callback. failed(@NotNull Request request, @NotNull Exception ex)
Method to be call upon failure of request.Future<Response>
AsyncFetcher. fetch(Request request)
Future<Response>
AsyncFetcher. fetch(Request request, Callback callback)
@NotNull Future<Response>
Fetcher. fetch(@NotNull Request request)
Fetch the desired HTTP page given inRequest
.@NotNull Future<Response>
Fetcher. fetch(@NotNull Request request, @NotNull Callback callback)
Fetch the desired HTTP page given inRequest
.Future<Response>
StorageFetcher. fetch(Request request)
Future<Response>
StorageFetcher. fetch(Request request, Callback callback)
-
Uses of Request in ai.preferred.venom.job
Methods in ai.preferred.venom.job that return Request Modifier and Type Method Description @NotNull Request
Job. getRequest()
Get the request of this job.Methods in ai.preferred.venom.job with parameters of type Request Modifier and Type Method Description void
Scheduler. add(@NotNull Request request)
Adds a request to the queue.void
Scheduler. add(@NotNull Request request, @NotNull JobAttribute... jobAttributes)
Adds a request to the queue.void
Scheduler. add(@NotNull Request request, Handler handler, @NotNull JobAttribute... jobAttributes)
Adds a request to the queue.void
Scheduler. add(@NotNull Request r, Handler h, Priority p)
Deprecated.void
Scheduler. add(@NotNull Request r, Handler h, Priority p, Priority pf)
Deprecated.void
Scheduler. add(@NotNull Request r, Priority p)
Deprecated.void
Scheduler. add(@NotNull Request r, Priority p, Priority pf)
Deprecated.void
Scheduler. add(Request request, @NotNull Handler handler)
Adds a request to the queue.Constructors in ai.preferred.venom.job with parameters of type Request Constructor Description Job(@NotNull Request request)
Constructs a basic job.Job(@NotNull Request request, Handler handler)
Constructs a basic job.Job(@NotNull Request request, Handler handler, @NotNull JobAttribute... jobAttributes)
Constructs a basic job.Constructor parameters in ai.preferred.venom.job with type arguments of type Request Constructor Description LazyPriorityJobQueue(Iterator<Request> requests)
Constructs an instance of lazy scheduler without a default handler.LazyPriorityJobQueue(Iterator<Request> requests, Handler handler)
Constructs an instance of lazy scheduler with a default handler.LazyScheduler(Iterator<Request> requests)
Deprecated.Constructs an instance of lazy scheduler without a default handler.LazyScheduler(Iterator<Request> requests, Handler handler)
Deprecated.Constructs an instance of lazy scheduler with a default handler. -
Uses of Request in ai.preferred.venom.request
Subinterfaces of Request in ai.preferred.venom.request Modifier and Type Interface Description interface
Unwrappable
This interface represents that the request can be unwrapped.Classes in ai.preferred.venom.request that implement Request Modifier and Type Class Description class
CrawlerRequest
This class allows the removal of proxy from request.class
HttpFetcherRequest
class
StorageFetcherRequest
class
VRequest
An implementation of HTTP request.Methods in ai.preferred.venom.request that return Request Modifier and Type Method Description Request
CrawlerRequest. getInner()
Request
HttpFetcherRequest. getInner()
Request
StorageFetcherRequest. getInner()
@NotNull Request
Unwrappable. getInner()
Returns the unwrapped version of this request.static @NotNull Request
Unwrappable. unwrapRequest(@NotNull Request request)
Unwrap all wrapped request to an instance of base request.Methods in ai.preferred.venom.request with parameters of type Request Modifier and Type Method Description static @NotNull Request
Unwrappable. unwrapRequest(@NotNull Request request)
Unwrap all wrapped request to an instance of base request.Constructors in ai.preferred.venom.request with parameters of type Request Constructor Description CrawlerRequest(Request request)
Constructs an instance of crawler request with an underlying request.HttpFetcherRequest(Request innerRequest)
Constructs an instance of http fetcher request.StorageFetcherRequest(Request innerRequest)
Constructs an instance of StorageFetcherRequest. -
Uses of Request in ai.preferred.venom.storage
Methods in ai.preferred.venom.storage with parameters of type Request Modifier and Type Method Description void
FileManagerCallback. cancelled(Request request)
void
MysqlFileManager.CompletedThreadedCallback. cancelled(@NotNull Request request)
void
FileManagerCallback. completed(Request request, Response response)
void
MysqlFileManager.CompletedThreadedCallback. completed(@NotNull Request request, @NotNull Response response)
void
FileManagerCallback. failed(Request request, Exception ex)
void
MysqlFileManager.CompletedThreadedCallback. failed(@NotNull Request request, @NotNull Exception ex)
Record
DummyFileManager. get(Request request)
@NotNull Record
FileManager. get(@NotNull Request request)
Returns latest record matching request.Record<Integer>
MysqlFileManager. get(Request request)
String
DummyFileManager. put(Request request, Response response)
@NotNull String
FileManager. put(@NotNull Request request, @NotNull Response response)
Puts record into database.String
MysqlFileManager. put(Request request, Response response)
-
Uses of Request in ai.preferred.venom.utils
Methods in ai.preferred.venom.utils with parameters of type Request Modifier and Type Method Description static String
UrlUtil. getBaseUrl(Request request)
Get base url from a request. -
Uses of Request in ai.preferred.venom.validator
Methods in ai.preferred.venom.validator with parameters of type Request Modifier and Type Method Description Validator.Status
EmptyContentValidator. isValid(Request request, Response response)
Validator.Status
MimeTypeValidator. isValid(Request request, Response response)
Validator.Status
PipelineValidator. isValid(Request request, Response response)
Validator.Status
StatusOkValidator. isValid(Request request, Response response)
Validator.Status
Validator. isValid(@NotNull Request request, @NotNull Response response)
Method will be called when a response need validation.
-