Package ai.preferred.venom.request
Class CrawlerRequest
- java.lang.Object
-
- ai.preferred.venom.request.CrawlerRequest
-
- All Implemented Interfaces:
Request
,Unwrappable
public class CrawlerRequest extends Object implements Request, Unwrappable
This class allows the removal of proxy from request.- Author:
- Maksim Tkachenko, Ween Jiann Lee
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from interface ai.preferred.venom.request.Request
Request.Method
-
-
Constructor Summary
Constructors Constructor Description CrawlerRequest(Request request)
Constructs an instance of crawler request with an underlying request.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description String
getBody()
Returns the request body of the request or null if none specified.Map<String,String>
getHeaders()
Returns the headers set for the request.Request
getInner()
Returns the unwrapped version of this request.Request.Method
getMethod()
Returns the method type of the request.org.apache.http.HttpHost
getProxy()
Returns the proxy set to be used for the request or default to fetcher if none specified.SleepScheduler
getSleepScheduler()
Returns information about the amount of sleep before this request is made.String
getUrl()
Returns the url of the request.void
removeProxy()
Remove the proxy from this request.
-
-
-
Constructor Detail
-
CrawlerRequest
public CrawlerRequest(Request request)
Constructs an instance of crawler request with an underlying request.- Parameters:
request
- An instance of the underlying request
-
-
Method Detail
-
getMethod
public final Request.Method getMethod()
Description copied from interface:Request
Returns the method type of the request.
-
getBody
public final String getBody()
Description copied from interface:Request
Returns the request body of the request or null if none specified.
-
getUrl
public final String getUrl()
Description copied from interface:Request
Returns the url of the request.
-
getHeaders
public final Map<String,String> getHeaders()
Description copied from interface:Request
Returns the headers set for the request.- Specified by:
getHeaders
in interfaceRequest
- Returns:
- a map of the headers set
-
getProxy
public final org.apache.http.HttpHost getProxy()
Description copied from interface:Request
Returns the proxy set to be used for the request or default to fetcher if none specified.
-
removeProxy
public final void removeProxy()
Remove the proxy from this request.
-
getSleepScheduler
public final SleepScheduler getSleepScheduler()
Description copied from interface:Request
Returns information about the amount of sleep before this request is made.- Specified by:
getSleepScheduler
in interfaceRequest
- Returns:
- an instance of SleepScheduler
-
getInner
public final Request getInner()
Description copied from interface:Unwrappable
Returns the unwrapped version of this request.- Specified by:
getInner
in interfaceUnwrappable
- Returns:
- an instance of request
-
-