public interface CoreAttributeConstants
Modifier and Type | Field and Description |
---|---|
static String |
A_ANNOTATIONS
shorthand string tokens indicating notable occurrences,
separated by commas
|
static String |
A_CONTENT_TYPE
Extracted MIME type of fetched content; should be
set immediately by fetching module if possible
(rather than waiting for a later analyzer)
|
static String |
A_CREDENTIALS_KEY
Key to get credential avatars from A_LIST.
|
static String |
A_DELAY_FACTOR
Multiplier of last fetch duration to wait before
fetching another item of the same class (eg host)
|
static String |
A_DISTANCE_FROM_SEED |
static String |
A_DNS_FETCH_TIME |
static String |
A_DNS_SERVER_IP_LABEL |
static String |
A_FETCH_BEGAN_TIME |
static String |
A_FETCH_COMPLETED_TIME |
static String |
A_FORCE_RETIRE
flag indicating the containing queue should be retired
|
static String |
A_FTP_CONTROL_CONVERSATION |
static String |
A_FTP_FETCH_STATUS |
static String |
A_HERITABLE_KEYS
Key to (optional) attribute specifying a list of keys that
are passed to CandidateURIs that 'descend' (are discovered
via) this URI.
|
static String |
A_HTML_BASE |
static String |
A_HTTP_AUTH_CHALLENGES |
static String |
A_HTTP_PROXY_HOST
local override of proxy host
|
static String |
A_HTTP_PROXY_PORT
local override of proxy port
|
static String |
A_HTTP_RESPONSE_HEADERS |
static String |
A_MINIMUM_DELAY
Minimum delay before fetching another item of th
same class (eg host).
|
static String |
A_MIRROR_PATH
Define for org.archive.crawler.writer.MirrorWriterProcessor.
|
static String |
A_NONFATAL_ERRORS |
static String |
A_PRECALC_PRECEDENCE
key to attribute containing pre-calculated precedence
|
static String |
A_PREREQUISITE_URI |
static String |
A_RETRY_DELAY |
static String |
A_RRECORD_SET_LABEL |
static String |
A_RUNTIME_EXCEPTION |
static String |
A_SOURCE_TAG
a 'source' (usu.
|
static String |
A_SUBMIT_DATA |
static String |
A_SUBMIT_ENCTYPE |
static String |
A_WARC_RESPONSE_HEADERS |
static String |
A_WARC_STATS |
static String |
A_WHOIS_SERVER_IP |
static String |
HEADER_TRUNC |
static String |
LENGTH_TRUNC |
static String |
TIMER_TRUNC |
static String |
TRUNC_SUFFIX
Fetch truncation codes present in
CrawlURI annotations. |
static final String A_CONTENT_TYPE
static final String A_DELAY_FACTOR
static final String A_MINIMUM_DELAY
static final String A_RRECORD_SET_LABEL
static final String A_DNS_FETCH_TIME
static final String A_DNS_SERVER_IP_LABEL
static final String A_FETCH_BEGAN_TIME
static final String A_FETCH_COMPLETED_TIME
static final String A_RUNTIME_EXCEPTION
static final String A_NONFATAL_ERRORS
static final String A_ANNOTATIONS
static final String A_PREREQUISITE_URI
static final String A_DISTANCE_FROM_SEED
static final String A_HTML_BASE
static final String A_RETRY_DELAY
static final String A_MIRROR_PATH
static final String A_CREDENTIALS_KEY
static final String A_SOURCE_TAG
static final String A_HERITABLE_KEYS
static final String A_FORCE_RETIRE
static final String A_PRECALC_PRECEDENCE
static final String A_HTTP_PROXY_HOST
static final String A_HTTP_PROXY_PORT
static final String TRUNC_SUFFIX
CrawlURI
annotations.
All truncation annotations have a TRUNC_SUFFIX
suffix (TODO:
Make for-sure unique or redo truncation so definitive flag marked
against CrawlURI
).static final String HEADER_TRUNC
static final String TIMER_TRUNC
static final String LENGTH_TRUNC
static final String A_FTP_CONTROL_CONVERSATION
static final String A_FTP_FETCH_STATUS
static final String A_WHOIS_SERVER_IP
static final String A_HTTP_RESPONSE_HEADERS
static final String A_HTTP_AUTH_CHALLENGES
static final String A_SUBMIT_DATA
static final String A_SUBMIT_ENCTYPE
static final String A_WARC_RESPONSE_HEADERS
static final String A_WARC_STATS
Copyright © 2003–2019 Internet Archive. All rights reserved.