Data

functions

DataAccessor

access

DataEnrichRoot

dataspecs

DataLoad

functions

DataLoadBase

dataloads

DataLoadCompanion

dataloads

DataLoader

dataspecs

DataSpec

dataspecs

DateTimeFormatter

CdxRecord

DefaultChartset

HttpResponse

DefaultField

enrich

DefaultFieldAccess

enrich

DefaultProps

EntitiesConstants

DefaultRetryDelay

HdfsFileSpec

DefaultTagFieldMapping

EntitiesConstants

DependentEnrichFunc

enrich

DependentEnrichFuncWithDefaultField

enrich

Derivatives

enrich

DistributedConfig

archivespark

dataPath

HadoopDataLoader TextDataLoader TextFileDataLoader CdxHdfsSpec CdxHdfsWaybackSpec WarcCdxHdfsSpec

dataloads

enrich

dataspecs

archivespark

de

root

decompress

HdfsFileAccessor

defaultCreate

SparkIO

defaultEnrichFunction

DataLoadBase WarcRecord WaybackRecord

defaultField

DefaultFieldAccess MultiPipedDependentEnrichFuncWithDefaultField MultiPipedEnrichFuncWithDefaultField PipedDependentEnrichFuncWithDefaultField PipedEnrichFuncWithDefaultField SingleField HttpPayload WarcPayload

defaultHeaders

HttpClient

dependency

BasicDependentEnrichFunc BasicEnrichFunc BasicMultiValDependentEnrichFunc BasicMultiValEnrichFunc BoundEnrichFunc BoundEnrichFuncWithDefaultField DependentEnrichFunc IdentityEnrichFunction MultiPipedDependentEnrichFuncWithDefaultField PipedDependentEnrichFunc PipedDependentEnrichFuncWithDefaultField

dependencyField

BasicDependentEnrichFunc BasicEnrichFunc BasicMultiValDependentEnrichFunc BasicMultiValEnrichFunc BoundEnrichFunc BoundEnrichFuncWithDefaultField DependentEnrichFunc IdentityEnrichFunction MultiPipedDependentEnrichFuncWithDefaultField PipedDependentEnrichFunc PipedDependentEnrichFuncWithDefaultField

derive

BasicDependentEnrichFunc BasicEnrichFunc BasicMultiValDependentEnrichFunc BasicMultiValEnrichFunc EnrichFunc IdentityEnrichFunction PipedDependentEnrichFunc PipedEnrichFunc RootEnrichFunc Entities HtmlAttribute HtmlTag HtmlTags Json Root Values

deriveRoot

RootEnrichFunc Data DataLoad GroupAggregation HttpPayload WarcPayload

digest

CdxRecord

distinctByValue

GenericHelpersRDD

distinctValue

EnrichableRDD