Modifier and Type | Method and Description |
---|---|
RecordReader |
BaseInputFormat.createReader(InputSplit split) |
RecordReader |
InputFormat.createReader(InputSplit split)
Creates a reader from an input split
|
RecordReader |
InputFormat.createReader(InputSplit split,
Configuration conf)
Creates a reader from an input split
|
Modifier and Type | Method and Description |
---|---|
RecordReader |
ListStringInputFormat.createReader(InputSplit split)
Creates a reader from an input split
|
RecordReader |
MatlabInputFormat.createReader(InputSplit split) |
RecordReader |
CSVInputFormat.createReader(InputSplit split) |
RecordReader |
LineInputFormat.createReader(InputSplit split) |
RecordReader |
SVMLightInputFormat.createReader(InputSplit split) |
RecordReader |
ListStringInputFormat.createReader(InputSplit split,
Configuration conf)
Creates a reader from an input split
|
RecordReader |
MatlabInputFormat.createReader(InputSplit split,
Configuration conf) |
RecordReader |
LibSvmInputFormat.createReader(InputSplit split,
Configuration conf) |
RecordReader |
CSVInputFormat.createReader(InputSplit split,
Configuration conf) |
RecordReader |
LineInputFormat.createReader(InputSplit split,
Configuration conf) |
RecordReader |
SVMLightInputFormat.createReader(InputSplit split,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
RecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
RecordReader.initialize(InputSplit split)
Called once at initialization.
|
Modifier and Type | Field and Description |
---|---|
protected InputSplit |
LineRecordReader.inputSplit |
protected InputSplit |
FileRecordReader.inputSplit |
Modifier and Type | Method and Description |
---|---|
protected void |
FileRecordReader.doInitialize(InputSplit split) |
void |
LineRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
ComposableRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
ConcatenatingRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
FileRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
LineRecordReader.initialize(InputSplit split) |
void |
ComposableRecordReader.initialize(InputSplit split) |
void |
ConcatenatingRecordReader.initialize(InputSplit split) |
void |
FileRecordReader.initialize(InputSplit split) |
Modifier and Type | Method and Description |
---|---|
void |
CollectionSequenceRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
CollectionRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
ListStringRecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
CollectionSequenceRecordReader.initialize(InputSplit split) |
void |
CollectionRecordReader.initialize(InputSplit split) |
void |
ListStringRecordReader.initialize(InputSplit split)
Called once at initialization.
|
Modifier and Type | Method and Description |
---|---|
void |
CSVRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
CSVVariableSlidingWindowRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
CSVNLinesSequenceRecordReader.initialize(Configuration conf,
InputSplit split) |
Modifier and Type | Method and Description |
---|---|
void |
InMemoryRecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
InMemorySequenceRecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
InMemoryRecordReader.initialize(InputSplit split)
Called once at initialization.
|
void |
InMemorySequenceRecordReader.initialize(InputSplit split)
Called once at initialization.
|
Modifier and Type | Method and Description |
---|---|
void |
JacksonRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
JacksonRecordReader.initialize(InputSplit split) |
Modifier and Type | Method and Description |
---|---|
void |
SVMLightRecordReader.initialize(Configuration conf,
InputSplit split)
Must be called before attempting to read records.
|
Modifier and Type | Method and Description |
---|---|
void |
RegexSequenceRecordReader.initialize(Configuration conf,
InputSplit split) |
void |
RegexLineRecordReader.initialize(Configuration conf,
InputSplit split) |
Modifier and Type | Method and Description |
---|---|
void |
TransformProcessRecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
TransformProcessSequenceRecordReader.initialize(Configuration conf,
InputSplit split)
Called once at initialization.
|
void |
TransformProcessRecordReader.initialize(InputSplit split)
Called once at initialization.
|
void |
TransformProcessSequenceRecordReader.initialize(InputSplit split)
Called once at initialization.
|
Modifier and Type | Method and Description |
---|---|
void |
RecordWriter.initialize(Configuration configuration,
InputSplit split,
Partitioner partitioner)
Initialize the record reader with the given configuration
and
InputSplit |
void |
RecordWriter.initialize(InputSplit inputSplit,
Partitioner partitioner)
Initialize a record writer with the given input split
|
Modifier and Type | Method and Description |
---|---|
void |
FileRecordWriter.initialize(Configuration configuration,
InputSplit split,
Partitioner partitioner) |
void |
FileRecordWriter.initialize(InputSplit inputSplit,
Partitioner partitioner) |
Modifier and Type | Class and Description |
---|---|
class |
BaseInputSplit
Base input split
|
class |
CollectionInputSplit
A simple InputSplit based on a collection of URIs
|
class |
FileSplit
File input split.
|
class |
InputStreamInputSplit
Input stream input split.
|
class |
ListStringSplit
An input split that already
has delimited data of some kind.
|
class |
NumberedFileInputSplit
InputSplit for sequences of numbered files.
|
class |
OutputStreamInputSplit
Input stream input split.
|
class |
StringSplit
String split used for single line inputs
|
class |
TransformSplit
InputSplit implementation that maps the URIs of a given BaseInputSplit to new URIs.
|
Modifier and Type | Method and Description |
---|---|
InputSplit[] |
BaseInputSplit.sample(PathFilter pathFilter,
double... weights)
Samples the locations based on the PathFilter and splits the result into
an array of InputSplit objects, with sizes proportional to the weights.
|
Modifier and Type | Method and Description |
---|---|
void |
NumberOfRecordsPartitioner.init(Configuration configuration,
InputSplit split) |
void |
Partitioner.init(Configuration configuration,
InputSplit split)
Initializes this partitioner with the given configuration
and input split
|
void |
NumberOfRecordsPartitioner.init(InputSplit inputSplit) |
void |
Partitioner.init(InputSplit inputSplit)
Initializes this partitioner with the given configuration
and input split
|
Copyright © 2018. All rights reserved.