K
- Type of KeyV
- Type of ValueT
- Record type.@Internal public abstract class HadoopOutputFormatBase<K,V,T> extends HadoopOutputFormatCommonBase<T> implements org.apache.flink.api.common.io.FinalizeOnMaster
限定符和类型 | 字段和说明 |
---|---|
protected static Object |
CLOSE_MUTEX |
protected static Object |
CONFIGURE_MUTEX |
protected org.apache.hadoop.mapred.TaskAttemptContext |
context |
protected org.apache.hadoop.mapred.JobConf |
jobConf |
protected org.apache.hadoop.mapred.OutputFormat<K,V> |
mapredOutputFormat |
protected static Object |
OPEN_MUTEX |
protected org.apache.hadoop.mapred.OutputCommitter |
outputCommitter |
protected org.apache.hadoop.mapred.RecordWriter<K,V> |
recordWriter |
credentials
构造器和说明 |
---|
HadoopOutputFormatBase(org.apache.hadoop.mapred.OutputFormat<K,V> mapredOutputFormat,
org.apache.hadoop.mapred.JobConf job) |
限定符和类型 | 方法和说明 |
---|---|
void |
close()
commit the task by moving the output file out from the temporary directory.
|
void |
configure(org.apache.flink.configuration.Configuration parameters) |
void |
finalizeGlobal(int parallelism) |
org.apache.hadoop.mapred.JobConf |
getJobConf() |
void |
open(int taskNumber,
int numTasks)
create the temporary output file for hadoop RecordWriter.
|
read, write
protected static final Object OPEN_MUTEX
protected static final Object CONFIGURE_MUTEX
protected static final Object CLOSE_MUTEX
protected org.apache.hadoop.mapred.JobConf jobConf
protected transient org.apache.hadoop.mapred.OutputCommitter outputCommitter
protected transient org.apache.hadoop.mapred.TaskAttemptContext context
public org.apache.hadoop.mapred.JobConf getJobConf()
public void configure(org.apache.flink.configuration.Configuration parameters)
configure
在接口中 org.apache.flink.api.common.io.OutputFormat<T>
public void open(int taskNumber, int numTasks) throws IOException
open
在接口中 org.apache.flink.api.common.io.OutputFormat<T>
taskNumber
- The number of the parallel instance.numTasks
- The number of parallel tasks.IOException
public void close() throws IOException
close
在接口中 org.apache.flink.api.common.io.OutputFormat<T>
IOException
public void finalizeGlobal(int parallelism) throws IOException
finalizeGlobal
在接口中 org.apache.flink.api.common.io.FinalizeOnMaster
IOException
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.