org.elasticsearch.hadoop.mr

Class EsOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat

org.elasticsearch.hadoop.mr.EsOutputFormat

All Implemented Interfaces:

org.apache.hadoop.mapred.OutputFormat

Direct Known Subclasses:

EsHiveOutputFormat

public class EsOutputFormat
extends org.apache.hadoop.mapreduce.OutputFormat
implements org.apache.hadoop.mapred.OutputFormat

ElasticSearch OutputFormat (old and new API) for adding data to an index inside ElasticSearch.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	EsOutputFormat.EsOldAPIOutputCommitter
static class	EsOutputFormat.EsOutputCommitter
protected static class	EsOutputFormat.EsRecordWriter

Constructor Summary

Constructors

Constructor and Description
EsOutputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
void	checkOutputSpecs(FileSystem ignored, org.apache.hadoop.mapred.JobConf cfg)
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
org.apache.hadoop.mapred.RecordWriter	getRecordWriter(FileSystem ignored, org.apache.hadoop.mapred.JobConf job, java.lang.String name, org.apache.hadoop.util.Progressable progress)
org.apache.hadoop.mapreduce.RecordWriter	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EsOutputFormat

public EsOutputFormat()

Method Detail

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)

Specified by:

getRecordWriter in class org.apache.hadoop.mapreduce.OutputFormat

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
                      throws java.io.IOException

Specified by:

checkOutputSpecs in class org.apache.hadoop.mapreduce.OutputFormat

Throws:

java.io.IOException

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)

Specified by:

getOutputCommitter in class org.apache.hadoop.mapreduce.OutputFormat

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter getRecordWriter(FileSystem ignored,
                                                    org.apache.hadoop.mapred.JobConf job,
                                                    java.lang.String name,
                                                    org.apache.hadoop.util.Progressable progress)

Specified by:

getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat

checkOutputSpecs

public void checkOutputSpecs(FileSystem ignored,
                    org.apache.hadoop.mapred.JobConf cfg)
                      throws java.io.IOException

Specified by:

checkOutputSpecs in interface org.apache.hadoop.mapred.OutputFormat

Throws:

java.io.IOException