org.apache.cassandra.hadoop

Class AbstractBulkOutputFormat<K,V>

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<K,V>

org.apache.cassandra.hadoop.AbstractBulkOutputFormat<K,V>

All Implemented Interfaces:

org.apache.hadoop.mapred.OutputFormat<K,V>

Direct Known Subclasses:

BulkOutputFormat, CqlBulkOutputFormat

public abstract class AbstractBulkOutputFormat<K,V>
extends org.apache.hadoop.mapreduce.OutputFormat<K,V>
implements org.apache.hadoop.mapred.OutputFormat<K,V>

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AbstractBulkOutputFormat.NullOutputCommitter

Constructor Summary

Constructors

Constructor and Description
AbstractBulkOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.fs.FileSystem filesystem, org.apache.hadoop.mapred.JobConf job) Deprecated.
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
static java.util.Collection<java.lang.String>	getIgnoreHosts(org.apache.hadoop.conf.Configuration conf) Get the hosts to ignore as a collection of strings
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
static void	setIgnoreHosts(org.apache.hadoop.conf.Configuration conf, java.lang.String... ignoreNodes) Set the hosts to ignore.
static void	setIgnoreHosts(org.apache.hadoop.conf.Configuration conf, java.lang.String ignoreNodesCsv) Set the hosts to ignore as comma delimited values.

Methods inherited from class org.apache.hadoop.mapreduce.OutputFormat

getRecordWriter

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.mapred.OutputFormat

getRecordWriter

Constructor Detail

AbstractBulkOutputFormat

public AbstractBulkOutputFormat()

Method Detail

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)

Specified by:

checkOutputSpecs in class org.apache.hadoop.mapreduce.OutputFormat<K,V>

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                               throws java.io.IOException,
                                                                      java.lang.InterruptedException

Specified by:

getOutputCommitter in class org.apache.hadoop.mapreduce.OutputFormat<K,V>

Throws:

java.io.IOException

java.lang.InterruptedException

checkOutputSpecs

@Deprecated
public void checkOutputSpecs(org.apache.hadoop.fs.FileSystem filesystem,
                                         org.apache.hadoop.mapred.JobConf job)
                                  throws java.io.IOException

Deprecated.

Fills the deprecated OutputFormat interface for streaming.

Specified by:

checkOutputSpecs in interface org.apache.hadoop.mapred.OutputFormat<K,V>

Throws:

java.io.IOException

setIgnoreHosts

public static void setIgnoreHosts(org.apache.hadoop.conf.Configuration conf,
                                  java.lang.String ignoreNodesCsv)

Set the hosts to ignore as comma delimited values. Data will not be bulk loaded onto the ignored nodes.

Parameters:

conf - job configuration

ignoreNodesCsv - a comma delimited list of nodes to ignore

setIgnoreHosts

public static void setIgnoreHosts(org.apache.hadoop.conf.Configuration conf,
                                  java.lang.String... ignoreNodes)

Set the hosts to ignore. Data will not be bulk loaded onto the ignored nodes.

Parameters:

conf - job configuration

ignoreNodes - the nodes to ignore

getIgnoreHosts

public static java.util.Collection<java.lang.String> getIgnoreHosts(org.apache.hadoop.conf.Configuration conf)

Get the hosts to ignore as a collection of strings

Parameters:

conf - job configuration

Returns:

the nodes to ignore as a collection of stirngs