Package | Description |
---|---|
org.datavec.api.transform.ops | |
org.datavec.api.transform.reduce | |
org.datavec.api.transform.reduce.impl |
Modifier and Type | Class and Description |
---|---|
class |
AggregableCheckingOp<T>
A variant of
IAggregableReduceOp exercised on a Writable that takes schema metadata
in its constructor, and checks the input Writable against the schema before accepting it. |
class |
AggregableMultiOp<T>
This class transforms a list of
IAggregableReduceOp on one single field, each returning a Writable
and transforms it into an operation on that single column, that returns a Writable list. |
static class |
AggregatorImpls.AggregableCount<T> |
static class |
AggregatorImpls.AggregableCountUnique<T>
This distinct count is based on streamlib's implementation of "HyperLogLog in Practice:
Algorithmic Engineering of a State of The Art Cardinality Estimation Algorithm", available
here.
|
static class |
AggregatorImpls.AggregableFirst<T> |
static class |
AggregatorImpls.AggregableLast<T> |
static class |
AggregatorImpls.AggregableMax<T extends Number & Comparable<T>> |
static class |
AggregatorImpls.AggregableMean<T extends Number> |
static class |
AggregatorImpls.AggregableMin<T extends Number & Comparable<T>> |
static class |
AggregatorImpls.AggregablePopulationVariance<T extends Number>
This class offers an aggregable reduce operation for the population variance, i.e.
|
static class |
AggregatorImpls.AggregableProd<T extends Number> |
static class |
AggregatorImpls.AggregableRange<T extends Number & Comparable<T>> |
static class |
AggregatorImpls.AggregableStdDev<T extends Number>
This class offers an aggregable reduce operation for the unbiased standard deviation, i.e.
|
static class |
AggregatorImpls.AggregableSum<T extends Number> |
static class |
AggregatorImpls.AggregableUncorrectedStdDev<T extends Number>
This class offers an aggregable reduce operation for the biased standard deviation, i.e.
|
static class |
AggregatorImpls.AggregableVariance<T extends Number>
This class offers an aggregable reduce operation for the unbiased variance, i.e.
|
class |
ByteWritableOp<T>
This class converts an
IAggregableReduceOp operating on a Byte to one operating
on Writable instances. |
class |
DispatchOp<T,U>
This class takes many
IAggregableReduceOp , each acting on one field, and each returning several
Writable elements, in the form of a list of Writable . |
class |
DispatchWithConditionOp<U>
A variant of
DispatchOp that for each operation, tests the input list of elements for a Condition ,
before dispatching the appropriate column of this element to its operation. |
class |
DoubleWritableOp<T>
This class converts an
IAggregableReduceOp operating on a Double to one operating
on Writable instances. |
class |
FloatWritableOp<T>
This class converts an
IAggregableReduceOp operating on a Float to one operating
on Writable instances. |
class |
IntWritableOp<T>
This class converts an
IAggregableReduceOp operating on a Integer to one operating
on Writable instances. |
class |
LongWritableOp<T>
This class converts an
IAggregableReduceOp operating on a Long to one operating
on Writable instances. |
static class |
StringAggregatorImpls.AggregableStringAppend |
static class |
StringAggregatorImpls.AggregableStringPrepend |
class |
StringWritableOp<T>
This class converts an
IAggregableReduceOp operating on a String to one operating
on Writable instances. |
Modifier and Type | Method and Description |
---|---|
<U extends IAggregableReduceOp<T,List<Writable>>> |
AggregableMultiOp.combine(U accu) |
<U extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableMean.combine(U acc) |
<U extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableStdDev.combine(U acc) |
<U extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableVariance.combine(U acc) |
<U extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableCountUnique.combine(U acc) |
<W extends IAggregableReduceOp<String,Writable>> |
StringAggregatorImpls.AggregableStringAppend.combine(W accu) |
<W extends IAggregableReduceOp<String,Writable>> |
StringAggregatorImpls.AggregableStringPrepend.combine(W accu) |
<W extends IAggregableReduceOp<List<T>,List<U>>> |
DispatchOp.combine(W accu) |
<W extends IAggregableReduceOp<Writable,T>> |
StringWritableOp.combine(W accu) |
<W extends IAggregableReduceOp<Writable,T>> |
DoubleWritableOp.combine(W accu) |
<W extends IAggregableReduceOp<Writable,T>> |
IntWritableOp.combine(W accu) |
<W extends IAggregableReduceOp<Writable,T>> |
FloatWritableOp.combine(W accu) |
<W extends IAggregableReduceOp<Writable,T>> |
AggregableCheckingOp.combine(W accu) |
<W extends IAggregableReduceOp<Writable,T>> |
ByteWritableOp.combine(W accu) |
<W extends IAggregableReduceOp<Writable,T>> |
LongWritableOp.combine(W accu) |
<W extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableFirst.combine(W accu) |
<W extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableLast.combine(W accu) |
<W extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableSum.combine(W accu) |
<W extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableProd.combine(W accu) |
<W extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableMax.combine(W accu) |
<W extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableMin.combine(W accu) |
<W extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableRange.combine(W accu) |
<W extends IAggregableReduceOp<T,Writable>> |
AggregatorImpls.AggregableCount.combine(W accu) |
<W extends IAggregableReduceOp<T,V>> |
IAggregableReduceOp.combine(W accu) |
Constructor and Description |
---|
DispatchWithConditionOp(List<IAggregableReduceOp<Writable,List<U>>> ops,
List<Condition> conds) |
Modifier and Type | Method and Description |
---|---|
IAggregableReduceOp<List<Writable>,List<Writable>> |
Reducer.aggregableReducer() |
IAggregableReduceOp<List<Writable>,List<Writable>> |
IAssociativeReducer.aggregableReducer()
An aggregation that has the property that
reduce(List(reduce(List(l1, l2)), l3)) = reduce(List(l1, reduce(List(l2, l3)))
|
static IAggregableReduceOp<Writable,List<Writable>> |
AggregableReductionUtils.reduceBytesColumn(List<ReduceOp> lop,
boolean ignoreInvalid,
ColumnMetaData metaData) |
static IAggregableReduceOp<Writable,List<Writable>> |
AggregableReductionUtils.reduceColumn(List<ReduceOp> op,
ColumnType type,
boolean ignoreInvalid,
ColumnMetaData metaData) |
static IAggregableReduceOp<Writable,List<Writable>> |
AggregableReductionUtils.reduceDoubleColumn(List<ReduceOp> lop,
boolean ignoreInvalid,
ColumnMetaData metaData) |
static IAggregableReduceOp<Writable,List<Writable>> |
AggregableReductionUtils.reduceFloatColumn(List<ReduceOp> lop,
boolean ignoreInvalid,
ColumnMetaData metaData) |
static IAggregableReduceOp<Writable,List<Writable>> |
AggregableReductionUtils.reduceIntColumn(List<ReduceOp> lop,
boolean ignoreInvalid,
ColumnMetaData metaData) |
static IAggregableReduceOp<Writable,List<Writable>> |
AggregableReductionUtils.reduceLongColumn(List<ReduceOp> lop,
boolean ignoreInvalid,
ColumnMetaData metaData) |
IAggregableReduceOp<Writable,List<Writable>> |
AggregableColumnReduction.reduceOp()
Reduce a single column.
|
static IAggregableReduceOp<Writable,List<Writable>> |
AggregableReductionUtils.reduceStringOrCategoricalColumn(List<ReduceOp> lop,
boolean ignoreInvalid,
ColumnMetaData metaData) |
static IAggregableReduceOp<Writable,List<Writable>> |
AggregableReductionUtils.reduceTimeColumn(List<ReduceOp> lop,
boolean ignoreInvalid,
ColumnMetaData metaData) |
Modifier and Type | Class and Description |
---|---|
static class |
GeographicMidpointReduction.AverageCoordinateReduceOp |
Modifier and Type | Method and Description |
---|---|
<W extends IAggregableReduceOp<Writable,List<Writable>>> |
GeographicMidpointReduction.AverageCoordinateReduceOp.combine(W accu) |
Modifier and Type | Method and Description |
---|---|
IAggregableReduceOp<Writable,List<Writable>> |
GeographicMidpointReduction.reduceOp() |
Copyright © 2019. All rights reserved.