Package | Description |
---|---|
org.datavec.api.transform |
Modifier and Type | Method and Description |
---|---|
TransformProcess.Builder |
TransformProcess.Builder.calculateSortedRank(String newColumnName,
String sortOnColumn,
WritableComparator comparator)
CalculateSortedRank: calculate the rank of each example, after sorting example.
|
TransformProcess.Builder |
TransformProcess.Builder.calculateSortedRank(String newColumnName,
String sortOnColumn,
WritableComparator comparator,
boolean ascending)
CalculateSortedRank: calculate the rank of each example, after sorting example.
|
TransformProcess.Builder |
TransformProcess.Builder.categoricalToInteger(String... columnNames)
Convert the specified column(s) from a categorical representation to an integer representation.
|
TransformProcess.Builder |
TransformProcess.Builder.categoricalToOneHot(String... columnNames)
Convert the specified column(s) from a categorical representation to a one-hot representation.
|
TransformProcess.Builder |
TransformProcess.Builder.conditionalCopyValueTransform(String columnToReplace,
String sourceColumn,
Condition condition)
Replace the value in a specified column with a new value taken from another column, if a condition is satisfied/true.
Note that the condition can be any generic condition, including on other column(s), different to the column that will be modified if the condition is satisfied/true. |
TransformProcess.Builder |
TransformProcess.Builder.conditionalReplaceValueTransform(String column,
Writable newValue,
Condition condition)
Replace the values in a specified column with a specified new value, if some condition holds.
|
TransformProcess.Builder |
TransformProcess.Builder.convertFromSequence()
Convert a sequence to a set of individual values (by treating each value in each sequence as a separate example)
|
TransformProcess.Builder |
TransformProcess.Builder.convertToSequence(String keyColumn,
SequenceComparator comparator)
Convert a set of independent records/examples into a sequence, according to some key.
|
TransformProcess.Builder |
TransformProcess.Builder.doubleColumnsMathOp(String newColumnName,
MathOp mathOp,
String... columnNames)
Calculate and add a new double column by performing a mathematical operation on a number of existing columns.
|
TransformProcess.Builder |
TransformProcess.Builder.doubleMathOp(String columnName,
MathOp mathOp,
double scalar)
Perform a mathematical operation (add, subtract, scalar max etc) on the specified double column, with a scalar
|
TransformProcess.Builder |
TransformProcess.Builder.duplicateColumn(String column,
String newName)
Duplicate a single column
|
TransformProcess.Builder |
TransformProcess.Builder.duplicateColumns(List<String> columnNames,
List<String> newNames)
Duplicate a set of columns
|
TransformProcess.Builder |
TransformProcess.Builder.filter(Filter filter)
Add a filter operation to be executed after the previously-added operations have been executed
|
TransformProcess.Builder |
TransformProcess.Builder.integerColumnsMathOp(String newColumnName,
MathOp mathOp,
String... columnNames)
Calculate and add a new integer column by performing a mathematical operation on a number of existing columns.
|
TransformProcess.Builder |
TransformProcess.Builder.integerMathOp(String column,
MathOp mathOp,
int scalar)
Perform a mathematical operation (add, subtract, scalar max etc) on the specified integer column, with a scalar
|
TransformProcess.Builder |
TransformProcess.Builder.integerToCategorical(String columnName,
List<String> categoryStateNames)
Convert the specified column from an integer representation (assume values 0 to numCategories-1) to
a categorical representation, given the specified state names
|
TransformProcess.Builder |
TransformProcess.Builder.integerToCategorical(String columnName,
Map<Integer,String> categoryIndexNameMap)
Convert the specified column from an integer representation to a categorical representation, given the specified
mapping between integer indexes and state names
|
TransformProcess.Builder |
TransformProcess.Builder.longColumnsMathOp(String newColumnName,
MathOp mathOp,
String... columnNames)
Calculate and add a new long column by performing a mathematical operation on a number of existing columns.
|
TransformProcess.Builder |
TransformProcess.Builder.longMathOp(String columnName,
MathOp mathOp,
long scalar)
Perform a mathematical operation (add, subtract, scalar max etc) on the specified long column, with a scalar
|
TransformProcess.Builder |
TransformProcess.Builder.normalize(String column,
Normalize type,
DataAnalysis da)
Normalize the specified column with a given type of normalization
|
TransformProcess.Builder |
TransformProcess.Builder.reduce(IReducer reducer)
Reduce (i.e., aggregate/combine) a set of examples (typically by key).
|
TransformProcess.Builder |
TransformProcess.Builder.reduceSequenceByWindow(IReducer reducer,
WindowFunction windowFunction)
Reduce (i.e., aggregate/combine) a set of sequence examples - for each sequence individually - using a window function.
|
TransformProcess.Builder |
TransformProcess.Builder.removeAllColumnsExceptFor(Collection<String> columnNames)
Remove all columns, except for those that are specified here
|
TransformProcess.Builder |
TransformProcess.Builder.removeAllColumnsExceptFor(String... columnNames)
Remove all columns, except for those that are specified here
|
TransformProcess.Builder |
TransformProcess.Builder.removeColumns(Collection<String> columnNames)
Remove all of the specified columns, by name
|
TransformProcess.Builder |
TransformProcess.Builder.removeColumns(String... columnNames)
Remove all of the specified columns, by name
|
TransformProcess.Builder |
TransformProcess.Builder.renameColumn(String oldName,
String newName)
Rename a single column
|
TransformProcess.Builder |
TransformProcess.Builder.renameColumns(List<String> oldNames,
List<String> newNames)
Rename multiple columns
|
TransformProcess.Builder |
TransformProcess.Builder.reorderColumns(String... newOrder)
Reorder the columns using a partial or complete new ordering.
|
TransformProcess.Builder |
TransformProcess.Builder.splitSequence(SequenceSplit split)
Split sequences into 1 or more other sequences.
|
TransformProcess.Builder |
TransformProcess.Builder.stringMapTransform(String columnName,
Map<String,String> mapping)
Replace one or more String values in the specified column with new values.
|
TransformProcess.Builder |
TransformProcess.Builder.stringRemoveWhitespaceTransform(String columnName)
Remove all whitespace characters from the values in the specified String column
|
TransformProcess.Builder |
TransformProcess.Builder.stringToCategorical(String columnName,
List<String> stateNames)
Convert the specified String column to a categorical column.
|
TransformProcess.Builder |
TransformProcess.Builder.stringToTimeTransform(String column,
String format,
org.joda.time.DateTimeZone dateTimeZone)
Convert a String column (containing a date/time String) to a time column (by parsing the date/time String)
|
TransformProcess.Builder |
TransformProcess.Builder.timeMathOp(String columnName,
MathOp mathOp,
long timeQuantity,
TimeUnit timeUnit)
Perform a mathematical operation (add, subtract, scalar min/max only) on the specified time column
|
TransformProcess.Builder |
TransformProcess.Builder.transform(Transform transform)
Add a transformation to be executed after the previously-added operations have been executed
|
Copyright © 2016. All rights reserved.