OpVectorColumnHistory

Full history for each column element in a vector

columnName: name for feature in column
parentFeatureName: name of immediate parent feature that was used to create the vector
parentFeatureOrigins: names of raw features that went into the parent feature
parentFeatureStages: stageNames of all stages applied to the parent feature before conversion to a vector
parentFeatureType: type of the parent feature
grouping: The name of the group a column belongs to (usually the parent feature, but in the case of TextMapVectorizer, this includes keys in maps too). Every other vector column in the same vector that has this same indicator group should be mutually exclusive to this one. If this is not an indicator, then this field is None
indicatorValue: A name for a binary indicator value (null indicator or result of a pivot or whatever that value is), otherwise None
descriptorValue: A name for a value that is continuous (not a binary indicator) eg for geolocation (lat, lon, accuracy) or for dates that have been converted to a circular representation the time window and x or y coordinate, otherwise None
index: the index of the vector column this information is tied to

Linear Supertypes

Product, Equals, JsonLike, Serializable, Serializable, AnyRef, Any

Instance Constructors

new OpVectorColumnHistory(columnName: String, parentFeatureName: Seq[String], parentFeatureOrigins: Seq[String], parentFeatureStages: Seq[String], parentFeatureType: Seq[String], grouping: Option[String], indicatorValue: Option[String], descriptorValue: Option[String], index: Int)

columnName
name for feature in column
parentFeatureName
name of immediate parent feature that was used to create the vector
parentFeatureOrigins
names of raw features that went into the parent feature
parentFeatureStages
stageNames of all stages applied to the parent feature before conversion to a vector
parentFeatureType
type of the parent feature
grouping
The name of the group a column belongs to (usually the parent feature, but in the case of TextMapVectorizer, this includes keys in maps too). Every other vector column in the same vector that has this same indicator group should be mutually exclusive to this one. If this is not an indicator, then this field is None
indicatorValue
A name for a binary indicator value (null indicator or result of a pivot or whatever that value is), otherwise None
descriptorValue
A name for a value that is continuous (not a binary indicator) eg for geolocation (lat, lon, accuracy) or for dates that have been converted to a circular representation the time window and x or y coordinate, otherwise None
index
the index of the vector column this information is tied to

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0

Definition Classes
Any
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
val columnName: String

name for feature in column
val descriptorValue: Option[String]

A name for a value that is continuous (not a binary indicator) eg for geolocation (lat, lon, accuracy) or for dates that have been converted to a circular representation the time window and x or y coordinate, otherwise None
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
val grouping: Option[String]

The name of the group a column belongs to (usually the parent feature, but in the case of TextMapVectorizer, this includes keys in maps too).
The name of the group a column belongs to (usually the parent feature, but in the case of TextMapVectorizer, this includes keys in maps too). Every other vector column in the same vector that has this same indicator group should be mutually exclusive to this one. If this is not an indicator, then this field is None
val index: Int

the index of the vector column this information is tied to
val indicatorValue: Option[String]

A name for a binary indicator value (null indicator or result of a pivot or whatever that value is), otherwise None
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
val parentFeatureName: Seq[String]

name of immediate parent feature that was used to create the vector
val parentFeatureOrigins: Seq[String]

names of raw features that went into the parent feature
val parentFeatureStages: Seq[String]

stageNames of all stages applied to the parent feature before conversion to a vector
val parentFeatureType: Seq[String]

type of the parent feature
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def toJson(pretty: Boolean): String

Definition Classes
JsonLike
def toString(): String

Definition Classes
JsonLike → AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Docs: object OpVectorColumnHistory | package spark

Instance Constructors

new OpVectorColumnHistory(columnName: String, parentFeatureName: Seq[String], parentFeatureOrigins: Seq[String], parentFeatureStages: Seq[String], parentFeatureType: Seq[String], grouping: Option[String], indicatorValue: Option[String], descriptorValue: Option[String], index: Int)

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

def clone(): AnyRef

val columnName: String

val descriptorValue: Option[String]

final def eq(arg0: AnyRef): Boolean

def finalize(): Unit

final def getClass(): Class[_]

val grouping: Option[String]

val index: Int

val indicatorValue: Option[String]

final def isInstanceOf[T0]: Boolean

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

val parentFeatureName: Seq[String]

val parentFeatureOrigins: Seq[String]

val parentFeatureStages: Seq[String]

val parentFeatureType: Seq[String]

final def synchronized[T0](arg0: ⇒ T0): T0

def toJson(pretty: Boolean): String

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Product

Inherited from Equals

Inherited from JsonLike

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped