FeatureCorrelationDetection

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def buildFeaturePairs(): Array[FieldPairs]

   

   Create the left/right testing pairs to be used in determining correlation between feature fields

   Create the left/right testing pairs to be used in determining correlation between feature fields

   returns

   Array of distinct pairs of feature fields to test

   Since

   0.6.2

6. def calculateFeatureCorrelation: Array[FieldCorrelationPayload]

   

   Method for calculating all of the pairwise correlation calculations for the feature fields

   Method for calculating all of the pairwise correlation calculations for the feature fields

   returns

   Array of FieldCorrelationPayload data (left/right name pairs and the correlation value)

   Since

   0.6.2

7. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

8. def determineFieldsToDrop: FieldRemovalPayload

   

   Method for determining which columns need to be dropped from the feature set based on the correlation cutoff settings

   Method for determining which columns need to be dropped from the feature set based on the correlation cutoff settings

   returns

   FieldRemovalPayload that contains the removal and retain fields.

   Annotations

   @throws( classOf[RuntimeException] )

   Since

   0.6.2

   Exceptions thrown

   FeatureCorrelationException: totalFields, removedFields

9. final def eq(arg0: AnyRef): Boolean

   

   Definition Classes

   AnyRef

10. def equals(arg0: Any): Boolean

    

    Definition Classes

    AnyRef → Any

11. def filterFeatureCorrelation(): DataFrame

    

12. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

13. def generateFeatureCorrelationReport: DataFrame

    

    Debug method to allow for an inspection of the correlation between each feature value to one another

    Debug method to allow for an inspection of the correlation between each feature value to one another

    returns

    DataFrame that contains the pair information and the correlation values of those pairs

    Since

    0.6.2

14. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

15. def getCorrelationCutoffHigh: Double

    

16. def getCorrelationCutoffLow: Double

    

17. def getLabelCol: String

    

18. def getParallelism: Int

    

19. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

20. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

21. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

22. final def notify(): Unit

    

    Definition Classes

    AnyRef

23. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

24. lazy val sc: SparkContext

    

    Definition Classes

    SparkSessionWrapper

25. def setCorrelationCutoffHigh(value: Double): FeatureCorrelationDetection.this.type

    

26. def setCorrelationCutoffLow(value: Double): FeatureCorrelationDetection.this.type

    

27. def setLabelCol(value: String): FeatureCorrelationDetection.this.type

    

28. def setParallelism(value: Int): FeatureCorrelationDetection.this.type

    

29. lazy val spark: SparkSession

    

    Definition Classes

    SparkSessionWrapper

30. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

31. def toString(): String

    

    Definition Classes

    AnyRef → Any

32. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

33. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

34. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )