Class/Object

com.johnsnowlabs.nlp.annotators.assertion.logreg

AssertionLogRegApproach

Related Docs: object AssertionLogRegApproach | package logreg

Permalink

class AssertionLogRegApproach extends ApproachWithWordEmbeddings[AssertionLogRegApproach, AssertionLogRegModel] with Windowing

Created by jose on 22/11/17.

Linear Supertypes
Windowing, ApproachWithWordEmbeddings[AssertionLogRegApproach, AssertionLogRegModel], AutoCloseable, AnnotatorApproach[AssertionLogRegModel], DefaultParamsWritable, MLWritable, HasAnnotatorType, HasOutputAnnotationCol, HasInputAnnotationCols, Estimator[AssertionLogRegModel], PipelineStage, Logging, Params, Serializable, Serializable, Identifiable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. AssertionLogRegApproach
  2. Windowing
  3. ApproachWithWordEmbeddings
  4. AutoCloseable
  5. AnnotatorApproach
  6. DefaultParamsWritable
  7. MLWritable
  8. HasAnnotatorType
  9. HasOutputAnnotationCol
  10. HasInputAnnotationCols
  11. Estimator
  12. PipelineStage
  13. Logging
  14. Params
  15. Serializable
  16. Serializable
  17. Identifiable
  18. AnyRef
  19. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new AssertionLogRegApproach()

    Permalink
  2. new AssertionLogRegApproach(uid: String)

    Permalink

Type Members

  1. type AnnotatorType = String

    Permalink
    Definition Classes
    HasAnnotatorType

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def $[T](param: Param[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  4. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  5. lazy val after: Int

    Permalink
    Definition Classes
    AssertionLogRegApproachWindowing
  6. val afterParam: IntParam

    Permalink
  7. val annotatorType: AnnotatorType

    Permalink
  8. def applyWindow(wvectors: WordEmbeddings)(doc: String, s: Int, e: Int): Array[Double]

    Permalink
    Definition Classes
    Windowing
  9. def applyWindow(doc: String, target: String): (Array[String], Array[String], Array[String])

    Permalink
    Definition Classes
    Windowing
  10. def applyWindow(doc: String, s: Int, e: Int): (Array[String], Array[String], Array[String])

    Permalink
    Definition Classes
    Windowing
  11. def applyWindowUdf: UserDefinedFunction

    Permalink
    Definition Classes
    Windowing
  12. def applyWindowUdfNerExhaustive(targetLabels: Array[String]): UserDefinedFunction

    Permalink
    Definition Classes
    Windowing
  13. def applyWindowUdfNerFirst(targetLabels: Array[String]): UserDefinedFunction

    Permalink
    Definition Classes
    Windowing
  14. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  15. lazy val before: Int

    Permalink
    Definition Classes
    AssertionLogRegApproachWindowing
  16. val beforeParam: IntParam

    Permalink
  17. def beforeTraining(spark: SparkSession): Unit

    Permalink
  18. final def clear(param: Param[_]): AssertionLogRegApproach.this.type

    Permalink
    Definition Classes
    Params
  19. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. def close(): Unit

    Permalink
    Definition Classes
    ApproachWithWordEmbeddings → AutoCloseable
  21. final def copy(extra: ParamMap): Estimator[AssertionLogRegModel]

    Permalink
    Definition Classes
    AnnotatorApproach → Estimator → PipelineStage → Params
  22. def copyValues[T <: Params](to: T, extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  23. final def defaultCopy[T <: Params](extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  24. val description: String

    Permalink
  25. val eNetParam: DoubleParam

    Permalink
  26. def embeddings: Option[WordEmbeddings]

    Permalink
    Definition Classes
    ApproachWithWordEmbeddings
  27. val embeddingsFormat: IntParam

    Permalink
    Definition Classes
    ApproachWithWordEmbeddings
  28. val embeddingsNDims: IntParam

    Permalink
    Definition Classes
    ApproachWithWordEmbeddings
  29. val endCol: Param[String]

    Permalink
  30. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  31. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  32. val exhaustiveNerMode: BooleanParam

    Permalink
  33. def explainParam(param: Param[_]): String

    Permalink
    Definition Classes
    Params
  34. def explainParams(): String

    Permalink
    Definition Classes
    Params
  35. final def extractParamMap(): ParamMap

    Permalink
    Definition Classes
    Params
  36. final def extractParamMap(extra: ParamMap): ParamMap

    Permalink
    Definition Classes
    Params
  37. def extractTextUdf: UserDefinedFunction

    Permalink
  38. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  39. final def fit(dataset: Dataset[_]): AssertionLogRegModel

    Permalink
    Definition Classes
    AnnotatorApproach → Estimator
  40. def fit(dataset: Dataset[_], paramMaps: Array[ParamMap]): Seq[AssertionLogRegModel]

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )
  41. def fit(dataset: Dataset[_], paramMap: ParamMap): AssertionLogRegModel

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )
  42. def fit(dataset: Dataset[_], firstParamPair: ParamPair[_], otherParamPairs: ParamPair[_]*): AssertionLogRegModel

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" ) @varargs()
  43. final def get[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  44. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  45. final def getDefault[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  46. final def getInputCols: Array[String]

    Permalink

    returns

    input annotations columns currently used

    Definition Classes
    HasInputAnnotationCols
  47. final def getOrDefault[T](param: Param[T]): T

    Permalink
    Definition Classes
    Params
  48. final def getOutputCol: String

    Permalink

    Gets annotation column name going to generate

    Gets annotation column name going to generate

    Definition Classes
    HasOutputAnnotationCol
  49. def getParam(paramName: String): Param[Any]

    Permalink
    Definition Classes
    Params
  50. final def hasDefault[T](param: Param[T]): Boolean

    Permalink
    Definition Classes
    Params
  51. def hasParam(paramName: String): Boolean

    Permalink
    Definition Classes
    Params
  52. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  53. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  54. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  55. final val inputCols: StringArrayParam

    Permalink

    columns that contain annotations necessary to run this annotator AnnotatorType is used both as input and output columns if not specified

    columns that contain annotations necessary to run this annotator AnnotatorType is used both as input and output columns if not specified

    Attributes
    protected
    Definition Classes
    HasInputAnnotationCols
  56. final def isDefined(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  57. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  58. final def isSet(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  59. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  60. def l2norm(xs: Array[Double]): Double

    Permalink
    Definition Classes
    Windowing
  61. val label: Param[String]

    Permalink
  62. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  63. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  64. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  65. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  66. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  67. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  68. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  69. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  70. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  71. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  72. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  73. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  74. val maxIter: IntParam

    Permalink
  75. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  76. val nerCol: Param[String]

    Permalink
  77. def normalize(vec: Array[Double]): Array[Double]

    Permalink
    Definition Classes
    Windowing
  78. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  79. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  80. def onTrained(model: AssertionLogRegModel, spark: SparkSession): Unit

    Permalink
  81. final val outputCol: Param[String]

    Permalink
    Attributes
    protected
    Definition Classes
    HasOutputAnnotationCol
  82. lazy val params: Array[Param[_]]

    Permalink
    Definition Classes
    Params
  83. val regParam: DoubleParam

    Permalink
  84. val requiredAnnotatorTypes: Array[String]

    Permalink

    Annotator reference id.

    Annotator reference id. Used to identify elements in metadata or to refer to this annotator type

    Definition Classes
    AssertionLogRegApproachHasInputAnnotationCols
  85. def save(path: String): Unit

    Permalink
    Definition Classes
    MLWritable
    Annotations
    @Since( "1.6.0" ) @throws( ... )
  86. final def set(paramPair: ParamPair[_]): AssertionLogRegApproach.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  87. final def set(param: String, value: Any): AssertionLogRegApproach.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  88. final def set[T](param: Param[T], value: T): AssertionLogRegApproach.this.type

    Permalink
    Definition Classes
    Params
  89. def setAfter(a: Int): AssertionLogRegApproach.this.type

    Permalink
  90. def setBefore(b: Int): AssertionLogRegApproach.this.type

    Permalink
  91. final def setDefault(paramPairs: ParamPair[_]*): AssertionLogRegApproach.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  92. final def setDefault[T](param: Param[T], value: T): AssertionLogRegApproach.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  93. def setEmbeddingsSource(path: String, nDims: Int, format: String): AssertionLogRegApproach

    Permalink
    Definition Classes
    ApproachWithWordEmbeddings
  94. def setEmbeddingsSource(path: String, nDims: Int, format: Format): AssertionLogRegApproach

    Permalink
    Definition Classes
    ApproachWithWordEmbeddings
  95. def setEndCol(end: String): AssertionLogRegApproach.this.type

    Permalink
  96. def setEnet(enet: Double): AssertionLogRegApproach.this.type

    Permalink
  97. def setExhaustiveNerMode(v: Boolean): AssertionLogRegApproach

    Permalink
  98. final def setInputCols(value: String*): AssertionLogRegApproach.this.type

    Permalink
    Definition Classes
    HasInputAnnotationCols
  99. final def setInputCols(value: Array[String]): AssertionLogRegApproach.this.type

    Permalink

    Overrides required annotators column if different than default

    Overrides required annotators column if different than default

    Definition Classes
    HasInputAnnotationCols
  100. def setLabelCol(label: String): AssertionLogRegApproach.this.type

    Permalink
  101. def setMaxIter(max: Int): AssertionLogRegApproach.this.type

    Permalink
  102. def setNerCol(col: String): AssertionLogRegApproach.this.type

    Permalink
  103. final def setOutputCol(value: String): AssertionLogRegApproach.this.type

    Permalink

    Overrides annotation column name when transforming

    Overrides annotation column name when transforming

    Definition Classes
    HasOutputAnnotationCol
  104. def setReg(lambda: Double): AssertionLogRegApproach.this.type

    Permalink
  105. def setStartCol(start: String): AssertionLogRegApproach.this.type

    Permalink
  106. def setTargetNerLabels(v: Array[String]): AssertionLogRegApproach.this.type

    Permalink
  107. val sourceEmbeddingsPath: Param[String]

    Permalink
    Definition Classes
    ApproachWithWordEmbeddings
  108. val startCol: Param[String]

    Permalink
  109. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  110. val targetNerLabels: StringArrayParam

    Permalink
  111. def toString(): String

    Permalink
    Definition Classes
    Identifiable → AnyRef → Any
  112. def tokenIndexToSubstringIndex(doc: String, s: Int, e: Int): (Int, Int)

    Permalink
    Definition Classes
    Windowing
  113. val tokenizer: Tokenizer

    Permalink
    Definition Classes
    AssertionLogRegApproachWindowing
  114. def train(dataset: Dataset[_], recursivePipeline: Option[PipelineModel] = None): AssertionLogRegModel

    Permalink
  115. final def transformSchema(schema: StructType): StructType

    Permalink

    requirement for pipeline transformation validation.

    requirement for pipeline transformation validation. It is called on fit()

    Definition Classes
    AnnotatorApproach → PipelineStage
  116. def transformSchema(schema: StructType, logging: Boolean): StructType

    Permalink
    Attributes
    protected
    Definition Classes
    PipelineStage
    Annotations
    @DeveloperApi()
  117. val uid: String

    Permalink
    Definition Classes
    AssertionLogRegApproach → Identifiable
  118. def validate(schema: StructType): Boolean

    Permalink

    takes a Dataset and checks to see if all the required annotation types are present.

    takes a Dataset and checks to see if all the required annotation types are present.

    schema

    to be validated

    returns

    True if all the required types are present, else false

    Attributes
    protected
    Definition Classes
    HasInputAnnotationCols
  119. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  120. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  121. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  122. def wordVectors(): Option[WordEmbeddings]

    Permalink
    Definition Classes
    AssertionLogRegApproachWindowing
  123. def write: MLWriter

    Permalink
    Definition Classes
    DefaultParamsWritable → MLWritable

Inherited from Windowing

Inherited from AutoCloseable

Inherited from DefaultParamsWritable

Inherited from MLWritable

Inherited from HasAnnotatorType

Inherited from HasOutputAnnotationCol

Inherited from HasInputAnnotationCols

Inherited from Estimator[AssertionLogRegModel]

Inherited from PipelineStage

Inherited from Logging

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

Ungrouped