Expected result of the transformer applied on the Input Dataset
Expected result of the transformer applied on the Input Dataset
Input Dataset to transform
Input Dataset to transform
Transformer instance to be tested
Transformer instance to be tested
Assert stage instances
Assert stage instances
instance to assert
instance to assert against
should expect the same class or not
Feature type equality
Feature type equality
Feature type sequence equality
Feature type sequence equality
The wrapped Spark stage instance
Spec name (StageType[O] by default)
Spec name (StageType[O] by default)
Spark stage save path
Spark stage save path
A helper function to write and read stage into savePath
A helper function to write and read stage into savePath
stage instance to write and then read
Spark stage save path
read stage
The parameterless execute method has been deprecated and will be removed in a future version of ScalaTest. Please invoke execute with empty parens instead: execute().
(Since version 3.2.3) Use loadResource
The trap method is no longer needed for demos in the REPL, which now abreviates stack traces, and will be removed in a future version of ScalaTest
Base test class for testing Spark transformer wrapper instances, e.g SwUnaryTransformer, SwBinaryTransformer etc. Includes common tests for schema and data transformations.
output feature type
type of Spark transformer
type of Spark transformer wrapper being tested, e.g. SwUnaryTransformer, SwBinaryTransformer etc.