customlogic

Type Members

1. trait CustomDfCreator extends Serializable

   

   Interface to define custom logic for DataFrame transformations

2. case class CustomDfCreatorConfig(className: Option[String] = None, scalaFile: Option[String] = None, scalaCode: Option[String] = None, options: Option[Map[String, String]] = None) extends Product with Serializable

   

3. class CustomDfCreatorWrapper extends CustomDfCreator

   

4. trait CustomDfTransformer extends Serializable

   

   Interface to define custom logic for a DataFrame

5. case class CustomDfTransformerConfig(className: Option[String] = None, scalaFile: Option[String] = None, scalaCode: Option[String] = None, sqlCode: Option[String] = None, options: Map[String, String] = Map()) extends Product with Serializable

   

6. trait CustomDfsTransformer extends Serializable

   

   Same trait as CustomDfTransformer but supported multiple input and outputs.

7. case class CustomDfsTransformerConfig(className: Option[String] = None, scalaFile: Option[String] = None, scalaCode: Option[String] = None, sqlCode: Map[DataObjectId, String] = Map(), options: Map[String, String] = Map()) extends Product with Serializable

   
   className

   Optional class name to load transformer code from

   scalaFile

   Optional file where scala code for transformation is loaded from

   scalaCode

   Optional scala code for transformation

   sqlCode

   Optional map of DataObjectId and corresponding SQL Code

8. trait CustomFileTransformer extends Serializable

   

   Interface to define custom file transformation for CustomFileAction

9. case class CustomFileTransformerConfig(className: Option[String] = None, scalaFile: Option[String] = None, scalaCode: Option[String] = None) extends Product with Serializable

   

10. class CustomFileTransformerWrapper extends CustomFileTransformer with SmartDataLakeLogger