Object/Class

io.smartdatalake.workflow.action.sparktransformer

ScalaNotebookDfTransformer

Related Docs: class ScalaNotebookDfTransformer | package sparktransformer

Permalink

object ScalaNotebookDfTransformer extends FromConfigFactory[ParsableDfTransformer] with Serializable

Linear Supertypes
Serializable, Serializable, FromConfigFactory[ParsableDfTransformer], ConfigImplicits, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ScalaNotebookDfTransformer
  2. Serializable
  3. Serializable
  4. FromConfigFactory
  5. ConfigImplicits
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. implicit val actionIdReader: ConfigReader[ActionId]

    Permalink

    A reader that reads ActionId values.

    A reader that reads ActionId values.

    Definition Classes
    ConfigImplicits
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. implicit val authModeReader: ConfigReader[AuthMode]

    Permalink
    Definition Classes
    ConfigImplicits
  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. def compileCode(code: String): fnTransformType

    Permalink
  9. implicit val conditionReader: ConfigReader[Condition]

    Permalink
    Definition Classes
    ConfigImplicits
  10. implicit val connectionIdReader: ConfigReader[ConnectionId]

    Permalink

    A reader that reads ConnectionId values.

    A reader that reads ConnectionId values.

    Definition Classes
    ConfigImplicits
  11. implicit val customDfCreatorConfigReader: ConfigReader[CustomDfCreatorConfig]

    Permalink
    Definition Classes
    ConfigImplicits
  12. implicit val customDfTransformerConfigReader: ConfigReader[CustomDfTransformerConfig]

    Permalink
    Definition Classes
    ConfigImplicits
  13. implicit val customDfsTransformerConfigReader: ConfigReader[CustomDfsTransformerConfig]

    Permalink
    Definition Classes
    ConfigImplicits
  14. implicit val customFileTransformerConfigReader: ConfigReader[CustomFileTransformerConfig]

    Permalink
    Definition Classes
    ConfigImplicits
  15. implicit val dataObjectIdReader: ConfigReader[DataObjectId]

    Permalink

    A reader that reads DataObjectId values.

    A reader that reads DataObjectId values.

    Definition Classes
    ConfigImplicits
  16. implicit val dfTransformerReader: ConfigReader[ParsableDfTransformer]

    Permalink

    A reader that reads ParsableDfTransformer values.

    A reader that reads ParsableDfTransformer values. Note that DfSparkTransformer must be parsed according to it's 'type' attribute by using SDL ConfigParser.

    Definition Classes
    ConfigImplicits
  17. implicit val dfsTransformerReader: ConfigReader[ParsableDfsTransformer]

    Permalink

    A reader that reads ParsableDfsTransformer values.

    A reader that reads ParsableDfsTransformer values. Note that DfSparkTransformer must be parsed according to it's 'type' attribute by using SDL ConfigParser.

    Definition Classes
    ConfigImplicits
  18. def downloadNotebook(url: String, authMode: Option[AuthMode]): String

    Permalink

    Download Notebook content from url

  19. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  20. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  21. implicit val executionModeReader: ConfigReader[ExecutionMode]

    Permalink
    Definition Classes
    ConfigImplicits
  22. def extract[T](config: Config)(implicit arg0: ConfigReader[T]): T

    Permalink

    Helper method to extract case class from config

    Helper method to extract case class from config

    Attributes
    protected
    Definition Classes
    FromConfigFactory
  23. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  24. def fromConfig(config: Config)(implicit instanceRegistry: InstanceRegistry): ScalaNotebookDfTransformer

    Permalink

    Factory method for parsing (case) classes from Configs.

    Factory method for parsing (case) classes from Configs.

    returns

    a new instance of type CO parsed from the a context dependent Config.

    Definition Classes
    ScalaNotebookDfTransformer → FromConfigFactory
  25. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  26. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  27. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  28. implicit def mapDataObjectIdStringReader(implicit mapReader: ConfigReader[Map[String, String]]): ConfigReader[Map[DataObjectId, String]]

    Permalink
    Definition Classes
    ConfigImplicits
  29. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  30. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  31. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  32. implicit val outputModeReader: ConfigReader[OutputMode]

    Permalink

    A ConfigReader reader that reads OutputMode.

    A ConfigReader reader that reads OutputMode.

    Definition Classes
    ConfigImplicits
  33. def parseNotebook(notebookContent: String): String

    Permalink

    Parse *.ipynb Notebook content Get code from all cells with cell_type=code and language=scala, ignoring cells which start with "//!IGNORE" comment

  34. def prepareFunction(notebookCode: String, functionName: String): String

    Permalink

    Prepare function

  35. implicit val scriptDefReader: ConfigReader[ParsableScriptDef]

    Permalink

    A reader that reads ParsableScriptDef values.

    A reader that reads ParsableScriptDef values. Note that ParsableScriptDef must be parsed according to it's 'type' attribute by using SDL ConfigParser.

    Definition Classes
    ConfigImplicits
  36. implicit def sdlDefaultNaming[A]: ConfigKeyNaming[A]

    Permalink

    default naming strategy is to allow lowerCamelCase and hypen-separated key naming, and fail on superfluous keys

    default naming strategy is to allow lowerCamelCase and hypen-separated key naming, and fail on superfluous keys

    Definition Classes
    ConfigImplicits
  37. implicit val secretProviderConfigReader: ConfigReader[SecretProviderConfig]

    Permalink
    Definition Classes
    ConfigImplicits
  38. implicit val sparkRepartitionDefReader: ConfigReader[SparkRepartitionDef]

    Permalink
    Definition Classes
    ConfigImplicits
  39. implicit val sparkUdfCreatorConfigReader: ConfigReader[SparkUDFCreatorConfig]

    Permalink
    Definition Classes
    ConfigImplicits
  40. implicit val structTypeReader: ConfigReader[StructType]

    Permalink

    A ConfigReader reader that reads StructType values.

    A ConfigReader reader that reads StructType values.

    This reader parses a StructType from a DDL string.

    Definition Classes
    ConfigImplicits
  41. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  42. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  43. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  44. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  45. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from FromConfigFactory[ParsableDfTransformer]

Inherited from ConfigImplicits

Inherited from AnyRef

Inherited from Any

Ungrouped