Function to be implemented to define the transformation between an input and output DataFrame (1:1)
Function to be implemented to define the transformation between an input and output DataFrame (1:1)
Spark Session
Options specified in the configuration for this transformation
DataFrames to be transformed
Id of DataObject of SubFeed
Transformed DataFrame
Optional function to define the transformation of input to output partition values.
Optional function to define the transformation of input to output partition values. For example this enables to implement aggregations where multiple input partitions are combined into one output partition. Note that the default value is input = output partition values, which should be correct for most use cases.
Options specified in the configuration for this transformation
partition values to be transformed
Interface to define a custom Spark-DataFrame transformation (1:1)