com.coxautodata.waimak.dataflow.spark
Used to identify an extension instance on the flow
Used to identify an extension instance on the flow
Takes a value of type A and a msg to log, returning a and logging the message at the desired level
Takes a value of type A and a msg to log, returning a and logging the message at the desired level
a
Takes a value of type A and a function message from A to String, logs the value of invoking message(a) at the level described by the level parameter
Takes a value of type A and a function message from A to String, logs the value of invoking message(a) at the level described by the level parameter
a
logAndReturn(1, (num: Int) => s"number: $num", Info) // In the log we would see a log corresponding to "number 1"
Function that is called just before a flow is executed.
Function that is called just before a flow is executed. This function can be used to: * Validate a flow (using the metadata state) * Change the flow in some way (using the metadata state)
This function can be called multiple times until all invocations stabilise. Ensure you remove the extension from the flow to prevent the extension being called again.