Registers a new listener.
Registers a new listener.
Registers a data listener.
Registers a data listener.
Specifies if the step should throw an error if one of the inputs is not connected.
Specifies if the step should throw an error if one of the inputs is not connected.
Triggers listener notification on stream events.
Triggers listener notification on stream events.
the output value index.
Returns the implicit SQLContext.
Returns the implicit SQLContext.
Evaluates all step's outputs and returns a list of results.
Evaluates all step's outputs and returns a list of results.
The maximum number of input ports.
The maximum number of input ports.
Converts the state into a sequence of rows.
Converts the state into a sequence of rows.
Shortcut for output(0).
Shortcut for output(0). Computes a step output at index 0.
in case of an error, or if the step is not connected.
Computes a step output value at the specified index.
Computes a step output value at the specified index.
the output value index.
in case of an error, or if the step is not connected.
The number of output ports.
The number of output ports.
Converts the data frame into an RDD[(key, value)] where key is defined by the group field indices, and value is computed for each row by the supplied function.
Converts the data frame into an RDD[(key, value)] where key is defined by the group field indices, and value is computed for each row by the supplied function.
Registers the step with the runtime.
Registers the step with the runtime. Subsequent restarts will keep binding the step to newly created contexts.
Unregisters a listener.
Unregisters a listener.
Unregisters a data listener.
Unregisters a data listener.
Clears the cache of this step and optionally that of its predecessors and descendants.
Clears the cache of this step and optionally that of its predecessors and descendants.
Returns the implicit SparkContext.
Returns the implicit SparkContext.
Returns the implicit StreamingContext.
Returns the implicit StreamingContext.
The function to pass to updateStateByKey.
The function to pass to updateStateByKey.
Converts a data frame into a pair DStream[(key, data)], where key is the row key as defined by the set of grouping fields, and data is defied by the set of data fields from the original row.
Converts a data frame into a pair DStream[(key, data)], where key is the row key as defined by the set of grouping fields, and data is defied by the set of data fields from the original row.
Unregisters the step with the runtime.
Unregisters the step with the runtime. After the restart, the step will no longer be bound to the active context.
Wraps exceptions into ExecutionException instances.
Wraps exceptions into ExecutionException instances.
Models state as a java Iterable[Map[String, Any]]. Each map should contain only simple values, not collections.