IterablePipe
Related Doc:
package scala
Merge two pipes of the same type
Merge two pipes of the same type
Execute the chain and return the computed values.
Execute the chain and return the computed values.
Filter elements using the function f.
Filter elements using the function f.
Implemented as a flatMap executed on the client.
Transform each value using the function f and flatten the result.
Transform each value using the function f and flatten the result.
Note: This is not a monadic composition.
Flatten step is performed on the client. If you have a chain of flatMaps, all functions in the chain are composed and flattening is performed once on the client.
To manually split the flatMap chain, use .fork. Forking is useful when dealing with long, lazy chains, or when adding a barrier is desired.
Manually add a fork in the execution chain.
Manually add a fork in the execution chain. This creates a barrier, which means the subsequent transforms are planned on a fresh Ignite closure.
Transform each element using the function f.
Transform each element using the function f.
This is executed on the cluster nodes. Chained map transforms are composed and executed once on the cluster nodes. Use .fork to manually split the chain if tuning is required.
Prepare a Reduction based on the provided Semigroup.
Prepare a Reduction based on the provided Semigroup.
Note that results can arrived from cluster nodes in any order, so the operation has to be associative and commutative.
A pipe containing a sequence of values.
Can be generally used as the starting point in the execution chain. The sequence is partitioned and load balanced across the cluster nodes.