Methods that either wrap, or operate on wrapped, values so that
common RDD operations are available with a natural, functional syntax.
Let's look at Map as an example:
// implemented using librray that is not extendable and doesn't implement Serialzableval f: A => B = ...
// can be anywhere, error will occur even if in local modeval data: RDD[A] = ...
// cannot do
data.map(f)
// runtime exception :(// as f does not implement Serializable// instead doMap(f)(data)
// will serialize it using Kryo and safely// deserialize to perform map on the data RDD
Methods that either wrap, or operate on wrapped, values so that common RDD operations are available with a natural, functional syntax.
Let's look at Map as an example: