com.mongodb.spark.rdd.partitioner
The partition key property
The partition size MB property
Calculate the Partitions
Calculate the Partitions
the MongoConnector
the pipeline to apply if any. Note this pipeline may have been appended to during optimization.
the partitions
The SplitVector Partitioner.
Uses the
SplitVector
command on the primary node to generate partitions for a collection. RequiresClusterManager
privilege.Configuration Properties
The prefix when using
sparkConf
is:spark.mongodb.input.partitionerOptions
followed by the property name:_id
.64
.1.0