The predicate function to apply on each input record.
The predicate function to apply on each input record.
The input record to push predicates down on.
True if this should be filtered, else, false.
The fields of the input record that should be populated.
The fields of the input record that should be populated. If a projection should not be applied, this should be null. Code upstream will check for a null value, so this is safe.
A schema describing the projection to apply to all records.
Run method to be implemented by plugin implementor.
Run method to be implemented by plugin implementor.
Java Spark Context that this plugin is running inside of.
Input RDD of records.
Command line arguments passed to this plugin.
Output RDD to be saved to disk.
Plugins that seek to apply a predicate on the input records should extend this class.