Obtains a metrics recorder suitable for passing-in to a function that operates on an RDD.
Obtains a metrics recorder suitable for passing-in to a function that operates on an RDD. See the class-level documentation for a usage example.
Instruments the passed-in RDD, returning an InstrumentedRDD
Instruments a function call that acts on the data in an RDD.
Instruments a function call that acts on the data in an RDD. The recorder should have been obtained
from the metricsRecorder
method. The passed-in functionTimer
is used to time the function call.
See the class-level documentation for a usage example.
The overhead of instrumenting a function call has been measured at around 120 nanoseconds on an Intel i7-3720QM. The overhead of calling this method when no metrics are being recorded (a recorder is not defined) is negligible.
Instruments an RDD operation.
Instruments an RDD operation. All RDD operations that need to be instrumented should be wrapped in this method. See the class-level documentation for a usage example.