spark

Type Members

1. case class AppMetrics(appName: String, appId: String, runType: String, customTagName: Option[String], customTagValue: Option[String], appStartTime: Long, appEndTime: Long, appDuration: Long, stageMetrics: Seq[StageMetrics], versionInfo: VersionInfo) extends JsonLike with Product with Serializable

   

   App metrics container.

   App metrics container. Contains the app info, all the stage metrics computed by the spark listener and project version info.

2. class OpSparkListener extends SparkListener

   

   Logs & collects metrics upon completion of Spark application, jobs, stages

3. case class StageMetrics extends JsonLike with Product with Serializable

   

   Spark stage metrics container for a org.apache.spark.scheduler.StageInfo Note: all the time values are in milliseconds.