Type Members

1.  case class EngineEvent(applicationId: String, attemptId: Option[String], applicationName: String, owner: String, shareLevel: String, connectionUrl: String, master: String, sparkVersion: String, webUrl: String, startTime: Long, endTime: Long, state: Int, diagnostic: String, settings: Map[String, String]) extends KyuubiEvent with SparkListenerEvent with Product with Serializable
   applicationId

   application id a.k.a, the unique id for engine

   applicationName

   the application name

   owner

   the application user

   shareLevel

   the share level for this engine

   connectionUrl

   the jdbc connection string

   master

   the master type, yarn, k8s, local etc.

   sparkVersion

   short version of spark distribution

   webUrl

   the tracking url of this engine

   startTime

   start time

   endTime

   end time

   state

   the engine state

   diagnostic

   caught exceptions if any

   settings

   collection of all configurations of spark and kyuubi

2.  class EngineEventsStore extends AnyRef

   A memory store that tracking the number of statements and sessions, it provides:

   A memory store that tracking the number of statements and sessions, it provides:

   - stores all events. - cleanup the events when reach a certain threshold: 1). remove the finished events first. 2). remove the active events if still reach the threshold.

3.  case class SessionEvent(sessionId: String, name: String, engineId: String, username: String, ip: String, serverIp: String, conf: Map[String, String], startTime: Long, endTime: Long = -1L, totalOperations: Int = 0, sessionRunTime: Long = 0, sessionCpuTime: Long = 0) extends KyuubiEvent with SparkListenerEvent with Product with Serializable

   Event Tracking for user sessions

   Event Tracking for user sessions

   sessionId

   the identifier of a session

   engineId

   the engine id

   ip

   Client IP address

   serverIp

   Kyuubi Server IP address

   startTime

   Start time

   endTime

   End time

   totalOperations

   how many queries and meta calls

   sessionRunTime

   total time of running the session (including fetching shuffle data) in milliseconds

   sessionCpuTime

   total CPU time of running the session (including fetching shuffle data) in nanoseconds

4.  class SparkEventHandlerRegister extends EventHandlerRegister
5.  case class SparkOperationEvent(statementId: String, statement: String, shouldRunAsync: Boolean, state: String, eventTime: Long, createTime: Long, startTime: Long, completeTime: Long, exception: Option[Throwable], sessionId: String, sessionUser: String, executionId: Option[Long], operationRunTime: Option[Long], operationCpuTime: Option[Long]) extends KyuubiEvent with SparkListenerEvent with Product with Serializable

   A SparkOperationEvent used to tracker the lifecycle of an operation at Spark SQL Engine side.

   A SparkOperationEvent used to tracker the lifecycle of an operation at Spark SQL Engine side.

   • Operation Basis
   • Operation Live Status
   • Parent Session Id

   statementId

   the unique identifier of a single operation

   statement

   the sql that you execute

   shouldRunAsync

   the flag indicating whether the query runs synchronously or not

   state

   the current operation state

   eventTime

   the time when the event created & logged

   createTime

   the time for changing to the current operation state

   startTime

   the time the query start to time of this operation

   completeTime

   time time the query ends

   sessionId

   the identifier of the parent session

   sessionUser

   the authenticated client user

   executionId

   the query execution id of this operation

   operationRunTime

   total time of running the operation (including fetching shuffle data) in milliseconds

   operationCpuTime

   total CPU time of running the operation (including fetching shuffle data) in nanoseconds