events

Type Members

1. case class ApplicationAttemptInfo(attemptId: Option[String], startTime: Date, endTime: Date, sparkUser: String, completed: Boolean = false) extends Product with Serializable

   

   A clone of the Spark's ApplicationAttemptInfo, to keep the minimum set of information between version So a sparklint for spark 2.0.1 can still parse the response from a history server with spark 1.6.1

2. case class ApplicationHistoryInfo(id: String, name: String, attempts: List[ApplicationAttemptInfo]) extends Product with Serializable

   

3. class CompressedStateManager extends EventStateManagerLike with EventReceiverLike

   
   Since

   9/7/16.

4. class EventProgress extends AnyRef

   

   Simple data structure to track event source playback progress

   Simple data structure to track event source playback progress

   Since

   9/12/16.

5. class EventProgressTracker extends EventProgressTrackerLike with EventReceiverLike

   

   A class that provides various information about the pointer progress of a specific EventSource through the event receiver interface.

   A class that provides various information about the pointer progress of a specific EventSource through the event receiver interface.

   Annotations

   @throws( ... )

   Since

   9/12/16.

6. trait EventProgressTrackerLike extends AnyRef

   
   Since

   9/12/16.

7. trait EventReceiverLike extends AnyRef

   

   The EventReceiverLike interface provides base event routing and handling for all the event receivers that are injected into an EventSource.

   The EventReceiverLike interface provides base event routing and handling for all the event receivers that are injected into an EventSource.

   All base methods are no-ops, implementers can chose to implement only those they need, and compose freely from other traits. Note, the onPreprocEvent, onOnEvent and onUnEvent handlers are called for each inbound preproc, on and un event before routing to the typed event handler for each, resulting in at least two handler calls for each event type.

   Since

   11/15/16.

8. trait EventSource extends AnyRef

   
   Since

   1.0.5

9. trait EventSourceGroupManager extends AnyRef

   
   Since

   1.0.5

10. case class EventSourceMeta(appId: Option[String], attempt: Option[String], appName: String, sparkVersion: Option[String], startTime: Long = System.currentTimeMillis()) extends EventReceiverLike with Product with Serializable

    
    Since

    1.0.5

11. trait EventStateManagerLike extends AnyRef

    

    Extenders of the EventStateLike interface are capable of building current state based on the receiving or removal of specific SparkListenerEvent messages.

    Extenders of the EventStateLike interface are capable of building current state based on the receiving or removal of specific SparkListenerEvent messages.

    Since

    9/10/16.

12. abstract class EventType extends AnyRef

    

    A set of case classes that represent the available EventSource types.

    A set of case classes that represent the available EventSource types.

    Since

    11/7/16.

13. class FolderEventSourceGroupManager extends GenericEventSourceGroupManager

    
    Annotations

    @throws( ... )

    Since

    1.0.5

    Exceptions thrown

    FileNotFoundException if the folder provided doesn't exist or is a file

14. trait FreeScrollEventSource extends EventSource

    
    Since

    1.0.5

15. class GenericEventSourceGroupManager extends EventSourceGroupManager

    
    Since

    1.0.5

16. case class HistoryServerApi(name: String, host: Uri) extends Logging with Product with Serializable

    
    Since

    1.0.5

17. class HistoryServerEventSourceGroupManager extends GenericEventSourceGroupManager

    
    Since

    1.0.5

18. class IteratorEventSource extends FreeScrollEventSource

    
    Since

    1.0.5

19. class ListenerEventSource extends SparkFirehoseListener with EventSource

    
    Since

    1.0.5

20. class LosslessStateManager extends EventStateManagerLike with EventReceiverLike

    
    Since

    9/22/16.

21. case class UnrecognizedLogFileException(filename: String, reason: Option[String] = None) extends Throwable with Product with Serializable

    
    Since

    1.0.5