org.apache.spark.deploy.history

HistoryServer

Related Docs: object HistoryServer | package history

class HistoryServer extends WebUI with Logging with UIRoot

A web server that renders SparkUIs of completed applications.

For the standalone mode, MasterWebUI already achieves this functionality. Thus, the main use case of the HistoryServer is in other deploy modes (e.g. Yarn or Mesos).

The logging directory structure is as follows: Within the given base directory, each application's event logs are maintained in the application's own sub-directory. This is the same structure as maintained in the event log write code path in EventLoggingListener.

Linear Supertypes
UIRoot, WebUI, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. HistoryServer
  2. UIRoot
  3. WebUI
  4. Logging
  5. AnyRef
  6. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HistoryServer(conf: SparkConf, provider: ApplicationHistoryProvider, securityManager: SecurityManager, port: Int)

Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  5. def attachHandler(handler: ServletContextHandler): Unit

    Attach a handler to this UI.

    Attach a handler to this UI.

    Definition Classes
    WebUI

  6. def attachPage(page: WebUIPage): Unit

    Attach a page to this UI.

    Attach a page to this UI.

    Definition Classes
    WebUI

  7. def attachTab(tab: WebUITab): Unit

    Attach a tab to this UI, along with all of its attached pages.

    Attach a tab to this UI, along with all of its attached pages.

    Definition Classes
    WebUI

  8. def bind(): Unit

    Bind to the HTTP server behind this web interface.

    Bind to the HTTP server behind this web interface.

    Definition Classes
    HistoryServer → WebUI

  9. def boundPort: Int

    Return the actual port to which this server is bound.

    Return the actual port to which this server is bound. Only valid after bind().

    Definition Classes
    WebUI

  10. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  11. def detachHandler(handler: ServletContextHandler): Unit

    Detach a handler from this UI.

    Detach a handler from this UI.

    Definition Classes
    WebUI

  12. def detachPage(page: WebUIPage): Unit

    Definition Classes
    WebUI

  13. def detachTab(tab: WebUITab): Unit

    Definition Classes
    WebUI

  14. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  15. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  16. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  17. def getApplicationInfoList: Iterator[ApplicationInfo]

    Definition Classes
    HistoryServer → UIRoot

  18. def getApplicationList(): Iterable[ApplicationHistoryInfo]

    Returns a list of available applications, in descending order according to their end time.

    Returns a list of available applications, in descending order according to their end time.

    returns

    List of all known applications.

  19. def getBasePath: String

    Definition Classes
    WebUI

  20. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  21. def getHandlers: Seq[ServletContextHandler]

    Definition Classes
    WebUI

  22. def getProviderConfig(): Map[String, String]

    Returns the provider configuration to show in the listing page.

    Returns the provider configuration to show in the listing page.

    returns

    A map with the provider's configuration.

  23. def getSecurityManager: SecurityManager

    Definition Classes
    WebUI

  24. def getSparkUI(appKey: String): Option[SparkUI]

    Definition Classes
    HistoryServer → UIRoot

  25. def getTabs: Seq[WebUITab]

    Definition Classes
    WebUI

  26. val handlers: ArrayBuffer[ServletContextHandler]

    Attributes
    protected
    Definition Classes
    WebUI

  27. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  28. def initialize(): Unit

    Initialize the history server.

    Initialize the history server.

    This starts a background thread that periodically synchronizes information displayed on this UI with the event logs in the provided base directory.

    Definition Classes
    HistoryServer → WebUI

  29. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  30. def isTraceEnabled(): Boolean

    Attributes
    protected
    Definition Classes
    Logging

  31. val localHostName: String

    Attributes
    protected
    Definition Classes
    WebUI

  32. def log: Logger

    Attributes
    protected
    Definition Classes
    Logging

  33. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  34. def logDebug(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  35. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  36. def logError(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  37. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  38. def logInfo(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  39. def logName: String

    Attributes
    protected
    Definition Classes
    Logging

  40. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  41. def logTrace(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  42. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  43. def logWarning(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  44. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  45. final def notify(): Unit

    Definition Classes
    AnyRef

  46. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  47. val pageToHandlers: HashMap[WebUIPage, ArrayBuffer[ServletContextHandler]]

    Attributes
    protected
    Definition Classes
    WebUI

  48. val publicHostName: String

    Attributes
    protected
    Definition Classes
    WebUI

  49. val securityManager: SecurityManager

    Definition Classes
    WebUI

  50. var serverInfo: Option[ServerInfo]

    Attributes
    protected
    Definition Classes
    WebUI

  51. def stop(): Unit

    Stop the server and close the file system.

    Stop the server and close the file system.

    Definition Classes
    HistoryServer → WebUI

  52. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  53. val tabs: ArrayBuffer[WebUITab]

    Attributes
    protected
    Definition Classes
    WebUI

  54. def toString(): String

    Definition Classes
    AnyRef → Any

  55. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  56. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  57. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  58. def withSparkUI[T](appId: String, attemptId: Option[String])(f: (SparkUI) ⇒ T): T

    Get the spark UI with the given appID, and apply a function to it.

    Get the spark UI with the given appID, and apply a function to it. If there is no such app, throw an appropriate exception

    Definition Classes
    UIRoot

Inherited from UIRoot

Inherited from WebUI

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped