org.apache.spark.repl

SparkIMain

class SparkIMain extends SparkImports with Logging

An interpreter for Scala code.

The main public entry points are compile(), interpret(), and bind(). The compile() method loads a complete Scala file. The interpret() method executes one line of Scala code at the request of the user. The bind() method binds an object to a variable that can then be used by later interpreted code.

The overall approach is based on compiling the requested code and then using a Java classloader and Java reflection to run the code and access its results.

In more detail, a single compiler instance is used to accumulate all successfully compiled or interpreted Scala code. To "interpret" a line of code, the compiler generates a fresh object that includes the line of code and which has public member(s) to export all variables defined by that code. To extract the result of an interpreted line to show the user, a second "result object" is created which imports the variables exported by the above object and then exports members called "$eval" and "$print". To accomodate user expressions that read from variables or methods defined in previous statements, "import" statements are used.

This interpreter shares the strengths and weaknesses of using the full compiler-to-Java. The main strength is that interpreted code behaves exactly as does compiled code, including running at full speed. The main weakness is that redefining classes and methods is not handled properly, because rebinding at the Java level is technically difficult.

Self Type
SparkIMain
Linear Supertypes
Logging, SparkImports, AnyRef, Any
Known Subclasses
SparkILoopInterpreter
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. SparkIMain
  2. Logging
  3. SparkImports
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SparkIMain()

  2. new SparkIMain(settings: Settings)

    construct an interpreter that reports to Console

  3. new SparkIMain(initialSettings: Settings, out: JPrintWriter)

Type Members

  1. class ReadEvalPrint extends AnyRef

    Here is where we:

  2. implicit class ReplTypeOps extends AnyRef

  3. class Request extends AnyRef

    One line of code submitted by the user for interpretation

  4. case class SparkComputedImports(prepend: String, append: String, access: String) extends Product with Serializable

    Compute imports that allow definitions from previous requests to be visible in a new request.

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. object FixedSessionNames

    Captures the session names (which are set by system properties) once, instead of for each line.

  7. val SPARK_DEBUG_REPL: Boolean

  8. def addImports(ids: String*): Result

  9. def aliasForType(path: String): Option[String]

    Parse the ScalaSig to find type aliases

  10. def allDefHandlers: List[(memberHandlers)#MemberDefHandler]

  11. def allDefSymbols: List[scala.tools.nsc.Global.Symbol]

  12. def allDefinedNames: List[scala.tools.nsc.Global.Name]

  13. def allHandlers: List[(memberHandlers)#MemberHandler]

  14. def allImplicits: List[scala.tools.nsc.Global.Name { ... /* 5 definitions in type refinement */ }]

  15. def allImportedNames: List[scala.tools.nsc.Global.Name]

    Definition Classes
    SparkImports

  16. def allSeenTypes: List[String]

  17. def apply[T](implicit arg0: ClassTag[T]): scala.tools.nsc.Global.Symbol

  18. def apply(name: String): scala.tools.nsc.Global.Symbol

    Translate a repl-defined identifier into a Symbol.

  19. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  20. def beQuietDuring[T](body: ⇒ T): T

    Temporarily be quiet

  21. def beSilentDuring[T](operation: ⇒ T): T

  22. def bind[T](name: String, value: T)(implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T], arg1: ClassTag[T]): Result

  23. def bind(p: NamedParam): Result

  24. def bind(name: String, boundType: String, value: Any, modifiers: List[String] = Nil): Result

    Bind a specified name to a specified value.

    Bind a specified name to a specified value. The name may later be used by expressions passed to interpret.

    name

    the variable name to bind

    boundType

    the type of the variable, as a string

    value

    the object value to bind to it

    returns

    an indication of whether the binding succeeded

  25. def bindSyntheticValue(x: Any): Result

  26. def bindValue(name: String, x: Any): Result

  27. def bindValue(x: Any): Result

  28. def classLoader: AbstractFileClassLoader

  29. def classOfTerm(id: String): Option[JClass]

  30. val classServer: HttpServer

    Jetty server that will serve our classes to worker nodes

  31. def classSymbols: List[scala.tools.nsc.Global.ClassSymbol]

  32. def cleanMemberDecl(owner: scala.tools.nsc.Global.Symbol, member: scala.tools.nsc.Global.Name): scala.tools.nsc.Global.Type

  33. def clearExecutionWrapper(): Unit

  34. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  35. def close(): Unit

    This instance is no longer needed, so release any resources it is using.

    This instance is no longer needed, so release any resources it is using. The reporter's output gets flushed.

  36. def compileSources(sources: SourceFile*): Boolean

    Compile an nsc SourceFile.

    Compile an nsc SourceFile. Returns true if there are no compilation errors, or false otherwise.

  37. def compileSourcesKeepingRun(sources: SourceFile*): (Boolean, Run)

  38. def compileString(code: String): Boolean

    Compile a string.

    Compile a string. Returns true if there are no compilation errors, or false otherwise.

  39. def compilerClasspath: Seq[URL]

  40. val conf: SparkConf

  41. def debugging[T](msg: String)(res: T): T

  42. object deconstruct extends StructuredTypeStrings

  43. def definedSymbolList: List[scala.tools.nsc.Global.Symbol]

  44. def definedSymbols: Set[scala.tools.nsc.Global.Symbol]

  45. def definedTerms: List[scala.tools.nsc.Global.TermName]

  46. def definedTypes: List[scala.tools.nsc.Global.TypeName]

  47. def definitionForName(name: scala.tools.nsc.Global.Name): Option[(memberHandlers)#MemberHandler]

  48. def directBind[T](name: String, value: T)(implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T], arg1: ClassTag[T]): Result

  49. def directBind(p: NamedParam): Result

  50. def directBind(name: String, boundType: String, value: Any): Result

  51. final def ensureClassLoader(): Unit

  52. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  53. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  54. def executionWrapper: String

  55. object exprTyper extends SparkExprTyper

  56. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  57. def flatName(id: String): String

  58. lazy val formatting: Formatting

  59. def generatedName(simpleName: String): Option[String]

    Given a simple repl-defined name, returns the real name of the class representing it, e.

    Given a simple repl-defined name, returns the real name of the class representing it, e.g. for "Bippy" it may return

    $line19.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$Bippy

  60. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  61. def getInterpreterClassLoader(): AbstractFileClassLoader

  62. lazy val global: Global

    the public, go through the future compiler

  63. def handleTermRedefinition(name: scala.tools.nsc.Global.TermName, old: Request, req: Request): Unit

  64. def handleTypeRedefinition(name: scala.tools.nsc.Global.TypeName, old: Request, req: Request): Unit

    Stubs for work in progress.

  65. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  66. def implicitSymbols: List[scala.tools.nsc.Global.Symbol]

    Definition Classes
    SparkImports

  67. def implicitSymbolsBySource: List[(scala.tools.nsc.Global.Symbol, List[scala.tools.nsc.Global.Symbol])]

    Definition Classes
    SparkImports

  68. def importHandlers: List[(memberHandlers)#ImportHandler]

  69. def importedSymbols: List[scala.tools.nsc.Global.Symbol]

    Definition Classes
    SparkImports

  70. def importedSymbolsBySource: List[(scala.tools.nsc.Global.Symbol, List[scala.tools.nsc.Global.Symbol])]

    Tuples of (source, imported symbols) in the order they were imported.

    Tuples of (source, imported symbols) in the order they were imported.

    Definition Classes
    SparkImports

  71. def importedTermNamed(name: String): scala.tools.nsc.Global.Symbol

    Definition Classes
    SparkImports

  72. def importedTermSymbols: List[scala.tools.nsc.Global.TermSymbol]

    Definition Classes
    SparkImports

  73. def importedTerms: List[scala.tools.nsc.Global.TermName]

    Definition Classes
    SparkImports

  74. def importedTypeSymbols: List[scala.tools.nsc.Global.TypeSymbol]

    Definition Classes
    SparkImports

  75. def importedTypes: List[scala.tools.nsc.Global.TypeName]

    Definition Classes
    SparkImports

  76. def importsCode(wanted: Set[scala.tools.nsc.Global.Name]): SparkComputedImports

    Attributes
    protected
    Definition Classes
    SparkImports

  77. def initialize(postInitSignal: ⇒ Unit): Unit

  78. def initializeSynchronous(): Unit

  79. def interpret(line: String, synthetic: Boolean): Result

  80. def interpret(line: String): Result

    Interpret one line of input.

    Interpret one line of input. All feedback, including parse errors and evaluation results, are printed via the supplied compiler's reporter. Values defined are available for future interpreted strings.

    The return value is whether the line was interpreter successfully, e.g. that there were no parse errors.

  81. def interpretSynthetic(line: String): Result

  82. def isInitializeComplete: Boolean

  83. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  84. def isNoImports: Boolean

    Definition Classes
    SparkImports

  85. def isNoPredef: Boolean

    Definition Classes
    SparkImports

  86. def isParseable(line: String): Boolean

  87. def isTraceEnabled(): Boolean

    Attributes
    protected
    Definition Classes
    Logging

  88. lazy val isettings: SparkISettings

    interpreter settings

  89. def languageSymbols: List[scala.tools.nsc.Global.Symbol]

    Definition Classes
    SparkImports

  90. def languageWildcardHandlers: List[(memberHandlers)#ImportHandler]

    Definition Classes
    SparkImports

  91. def languageWildcardSyms: List[scala.tools.nsc.Global.Symbol]

    Symbols whose contents are language-defined to be imported.

    Symbols whose contents are language-defined to be imported.

    Definition Classes
    SparkImports

  92. def languageWildcards: List[scala.tools.nsc.Global.Type]

    Definition Classes
    SparkImports

  93. def lastRequest: Request

  94. def lastWarnings: List[(scala.tools.nsc.Global.Position, String)]

  95. def log: Logger

    Attributes
    protected
    Definition Classes
    Logging

  96. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  97. def logDebug(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  98. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  99. def logError(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  100. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  101. def logInfo(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  102. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  103. def logTrace(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  104. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  105. def logWarning(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  106. lazy val memberHandlers: SparkMemberHandlers { val intp: SparkIMain.this.type }

  107. def methodSymbols: List[scala.tools.nsc.Global.MethodSymbol]

  108. def mostRecentLine: String

  109. def mostRecentVar: String

    Returns the name of the most recent interpreter result.

    Returns the name of the most recent interpreter result. Mostly this exists so you can conveniently invoke methods on the previous result.

  110. def namedDefinedTerms: List[scala.tools.nsc.Global.TermName]

  111. object naming extends Naming

  112. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  113. def newCompiler(settings: Settings, reporter: Reporter): ReplGlobal

    Instantiate a compiler.

    Instantiate a compiler. Overridable.

    Attributes
    protected

  114. def normalizeNonPublic(tp: scala.tools.nsc.Global.Type): scala.tools.nsc.Global.Type

  115. final def notify(): Unit

    Definition Classes
    AnyRef

  116. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  117. def onlyTerms(xs: List[scala.tools.nsc.Global.Name]): List[scala.tools.nsc.Global.TermName]

    Attributes
    protected

  118. def onlyTypes(xs: List[scala.tools.nsc.Global.Name]): List[scala.tools.nsc.Global.TypeName]

    Attributes
    protected

  119. def optFlatName(id: String): Option[String]

  120. val out: JPrintWriter

  121. lazy val outputDir: File

    Local directory to save .

    Local directory to save .class files too

  122. def parentClassLoader: ClassLoader

    Parent classloader.

    Parent classloader. Overridable.

    Attributes
    protected

  123. def parse(line: String): Option[List[scala.tools.nsc.Global.Tree]]

  124. def pathToName(name: scala.tools.nsc.Global.Name): String

  125. def pathToTerm(id: String): String

  126. def pathToType(id: String): String

  127. def prevRequestList: List[Request]

  128. var printResults: Boolean

  129. def quietBind(p: NamedParam): Result

  130. def quietImport(ids: String*): Result

  131. def quietRun[T](code: String): Result

  132. def rebind(p: NamedParam): Result

  133. def recordRequest(req: Request): Unit

  134. lazy val repllog: Logger

  135. def replwarn(msg: ⇒ String): Unit

  136. lazy val reporter: ConsoleReporter

  137. def requestForIdent(line: String): Option[Request]

  138. def requestForName(name: scala.tools.nsc.Global.Name): Option[Request]

  139. def requestForReqId(id: Int): Option[Request]

  140. def requestHistoryForName(name: scala.tools.nsc.Global.Name): List[Request]

  141. def reset(): Unit

    Reset this interpreter, forgetting all user-specified requests.

  142. def resetClassLoader(): Unit

  143. def runtimeClassAndTypeOfTerm(id: String): Option[(JClass, scala.tools.nsc.Global.Type)]

  144. def runtimeTypeOfTerm(id: String): scala.tools.nsc.Global.Type

  145. def sessionImportedSymbols: List[scala.tools.nsc.Global.Symbol]

    Definition Classes
    SparkImports

  146. def sessionWildcards: List[scala.tools.nsc.Global.Type]

    Types which have been wildcard imported, such as: val x = "abc" ; import x.

    Types which have been wildcard imported, such as: val x = "abc" ; import x._ // type java.lang.String import java.lang.String._ // object java.lang.String

    Used by tab completion.

    XXX right now this gets import x._ and import java.lang.String._, but doesn't figure out import String._. There's a lot of ad hoc scope twiddling which should be swept away in favor of digging into the compiler scopes.

    Definition Classes
    SparkImports

  147. def setContextClassLoader(): Unit

  148. def setExecutionWrapper(code: String): Unit

  149. def settings: Settings

  150. def showCodeIfDebugging(code: String): Unit

  151. def symbolDefString(sym: scala.tools.nsc.Global.Symbol): String

  152. def symbolOfLine(code: String): scala.tools.nsc.Global.Symbol

  153. def symbolOfTerm(id: String): scala.tools.nsc.Global.Symbol

  154. def symbolOfType(id: String): scala.tools.nsc.Global.Symbol

  155. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  156. def terms[T](implicit arg0: ClassTag[T]): scala.tools.nsc.Global.Symbol

  157. def terms(name: String): scala.tools.nsc.Global.Symbol

  158. def toString(): String

    Definition Classes
    AnyRef → Any

  159. var totalSilence: Boolean

  160. def treesForRequestId(id: Int): List[scala.tools.nsc.Global.Tree]

  161. def typeOfExpression(expr: String, silent: Boolean = true): scala.tools.nsc.Global.Type

  162. def typeOfTerm(id: String): scala.tools.nsc.Global.Type

  163. def types[T](implicit arg0: ClassTag[T]): scala.tools.nsc.Global.Symbol

  164. def types(name: String): scala.tools.nsc.Global.Symbol

  165. def unqualifiedIds: List[String]

    Another entry point for tab-completion, ids in scope

  166. def valueOfTerm(id: String): Option[AnyRef]

  167. val virtualDirectory: PlainFile

  168. def visibleTermNames: List[scala.tools.nsc.Global.Name]

  169. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  170. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  171. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  172. def wildcardTypes: List[scala.tools.nsc.Global.Type]

    Definition Classes
    SparkImports

  173. def withoutUnwrapping(op: ⇒ Unit): Unit

  174. def withoutWarnings[T](body: ⇒ T): T

Deprecated Value Members

  1. lazy val compiler: global.type

    Annotations
    @deprecated
    Deprecated

    (Since version 2.9.0) Use global for access to the compiler instance.

Inherited from Logging

Inherited from SparkImports

Inherited from AnyRef

Inherited from Any

Ungrouped