Trait

com.twitter.scalding

BaseReplState

Related Doc: package scalding

Permalink

trait BaseReplState extends AnyRef

Object containing various implicit conversions required to create Scalding flows in the REPL. Most of these conversions come from the com.twitter.scalding.Job class.

Linear Supertypes
AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. BaseReplState
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def asyncExecute[T](execution: Execution[T])(implicit ec: scala.concurrent.ExecutionContext): Future[T]

    Permalink
  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def config: Config

    Permalink
  8. var customConfig: Config

    Permalink

    Configuration to use for REPL executions.

    Configuration to use for REPL executions.

    To make changes, don't forget to assign back to this var: config += "mapred.reduce.tasks" -> 2

  9. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  11. def execute[T](execution: Execution[T]): T

    Permalink
  12. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. var flowDef: FlowDef

    Permalink

    Implicit flowDef for this Scalding shell session.

  14. def fsShell(cmdLine: String): Int

    Permalink

    Access to Hadoop FsShell

    Access to Hadoop FsShell

    cmdLine

    command line parameters for FsShell as a single string

  15. def fsShellExp(cmdArgs: String*): Int

    Permalink

    Access to Hadoop FsShell

    Access to Hadoop FsShell

    cmdArgs

    list of command line parameters for FsShell, one per method argument

  16. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  17. def getEmptyFlowDef: FlowDef

    Permalink

    Gets a new, empty, flow definition.

    Gets a new, empty, flow definition.

    returns

    a new, empty flow definition.

  18. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  19. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  20. var mode: Mode

    Permalink

    Defaults to running in local mode if no mode is specified.

  21. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  22. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  23. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  24. def resetFlowDef(): Unit

    Permalink

    Sets the flow definition in implicit scope to an empty flow definition.

  25. def run(implicit fd: FlowDef, md: Mode): Option[JobStats]

    Permalink

    Runs this pipe as a Scalding job.

    Runs this pipe as a Scalding job.

    Automatically cleans up the flowDef to include only sources upstream from tails.

  26. def shell: BaseScaldingShell

    Permalink
    Attributes
    protected
  27. var storedHdfsMode: Option[Hdfs]

    Permalink

    If the repl is started in Hdfs mode, this field is used to preserve the settings when switching Modes.

  28. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  29. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  30. def useHdfsLocalMode(): Unit

    Permalink
  31. def useHdfsMode(): Unit

    Permalink
  32. def useLocalMode(): Unit

    Permalink

    Switch to Local mode

  33. def useStrictLocalMode(): Unit

    Permalink
  34. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  35. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  36. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped