com.twitter.scalding

Config

trait Config extends AnyRef

This is a wrapper class on top of Map[String, String]

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Config
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def toMap: Map[String, String]

Concrete Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. def +(kv: (String, String)): Config

  5. def ++(that: Config): Config

  6. def -(k: String): Config

  7. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  8. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  9. def addReducerEstimator(clsName: String): Config

    Prepend an estimator so it will be tried first.

    Prepend an estimator so it will be tried first. If it returns None, the previously-set estimators will be tried in order.

  10. def addReducerEstimator[T](cls: Class[T]): Config

    Prepend an estimator so it will be tried first.

    Prepend an estimator so it will be tried first. If it returns None, the previously-set estimators will be tried in order.

  11. def addUniqueId(u: UniqueID): Config

  12. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  13. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  14. def ensureUniqueId: (UniqueID, Config)

    Allocate a new UniqueID if there is not one present

  15. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  16. def equals(that: Any): Boolean

    Definition Classes
    Config → AnyRef → Any
  17. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  18. def get(key: String): Option[String]

  19. def getArgs: Args

  20. def getCascadingAppJar: Option[Try[Class[_]]]

    Returns None if not set, otherwise reflection is used to create the Class.

    Returns None if not set, otherwise reflection is used to create the Class.forName

  21. def getCascadingAppName: Option[String]

  22. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  23. def getKryo: Option[KryoInstantiator]

  24. def getNumReducers: Option[Int]

    Get the number of reducers (this is the parameter Hadoop will use)

  25. def getScaldingVersion: Option[String]

  26. def getSubmittedTimestamp: Option[RichDate]

  27. def getUniqueId: Option[UniqueID]

  28. def hashCode(): Int

    Definition Classes
    Config → AnyRef → Any
  29. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  30. def maybeSetSubmittedTimestamp(date: RichDate = RichDate.now): (Option[RichDate], Config)

  31. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  32. final def notify(): Unit

    Definition Classes
    AnyRef
  33. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  34. def setArgs(args: Args): Config

  35. def setCascadingAppId(id: String): Config

  36. def setCascadingAppJar(clazz: Class[_]): Config

    Non-fat-jar use cases require this, BUT using it with fat jars can cause problems.

    Non-fat-jar use cases require this, BUT using it with fat jars can cause problems. It is not set by default, but if you have problems you might need to set the Job class here Consider also setting this same class here: setScaldingFlowClass

  37. def setCascadingAppName(name: String): Config

  38. def setDefaultComparator(clazz: Class[_ <: Comparator[_]]): Config

  39. def setHRavenHistoryUserName: Config

    Set username from System.

    Set username from System.used for querying hRaven.

  40. def setListSpillThreshold(count: Int): Config

  41. def setMapSideAggregationThreshold(count: Int): Config

  42. def setMapSpillThreshold(count: Int): Config

  43. def setNumReducers(n: Int): Config

  44. def setReducerEstimators(clsList: String): Config

    Set the entire list of reducer estimators (overriding the existing list)

  45. def setScaldingFlowClass(clazz: Class[_]): Config

  46. def setScaldingVersion: Config

  47. def setSerialization(kryo: Either[(Class[_ <: KryoInstantiator], KryoInstantiator), Class[_ <: KryoInstantiator]], userHadoop: Seq[Class[_ <: Serialization[_]]] = Nil): Config

  48. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  49. def toString(): String

    Definition Classes
    AnyRef → Any
  50. def update[R](k: String)(fn: (Option[String]) ⇒ (Option[String], R)): (R, Config)

  51. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  52. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  53. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped