Class/Object

io.eels

SourceFrame

Related Docs: object SourceFrame | package eels

Permalink

class SourceFrame extends Frame with Logging

Linear Supertypes
Logging, Frame, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SourceFrame
  2. Logging
  3. Frame
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SourceFrame(source: Source, listener: Listener = NoopListener)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. def ++(other: Frame): Frame

    Permalink

    Joins two frames together, such that the elements of the given frame are appended to the end of this frame.

    Joins two frames together, such that the elements of the given frame are appended to the end of this frame. This operation is the same as a concat operation.

    Definition Classes
    Frame
  4. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  5. def addField(field: Field, defaultValue: Any): Frame

    Permalink

    Returns a new Frame with the given field added at the end.

    Returns a new Frame with the given field added at the end. The value of this field for each Row is specified by the default value. The value must be compatible with the field definition. Eg, an error will occur if the field had type Int and the default value was 1.3

    Definition Classes
    Frame
  6. def addField(name: String, defaultValue: Any): Frame

    Permalink

    Returns a new Frame with the new field of type String added at the end.

    Returns a new Frame with the new field of type String added at the end. The value of this field for each Row is specified by the default value.

    Definition Classes
    Frame
  7. def addFieldIfNotExists(field: Field, defaultValue: Any): Frame

    Permalink
    Definition Classes
    Frame
  8. def addFieldIfNotExists(name: String, defaultValue: Any): Frame

    Permalink
    Definition Classes
    Frame
  9. def aggregated(): GroupedFrame

    Permalink
    Definition Classes
    Frame
  10. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  11. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  12. def collect(): Vector[Row]

    Permalink
    Definition Classes
    Frame
  13. def count(): Long

    Permalink
    Definition Classes
    Frame
  14. def drop(k: Int): Frame

    Permalink
    Definition Classes
    Frame
  15. def dropNullRows(): Frame

    Permalink
    Definition Classes
    Frame
  16. def dropWhile(fieldName: String, pred: (Any) ⇒ Boolean): Frame

    Permalink
    Definition Classes
    Frame
  17. def dropWhile(pred: (Row) ⇒ Boolean): Frame

    Permalink
    Definition Classes
    Frame
  18. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  19. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  20. def exists(p: (Row) ⇒ Boolean): Boolean

    Permalink
    Definition Classes
    Frame
  21. def explode(fn: (Row) ⇒ Seq[Row]): Frame

    Permalink
    Definition Classes
    Frame
  22. def filter(fieldName: String, p: (Any) ⇒ Boolean): Frame

    Permalink

    Filters where the given field name matches the given predicate.

    Filters where the given field name matches the given predicate.

    Definition Classes
    Frame
  23. def filter(p: (Row) ⇒ Boolean): Frame

    Permalink
    Definition Classes
    Frame
  24. def filterNot(p: (Row) ⇒ Boolean): Frame

    Permalink
    Definition Classes
    Frame
  25. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  26. def find(p: (Row) ⇒ Boolean): Option[Row]

    Permalink
    Definition Classes
    Frame
  27. def fold[A](initial: A)(fn: (A, Row) ⇒ A): A

    Permalink
    Definition Classes
    Frame
  28. def forall(p: (Row) ⇒ Boolean): Boolean

    Permalink
    Definition Classes
    Frame
  29. def foreach[U](fn: (Row) ⇒ U): Frame

    Permalink

    Execute a side effecting function for every row in the frame, returning the same row.

    Execute a side effecting function for every row in the frame, returning the same row.

    fn

    the function to execute

    returns

    this frame, to allow for builder style chaining

    Definition Classes
    Frame
  30. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  31. def groupBy(fn: (Row) ⇒ Any): GroupedFrame

    Permalink
    Definition Classes
    Frame
  32. def groupBy(fields: Iterable[String]): GroupedFrame

    Permalink
    Definition Classes
    Frame
  33. def groupBy(first: String, rest: String*): GroupedFrame

    Permalink
    Definition Classes
    Frame
  34. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  35. def head(): Row

    Permalink
    Definition Classes
    Frame
  36. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  37. def join(other: Frame): Frame

    Permalink

    Combines two frames together such that the fields from this frame are joined with the fields of the given frame.

    Combines two frames together such that the fields from this frame are joined with the fields of the given frame. Eg, if this frame has A,B and the given frame has C,D then the result will be A,B,C,D

    Definition Classes
    Frame
  38. def listener(listener: Listener): Frame

    Permalink
    Definition Classes
    Frame
  39. val logger: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  40. def map(f: (Row) ⇒ Row): Frame

    Permalink
    Definition Classes
    Frame
  41. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  42. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  43. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  44. def projection(fields: Seq[String]): Frame

    Permalink

    Returns a new frame which contains the given list of fields from the existing frame.

    Returns a new frame which contains the given list of fields from the existing frame.

    Definition Classes
    Frame
  45. def projection(first: String, rest: String*): Frame

    Permalink
    Definition Classes
    Frame
  46. def projectionExpression(expr: String): Frame

    Permalink
    Definition Classes
    Frame
  47. def removeField(fieldName: String, caseSensitive: Boolean = true): Frame

    Permalink
    Definition Classes
    Frame
  48. def renameField(nameFrom: String, nameTo: String): Frame

    Permalink
    Definition Classes
    Frame
  49. def replace(fieldName: String, fn: (Any) ⇒ Any): Frame

    Permalink

    For each row, the value corresponding to the given fieldName is applied to the function.

    For each row, the value corresponding to the given fieldName is applied to the function. The result of the function is the new value for that cell.

    Definition Classes
    Frame
  50. def replace(fieldName: String, from: String, target: Any): Frame

    Permalink

    Replaces any values that match "form" with the value "target".

    Replaces any values that match "form" with the value "target". This operation only applies to the field name specified.

    Definition Classes
    Frame
  51. def replace(from: String, target: Any): Frame

    Permalink

    Foreach row, any values that match "from" will be replaced with "target".

    Foreach row, any values that match "from" will be replaced with "target". This operation applies to all values for all rows.

    Definition Classes
    Frame
  52. def replaceFieldType(from: DataType, toType: DataType): Frame

    Permalink
    Definition Classes
    Frame
  53. def replaceNullValues(defaultValue: String): Frame

    Permalink
    Definition Classes
    Frame
  54. def rows(): CloseableIterator[Row]

    Permalink
    Definition Classes
    SourceFrameFrame
  55. def sample(k: Int): Frame

    Permalink

    Returns a new Frame where only each "k" row is retained.

    Returns a new Frame where only each "k" row is retained. Ie, if sample is 2, then on average, every other row will be returned. If sample is 10 then only 10% of rows will be returned. When running concurrently, the rows that are sampled will vary depending on the ordering that the workers pull through the rows. Each stream (thread) uses its own count for the sample.

    Definition Classes
    Frame
  56. def save(sink: Sink, listener: Listener = NoopListener): Long

    Permalink
    Definition Classes
    Frame
  57. lazy val schema: StructType

    Permalink
    Definition Classes
    SourceFrameFrame
  58. def size(): Long

    Permalink
    Definition Classes
    Frame
  59. def stripCharsFromFieldNames(chars: Seq[Char]): Frame

    Permalink

    Returns a new Frame with the same data as this frame, but where the field names have been sanitized by removing any occurances of the given characters.

    Returns a new Frame with the same data as this frame, but where the field names have been sanitized by removing any occurances of the given characters.

    Definition Classes
    Frame
  60. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  61. def take(n: Int): Frame

    Permalink
    Definition Classes
    Frame
  62. def takeWhile(fieldName: String, pred: (Any) ⇒ Boolean): Frame

    Permalink
    Definition Classes
    Frame
  63. def takeWhile(pred: (Row) ⇒ Boolean): Frame

    Permalink
    Definition Classes
    Frame
  64. def to(sink: Sink, listener: Listener = NoopListener): Long

    Permalink
    Definition Classes
    Frame
  65. def toSeq(): Seq[Row]

    Permalink
    Definition Classes
    Frame
  66. def toSet(): Set[Row]

    Permalink
    Definition Classes
    Frame
  67. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  68. def toVector(): Vector[Row]

    Permalink
    Definition Classes
    Frame
  69. def union(other: Frame): Frame

    Permalink
    Definition Classes
    Frame
  70. def updateField(field: Field): Frame

    Permalink
    Definition Classes
    Frame
  71. def updateFieldType(fieldName: String, fieldType: DataType): Frame

    Permalink
    Definition Classes
    Frame
  72. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  73. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  74. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  75. def withLowerCaseSchema(): Frame

    Permalink

    Returns a new Frame where the schema has been lowercased.

    Returns a new Frame where the schema has been lowercased. This does not affect values.

    Definition Classes
    Frame

Deprecated Value Members

  1. def toList(): List[Row]

    Permalink
    Definition Classes
    Frame
    Annotations
    @deprecated
    Deprecated

    now returns a vector

Inherited from Logging

Inherited from Frame

Inherited from AnyRef

Inherited from Any

Ungrouped