Class/Object

org.apache.spark.streaming.api.java

JavaSnappyStreamingContext

Related Docs: object JavaSnappyStreamingContext | package java

Permalink

class JavaSnappyStreamingContext extends JavaStreamingContext

Linear Supertypes
JavaStreamingContext, Closeable, AutoCloseable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. JavaSnappyStreamingContext
  2. JavaStreamingContext
  3. Closeable
  4. AutoCloseable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new JavaSnappyStreamingContext(path: String, sparkContext: JavaSparkContext)

    Permalink

    Recreate a JavaSnappyStreamingContext from a checkpoint file using an existing SparkContext.

    Recreate a JavaSnappyStreamingContext from a checkpoint file using an existing SparkContext.

    path

    Path to the directory that was specified as the checkpoint directory

    sparkContext

    Existing SparkContext

  2. new JavaSnappyStreamingContext(path: String)

    Permalink

    Recreate a JavaSnappyStreamingContext from a checkpoint file.

    Recreate a JavaSnappyStreamingContext from a checkpoint file.

    path

    Path to the directory that was specified as the checkpoint directory

  3. new JavaSnappyStreamingContext(path: String, hadoopConf: Configuration)

    Permalink

    Recreate a JavaSnappyStreamingContext from a checkpoint file.

    Recreate a JavaSnappyStreamingContext from a checkpoint file.

    path

    Path to the directory that was specified as the checkpoint directory

    hadoopConf

    Optional, configuration object if necessary for reading from HDFS compatible filesystems

  4. new JavaSnappyStreamingContext(conf: SparkConf, batchDuration: Duration)

    Permalink

    Create a JavaSnappyStreamingContext by providing the configuration necessary for a new SparkContext.

    Create a JavaSnappyStreamingContext by providing the configuration necessary for a new SparkContext.

    conf

    a org.apache.spark.SparkConf object specifying Spark parameters

    batchDuration

    the time interval at which streaming data will be divided into batches

  5. new JavaSnappyStreamingContext(sparkContext: JavaSparkContext, batchDuration: Duration)

    Permalink

    Create a JavaSnappyStreamingContext using an existing SparkContext.

    Create a JavaSnappyStreamingContext using an existing SparkContext.

    sparkContext

    existing SparkContext

    batchDuration

    the time interval at which streaming data will be divided into batches

  6. new JavaSnappyStreamingContext(sparkContext: JavaSparkContext, checkpoint: Checkpoint, batchDuration: Duration)

    Permalink

    Create a JavaSnappyStreamingContext using an existing SparkContext.

    Create a JavaSnappyStreamingContext using an existing SparkContext.

    sparkContext

    existing SparkContext

    checkpoint

    checkpoint directory

    batchDuration

    the time interval at which streaming data will be divided into batches

  7. new JavaSnappyStreamingContext(snsc: SnappyStreamingContext)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def addStreamingListener(streamingListener: StreamingListener): Unit

    Permalink
    Definition Classes
    JavaStreamingContext
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def awaitTermination(): Unit

    Permalink
    Definition Classes
    JavaStreamingContext
    Annotations
    @throws( ... )
  7. def awaitTerminationOrTimeout(timeout: Long): Boolean

    Permalink
    Definition Classes
    JavaStreamingContext
    Annotations
    @throws( ... )
  8. def binaryRecordsStream(directory: String, recordLength: Int): JavaDStream[Array[Byte]]

    Permalink
    Definition Classes
    JavaStreamingContext
  9. def checkpoint(directory: String): Unit

    Permalink
    Definition Classes
    JavaStreamingContext
  10. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  11. def close(): Unit

    Permalink
    Definition Classes
    JavaStreamingContext → Closeable → AutoCloseable
  12. def createSchemaDStream(rowStream: JavaDStream[_], beanClass: Class[_]): SchemaDStream

    Permalink
  13. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  14. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  15. def fileStream[K, V, F <: InputFormat[K, V]](directory: String, kClass: Class[K], vClass: Class[V], fClass: Class[F], filter: Function[Path, Boolean], newFilesOnly: Boolean, conf: Configuration): JavaPairInputDStream[K, V]

    Permalink
    Definition Classes
    JavaStreamingContext
  16. def fileStream[K, V, F <: InputFormat[K, V]](directory: String, kClass: Class[K], vClass: Class[V], fClass: Class[F], filter: Function[Path, Boolean], newFilesOnly: Boolean): JavaPairInputDStream[K, V]

    Permalink
    Definition Classes
    JavaStreamingContext
  17. def fileStream[K, V, F <: InputFormat[K, V]](directory: String, kClass: Class[K], vClass: Class[V], fClass: Class[F]): JavaPairInputDStream[K, V]

    Permalink
    Definition Classes
    JavaStreamingContext
  18. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  19. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  20. def getSchemaDStream(tableName: String): SchemaDStream

    Permalink
  21. def getState(): StreamingContextState

    Permalink
    Definition Classes
    JavaStreamingContext
  22. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  23. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  24. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  25. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  26. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  27. def queueStream[T](queue: Queue[JavaRDD[T]], oneAtATime: Boolean, defaultRDD: JavaRDD[T]): JavaInputDStream[T]

    Permalink
    Definition Classes
    JavaStreamingContext
  28. def queueStream[T](queue: Queue[JavaRDD[T]], oneAtATime: Boolean): JavaInputDStream[T]

    Permalink
    Definition Classes
    JavaStreamingContext
  29. def queueStream[T](queue: Queue[JavaRDD[T]]): JavaDStream[T]

    Permalink
    Definition Classes
    JavaStreamingContext
  30. def rawSocketStream[T](hostname: String, port: Int): JavaReceiverInputDStream[T]

    Permalink
    Definition Classes
    JavaStreamingContext
  31. def rawSocketStream[T](hostname: String, port: Int, storageLevel: StorageLevel): JavaReceiverInputDStream[T]

    Permalink
    Definition Classes
    JavaStreamingContext
  32. def receiverStream[T](receiver: Receiver[T]): JavaReceiverInputDStream[T]

    Permalink
    Definition Classes
    JavaStreamingContext
  33. def registerCQ(queryStr: String): SchemaDStream

    Permalink

    Registers and executes given SQL query and returns SchemaDStream to consume the results

  34. def registerPythonCQ(queryStr: String): JavaDStream[Row]

    Permalink

    Registers and executes given SQL query and returns SchemaDStream to consume the results

  35. def remember(duration: Duration): Unit

    Permalink
    Definition Classes
    JavaStreamingContext
  36. def snappySession: SnappySession

    Permalink
  37. val snsc: SnappyStreamingContext

    Permalink
  38. def socketStream[T](hostname: String, port: Int, converter: Function[InputStream, Iterable[T]], storageLevel: StorageLevel): JavaReceiverInputDStream[T]

    Permalink
    Definition Classes
    JavaStreamingContext
  39. def socketTextStream(hostname: String, port: Int): JavaReceiverInputDStream[String]

    Permalink
    Definition Classes
    JavaStreamingContext
  40. def socketTextStream(hostname: String, port: Int, storageLevel: StorageLevel): JavaReceiverInputDStream[String]

    Permalink
    Definition Classes
    JavaStreamingContext
  41. val sparkContext: JavaSparkContext

    Permalink
    Definition Classes
    JavaStreamingContext
  42. def sql(sqlText: String): Dataset[Row]

    Permalink
  43. val ssc: StreamingContext

    Permalink
    Definition Classes
    JavaStreamingContext
  44. def start(): Unit

    Permalink

    Start the execution of the streams.

    Start the execution of the streams. Also registers population of AQP tables from stream tables if present.

    Definition Classes
    JavaSnappyStreamingContext → JavaStreamingContext
    Exceptions thrown

    IllegalStateException if the JavaSnappyStreamingContext is already stopped

  45. def stop(stopSparkContext: Boolean, stopGracefully: Boolean): Unit

    Permalink
    Definition Classes
    JavaSnappyStreamingContext → JavaStreamingContext
  46. def stop(stopSparkContext: Boolean): Unit

    Permalink
    Definition Classes
    JavaStreamingContext
  47. def stop(): Unit

    Permalink
    Definition Classes
    JavaStreamingContext
  48. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  49. def textFileStream(directory: String): JavaDStream[String]

    Permalink
    Definition Classes
    JavaStreamingContext
  50. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  51. def transform[T](dstreams: List[JavaDStream[_]], transformFunc: Function2[List[JavaRDD[_]], Time, JavaRDD[T]]): JavaDStream[T]

    Permalink
    Definition Classes
    JavaStreamingContext
  52. def transformToPair[K, V](dstreams: List[JavaDStream[_]], transformFunc: Function2[List[JavaRDD[_]], Time, JavaPairRDD[K, V]]): JavaPairDStream[K, V]

    Permalink
    Definition Classes
    JavaStreamingContext
  53. def union[K, V](first: JavaPairDStream[K, V], rest: List[JavaPairDStream[K, V]]): JavaPairDStream[K, V]

    Permalink
    Definition Classes
    JavaStreamingContext
  54. def union[T](first: JavaDStream[T], rest: List[JavaDStream[T]]): JavaDStream[T]

    Permalink
    Definition Classes
    JavaStreamingContext
  55. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  56. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  57. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from JavaStreamingContext

Inherited from Closeable

Inherited from AutoCloseable

Inherited from AnyRef

Inherited from Any

Ungrouped