org.apache.spark

ComplexFutureAction

Related Doc: package spark

class ComplexFutureAction[T] extends FutureAction[T]

A FutureAction for actions that could trigger multiple Spark jobs. Examples include take, takeSample. Cancellation works by setting the cancelled flag to true and interrupting the action thread if it is being blocked by a job.

Linear Supertypes
FutureAction[T], Future[T], Awaitable[T], AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ComplexFutureAction
  2. FutureAction
  3. Future
  4. Awaitable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ComplexFutureAction()

Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  4. def andThen[U](pf: PartialFunction[Try[T], U])(implicit executor: ExecutionContext): Future[T]

    Definition Classes
    Future
  5. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  6. def cancel(): Unit

    Cancels the execution of this action.

    Cancels the execution of this action.

    Definition Classes
    ComplexFutureActionFutureAction
  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. def collect[S](pf: PartialFunction[T, S])(implicit executor: ExecutionContext): Future[S]

    Definition Classes
    Future
  9. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  11. def failed: Future[Throwable]

    Definition Classes
    Future
  12. def fallbackTo[U >: T](that: Future[U]): Future[U]

    Definition Classes
    Future
  13. def filter(p: (T) ⇒ Boolean)(implicit executor: ExecutionContext): Future[T]

    Definition Classes
    Future
  14. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  15. def flatMap[S](f: (T) ⇒ Future[S])(implicit executor: ExecutionContext): Future[S]

    Definition Classes
    Future
  16. def foreach[U](f: (T) ⇒ U)(implicit executor: ExecutionContext): Unit

    Definition Classes
    Future
  17. def get(): T

    Blocks and returns the result of this job.

    Blocks and returns the result of this job.

    Definition Classes
    FutureAction
    Annotations
    @throws( classOf[Exception] )
  18. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  19. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  20. def isCancelled: Boolean

    Returns whether the action has been cancelled.

    Returns whether the action has been cancelled.

    Definition Classes
    ComplexFutureActionFutureAction
  21. def isCompleted: Boolean

    Returns whether the action has already been completed with a value or an exception.

    Returns whether the action has already been completed with a value or an exception.

    Definition Classes
    ComplexFutureActionFutureAction → Future
  22. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  23. def jobIds: Seq[Int]

    Returns the job IDs run by the underlying async operation.

    Returns the job IDs run by the underlying async operation.

    This returns the current snapshot of the job list. Certain operations may run multiple jobs, so multiple calls to this method may return different lists.

    Definition Classes
    ComplexFutureActionFutureAction
  24. def map[S](f: (T) ⇒ S)(implicit executor: ExecutionContext): Future[S]

    Definition Classes
    Future
  25. def mapTo[S](implicit tag: ClassTag[S]): Future[S]

    Definition Classes
    Future
  26. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  27. final def notify(): Unit

    Definition Classes
    AnyRef
  28. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  29. def onComplete[U](func: (Try[T]) ⇒ U)(implicit executor: ExecutionContext): Unit

    When this action is completed, either through an exception, or a value, applies the provided function.

    When this action is completed, either through an exception, or a value, applies the provided function.

    Definition Classes
    ComplexFutureActionFutureAction → Future
  30. def onFailure[U](pf: PartialFunction[Throwable, U])(implicit executor: ExecutionContext): Unit

    Definition Classes
    Future
  31. def onSuccess[U](pf: PartialFunction[T, U])(implicit executor: ExecutionContext): Unit

    Definition Classes
    Future
  32. def ready(atMost: Duration)(implicit permit: CanAwait): ComplexFutureAction.this.type

    Blocks until this action completes.

    Blocks until this action completes.

    atMost

    maximum wait time, which may be negative (no waiting is done), Duration.Inf for unbounded waiting, or a finite positive duration

    returns

    this FutureAction

    Definition Classes
    ComplexFutureActionFutureAction → Awaitable
    Annotations
    @throws( classOf[InterruptedException] ) @throws( ... )
  33. def recover[U >: T](pf: PartialFunction[Throwable, U])(implicit executor: ExecutionContext): Future[U]

    Definition Classes
    Future
  34. def recoverWith[U >: T](pf: PartialFunction[Throwable, Future[U]])(implicit executor: ExecutionContext): Future[U]

    Definition Classes
    Future
  35. def result(atMost: Duration)(implicit permit: CanAwait): T

    Awaits and returns the result (of type T) of this action.

    Awaits and returns the result (of type T) of this action.

    atMost

    maximum wait time, which may be negative (no waiting is done), Duration.Inf for unbounded waiting, or a finite positive duration

    returns

    the result value if the action is completed within the specific maximum wait time

    Definition Classes
    ComplexFutureActionFutureAction → Awaitable
    Annotations
    @throws( classOf[Exception] )
    Exceptions thrown

    Exception exception during action execution

  36. def run(func: ⇒ T)(implicit executor: ExecutionContext): ComplexFutureAction.this.type

    Executes some action enclosed in the closure.

    Executes some action enclosed in the closure. To properly enable cancellation, the closure should use runJob implementation in this promise. See takeAsync for example.

  37. def runJob[T, U, R](rdd: RDD[T], processPartition: (Iterator[T]) ⇒ U, partitions: Seq[Int], resultHandler: (Int, U) ⇒ Unit, resultFunc: ⇒ R): Unit

    Runs a Spark job.

    Runs a Spark job. This is a wrapper around the same functionality provided by SparkContext to enable cancellation.

  38. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  39. def toString(): String

    Definition Classes
    AnyRef → Any
  40. def transform[S](s: (T) ⇒ S, f: (Throwable) ⇒ Throwable)(implicit executor: ExecutionContext): Future[S]

    Definition Classes
    Future
  41. def value: Option[Try[T]]

    The value of this Future.

    The value of this Future.

    If the future is not completed the returned value will be None. If the future is completed the value will be Some(Success(t)) if it contains a valid result, or Some(Failure(error)) if it contains an exception.

    Definition Classes
    ComplexFutureActionFutureAction → Future
  42. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  43. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  44. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  45. final def withFilter(p: (T) ⇒ Boolean)(implicit executor: ExecutionContext): Future[T]

    Definition Classes
    Future
  46. def zip[U](that: Future[U]): Future[(T, U)]

    Definition Classes
    Future

Inherited from FutureAction[T]

Inherited from Future[T]

Inherited from Awaitable[T]

Inherited from AnyRef

Inherited from Any

Ungrouped