package client
- Alphabetic
- By Inheritance
- client
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Type Members
- class ArtifactManager extends AnyRef
The Artifact Manager is responsible for handling and transferring artifacts from the local client to the server (local/remote).
- trait ClassFinder extends AnyRef
- class ExecutePlanResponseReattachableIterator extends WrappedCloseableIterator[ExecutePlanResponse] with Logging
Retryable iterator of ExecutePlanResponses to an ExecutePlan call.
Retryable iterator of ExecutePlanResponses to an ExecutePlan call.
It can handle situations when:
- the ExecutePlanResponse stream was broken by retryable network error (governed by retryPolicy)
- the ExecutePlanResponse was gracefully ended by the server without a ResultComplete message; this tells the client that there is more, and it should reattach to continue.
Initial iterator is the result of an ExecutePlan on the request, but it can be reattached with ReattachExecute request. ReattachExecute request is provided the responseId of last returned ExecutePlanResponse on the iterator to return a new iterator from server that continues after that. If the initial ExecutePlan did not even reach the server, and hence reattach fails with INVALID_HANDLE.OPERATION_NOT_FOUND or INVALID_HANDLE.SESSION_NOT_FOUND, we attempt to retry ExecutePlan.
In reattachable execute the server does buffer some responses in case the client needs to backtrack. To let server release this buffer sooner, this iterator asynchronously sends ReleaseExecute RPCs that instruct the server to release responses that it already processed.
- class REPLClassDirMonitor extends ClassFinder
A generic ClassFinder implementation that traverses a specific REPL output directory.
- class ResponseValidator extends Logging
- class RetriesExceeded extends Throwable
Represents an exception which was considered retriable but has exceeded retry limits.
Represents an exception which was considered retriable but has exceeded retry limits.
The actual exceptions incurred can be retrieved with getSuppressed()
- case class RetryPolicy(maxRetries: Option[Int] = None, initialBackoff: FiniteDuration = FiniteDuration(1000, "ms"), maxBackoff: Option[FiniteDuration] = None, backoffMultiplier: Double = 1.0, jitter: FiniteDuration = FiniteDuration(0, "s"), minJitterThreshold: FiniteDuration = FiniteDuration(0, "s"), canRetry: (Throwable) => Boolean, name: String) extends Product with Serializable
RetryPolicy configure the retry mechanism in GrpcRetryHandler
RetryPolicy configure the retry mechanism in GrpcRetryHandler
- maxRetries
Maximum number of retries.
- initialBackoff
Start value of the exponential backoff (ms).
- maxBackoff
Maximal value of the exponential backoff (ms).
- backoffMultiplier
Multiplicative base of the exponential backoff.
- canRetry
Function that determines whether a retry is to be performed in the event of an error.
- class SparkConnectStubState extends Logging
- case class ToStub(value: Long) extends Product with Serializable
Class used to test stubbing.
Class used to test stubbing. This needs to be in the main source tree, because this is not synced with the connect server during tests.
Value Members
- object RetryPolicy extends Serializable
- object SparkConnectClient