Package

com.spotify.scio

transforms

Permalink

package transforms

Main package for transforms APIs. Import all.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. transforms
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. abstract class BaseAsyncDoFn[InputT, OutputT, ResourceT, FutureT] extends DoFnWithResource[InputT, OutputT, ResourceT] with Base[FutureT, OutputT]

    Permalink
  2. abstract class BaseAsyncLookupDoFn[A, B, C, F, T] extends DoFn[A, KV[A, T]] with Base[F, B]

    Permalink
  3. implicit final class CustomParallelismSCollection[T] extends AnyVal

    Permalink

    Enhanced version of SCollection with custom parallelism, where parallelism is the number of concurrent DoFn threads per worker (default to number of CPU cores).

  4. abstract class DoFnWithResource[InputT, OutputT, ResourceT] extends DoFn[InputT, OutputT]

    Permalink
  5. class FileDownloadDoFn[OutputT] extends DoFn[URI, OutputT]

    Permalink
  6. class FutureHandlers extends AnyRef

    Permalink
  7. abstract class GuavaAsyncDoFn[InputT, OutputT, ResourceT] extends BaseAsyncDoFn[InputT, OutputT, ResourceT, ListenableFuture[OutputT]] with Guava[OutputT]

    Permalink
  8. abstract class GuavaAsyncLookupDoFn[A, B, C] extends BaseAsyncLookupDoFn[A, B, C, ListenableFuture[B], Try[B]] with Guava[B]

    Permalink
  9. abstract class JavaAsyncDoFn[InputT, OutputT, ResourceT] extends BaseAsyncDoFn[InputT, OutputT, ResourceT, CompletableFuture[OutputT]] with Java[OutputT]

    Permalink
  10. abstract class JavaAsyncLookupDoFn[A, B, C] extends BaseAsyncLookupDoFn[A, B, C, CompletableFuture[B], Try[B]] with Java[B]

    Permalink
  11. class PipeDoFn extends DoFn[String, String]

    Permalink
  12. implicit final class PipeSCollection extends AnyVal

    Permalink

    Enhanced version of SCollection with pipe methods.

  13. class RateLimiterDoFn[InputT] extends DoFnWithResource[InputT, InputT, RateLimiter]

    Permalink
  14. implicit final class RichAsyncLookupDoFnTry[A] extends AnyVal

    Permalink

    Enhanced version of AsyncLookupDoFn.Try with convenience methods.

  15. abstract class ScalaAsyncDoFn[I, O, R] extends BaseAsyncDoFn[I, O, R, Future[O]] with ScalaFutureHandlers[O]

    Permalink

    A DoFn that handles asynchronous requests to an external service that returns Scala Futures.

  16. abstract class ScalaAsyncLookupDoFn[A, B, C] extends BaseAsyncLookupDoFn[A, B, C, Future[B], Try[B]] with ScalaFutureHandlers[B]

    Permalink

    A DoFn that performs asynchronous lookup using the provided client for Scala Future.

    A DoFn that performs asynchronous lookup using the provided client for Scala Future.

    A

    input element type.

    B

    client lookup value type.

    C

    client type.

  17. trait ScalaFutureHandlers[T] extends Base[Future[T], T]

    Permalink

    A FutureHandlers.Base implementation for Scala Future.

  18. implicit final class SpecializedFlatMapSCollection[T] extends AnyVal

    Permalink

    Enhanced version of SCollection with specialized versions of flatMap.

  19. implicit final class URISCollection extends AnyVal

    Permalink

    Enhanced version of SCollection with URI methods.

  20. type AsyncLookupDoFn[A, B, C] = BaseAsyncLookupDoFn[A, B, C, ListenableFuture[_], Try[B]]

    Permalink
    Annotations
    @deprecated
    Deprecated

    (Since version 0.8.0) renamed to BaseAsyncLookupDoFn. see https://spotify.github.io/scio/migrations/v0.8.0-Migration-Guide.html#async-dofns

Deprecated Value Members

  1. object AsyncLookupDoFn extends Serializable

    Permalink
    Annotations
    @deprecated
    Deprecated

    (Since version 0.8.0) renamed to BaseAsyncLookupDoFn. see https://spotify.github.io/scio/migrations/v0.8.0-Migration-Guide.html#async-dofns

Inherited from AnyRef

Inherited from Any

Ungrouped