-
public final class SparkHelperKt
-
-
Method Summary
Modifier and Type Method Description final static Unit
withSpark(Map<String, Object> props, String master, String appName, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params final static Unit
withSpark(Map<String, Object> props, String master, String appName, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params final static Unit
withSpark(Map<String, Object> props, String master, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params final static Unit
withSpark(Map<String, Object> props, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params final static Unit
withSpark(Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params final static Unit
withSpark(SparkSession.Builder builder, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)
final static Unit
withSpark(SparkSession.Builder builder, Function1<KSparkSession, Unit> func)
-
-
Method Detail
-
withSpark
@JvmOverloads() final static Unit withSpark(Map<String, Object> props, String master, String appName, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params
- Parameters:
props
- spark options, value types are runtime-checked for type-correctnessmaster
- SparkSession.Builder.appName
- SparkSession.Builder.func
- function which will be executed in context of KSparkSession (it means thatthis
inside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final static Unit withSpark(Map<String, Object> props, String master, String appName, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params
- Parameters:
props
- spark options, value types are runtime-checked for type-correctnessmaster
- SparkSession.Builder.appName
- SparkSession.Builder.func
- function which will be executed in context of KSparkSession (it means thatthis
inside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final static Unit withSpark(Map<String, Object> props, String master, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params
- Parameters:
props
- spark options, value types are runtime-checked for type-correctnessmaster
- SparkSession.Builder.func
- function which will be executed in context of KSparkSession (it means thatthis
inside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final static Unit withSpark(Map<String, Object> props, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params
- Parameters:
props
- spark options, value types are runtime-checked for type-correctnessfunc
- function which will be executed in context of KSparkSession (it means thatthis
inside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final static Unit withSpark(Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params
- Parameters:
func
- function which will be executed in context of KSparkSession (it means thatthis
inside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final static Unit withSpark(SparkSession.Builder builder, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)
-
withSpark
@JvmOverloads() final static Unit withSpark(SparkSession.Builder builder, Function1<KSparkSession, Unit> func)
-
-
-
-