-
public final class SparkHelperKt
-
-
Method Summary
Modifier and Type Method Description final static UnitwithSpark(Map<String, Object> props, String master, String appName, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)Wrapper for spark creation which allows to set different spark params final static UnitwithSpark(Map<String, Object> props, String master, String appName, Function1<KSparkSession, Unit> func)Wrapper for spark creation which allows to set different spark params final static UnitwithSpark(Map<String, Object> props, String master, Function1<KSparkSession, Unit> func)Wrapper for spark creation which allows to set different spark params final static UnitwithSpark(Map<String, Object> props, Function1<KSparkSession, Unit> func)Wrapper for spark creation which allows to set different spark params final static UnitwithSpark(Function1<KSparkSession, Unit> func)Wrapper for spark creation which allows to set different spark params final static UnitwithSpark(SparkSession.Builder builder, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)final static UnitwithSpark(SparkSession.Builder builder, Function1<KSparkSession, Unit> func)-
-
Method Detail
-
withSpark
@JvmOverloads() final static Unit withSpark(Map<String, Object> props, String master, String appName, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params
- Parameters:
props- spark options, value types are runtime-checked for type-correctnessmaster- SparkSession.Builder.appName- SparkSession.Builder.func- function which will be executed in context of KSparkSession (it means thatthisinside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final static Unit withSpark(Map<String, Object> props, String master, String appName, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params
- Parameters:
props- spark options, value types are runtime-checked for type-correctnessmaster- SparkSession.Builder.appName- SparkSession.Builder.func- function which will be executed in context of KSparkSession (it means thatthisinside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final static Unit withSpark(Map<String, Object> props, String master, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params
- Parameters:
props- spark options, value types are runtime-checked for type-correctnessmaster- SparkSession.Builder.func- function which will be executed in context of KSparkSession (it means thatthisinside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final static Unit withSpark(Map<String, Object> props, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params
- Parameters:
props- spark options, value types are runtime-checked for type-correctnessfunc- function which will be executed in context of KSparkSession (it means thatthisinside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final static Unit withSpark(Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params
- Parameters:
func- function which will be executed in context of KSparkSession (it means thatthisinside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final static Unit withSpark(SparkSession.Builder builder, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)
-
withSpark
@JvmOverloads() final static Unit withSpark(SparkSession.Builder builder, Function1<KSparkSession, Unit> func)
-
-
-
-