-
public final class SparkHelperKt
-
-
Method Summary
Modifier and Type Method Description final Unit
withSpark(Map<String, Any> props, String master, String appName, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params final Unit
withSpark(SparkSession.Builder builder, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)
-
-
Method Detail
-
withSpark
@JvmOverloads() final Unit withSpark(Map<String, Any> props, String master, String appName, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)
Wrapper for spark creation which allows to set different spark params- Parameters:
props
- spark options, value types are runtime-checked for type-correctnessmaster
- SparkSession.Builder.masterappName
- SparkSession.Builder.appNamefunc
- function which will be executed in context of KSparkSession (it means that this inside block will point to KSparkSession)
-
withSpark
@JvmOverloads() final Unit withSpark(SparkSession.Builder builder, SparkLogLevel logLevel, Function1<KSparkSession, Unit> func)
-
-
-
-