org.apache.flink.python.util

Class PythonConfigUtil

java.lang.Object

org.apache.flink.python.util.PythonConfigUtil

public class PythonConfigUtil
extends Object

A Util class to get the StreamExecutionEnvironment configuration and merged configuration with environment settings.

Field Summary

Fields

Modifier and Type	Field and Description
static String	KEYED_STREAM_VALUE_OPERATOR_NAME
static String	STREAM_KEY_BY_MAP_OPERATOR_NAME
static String	STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME

Constructor Summary

Constructors

Constructor and Description
PythonConfigUtil()

Method Summary

Modifier and Type	Method and Description
static void	configPythonOperator(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)
static org.apache.flink.configuration.Configuration	getEnvConfigWithDependencies(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env) A static method to get the StreamExecutionEnvironment configuration merged with python dependency management configurations.
static org.apache.flink.configuration.Configuration	getEnvironmentConfig(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env) Get the private field StreamExecutionEnvironment#configuration by reflection recursively.
static org.apache.flink.configuration.Configuration	getMergedConfig(org.apache.flink.api.java.ExecutionEnvironment env, org.apache.flink.table.api.TableConfig tableConfig)
static org.apache.flink.configuration.Configuration	getMergedConfig(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, org.apache.flink.table.api.TableConfig tableConfig)
static boolean	isPythonDataStreamOperator(org.apache.flink.api.dag.Transformation<?> transform)
static boolean	isPythonOperator(org.apache.flink.api.dag.Transformation<?> transform)
static void	setPartitionCustomOperatorNumPartitions(List<org.apache.flink.api.dag.Transformation<?>> transformations)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

KEYED_STREAM_VALUE_OPERATOR_NAME

public static final String KEYED_STREAM_VALUE_OPERATOR_NAME

See Also:

Constant Field Values

STREAM_KEY_BY_MAP_OPERATOR_NAME

public static final String STREAM_KEY_BY_MAP_OPERATOR_NAME

See Also:

Constant Field Values

STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME

public static final String STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME

See Also:

Constant Field Values

Constructor Detail

PythonConfigUtil

public PythonConfigUtil()

Method Detail

getEnvConfigWithDependencies

public static org.apache.flink.configuration.Configuration getEnvConfigWithDependencies(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)
                                                                                 throws InvocationTargetException,
                                                                                        IllegalAccessException,
                                                                                        NoSuchFieldException

A static method to get the StreamExecutionEnvironment configuration merged with python dependency management configurations.

Throws:

InvocationTargetException

IllegalAccessException

NoSuchFieldException

getEnvironmentConfig

public static org.apache.flink.configuration.Configuration getEnvironmentConfig(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)
                                                                         throws InvocationTargetException,
                                                                                IllegalAccessException,
                                                                                NoSuchFieldException

Get the private field StreamExecutionEnvironment#configuration by reflection recursively. Then access the field to get the configuration of the given StreamExecutionEnvironment.

Throws:

InvocationTargetException

IllegalAccessException

NoSuchFieldException

configPythonOperator

public static void configPythonOperator(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)
                                 throws IllegalAccessException,
                                        InvocationTargetException,
                                        NoSuchFieldException

Throws:

IllegalAccessException

InvocationTargetException

NoSuchFieldException

getMergedConfig

public static org.apache.flink.configuration.Configuration getMergedConfig(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
                                                                           org.apache.flink.table.api.TableConfig tableConfig)

getMergedConfig

public static org.apache.flink.configuration.Configuration getMergedConfig(org.apache.flink.api.java.ExecutionEnvironment env,
                                                                           org.apache.flink.table.api.TableConfig tableConfig)

isPythonOperator

public static boolean isPythonOperator(org.apache.flink.api.dag.Transformation<?> transform)

isPythonDataStreamOperator

public static boolean isPythonDataStreamOperator(org.apache.flink.api.dag.Transformation<?> transform)

setPartitionCustomOperatorNumPartitions

public static void setPartitionCustomOperatorNumPartitions(List<org.apache.flink.api.dag.Transformation<?>> transformations)