Package org.apache.flink.configuration

Class NettyShuffleEnvironmentOptions

  • @PublicEvolving
public class NettyShuffleEnvironmentOptions
extends Object
    The set of configuration options relating to network stack.

    • Field Detail

      • DATA_PORT

        public static final ConfigOption<Integer> DATA_PORT
        The default network port the task manager expects to receive transfer envelopes on. The 0 means that the TaskManager searches for a free port.

      • DATA_BIND_PORT

        public static final ConfigOption<String> DATA_BIND_PORT
        The local network port that the task manager listen at for data exchange.

      • DATA_SSL_ENABLED

        public static final ConfigOption<Boolean> DATA_SSL_ENABLED
        Config parameter to override SSL support for taskmanager's data transport.

      • NETWORK_DETAILED_METRICS

        public static final ConfigOption<Boolean> NETWORK_DETAILED_METRICS
        Boolean flag to enable/disable more detailed metrics about inbound/outbound network queue lengths.

      • NETWORK_READ_MAX_REQUIRED_BUFFERS_PER_GATE

        @Experimental
public static final ConfigOption<Integer> NETWORK_READ_MAX_REQUIRED_BUFFERS_PER_GATE
        The maximum number of network read buffers that are required by an input gate. (An input gate is responsible for reading data from all subtasks of an upstream task.) The number of buffers needed by an input gate is dynamically calculated in runtime, depending on various factors (e.g., the parallelism of the upstream task). Among the calculated number of needed buffers, the part below this configured value is required, while the excess part, if any, is optional. A task will fail if the required buffers cannot be obtained in runtime. A task will not fail due to not obtaining optional buffers, but may suffer a performance reduction.

      • NETWORK_SORT_SHUFFLE_MIN_BUFFERS

        public static final ConfigOption<Integer> NETWORK_SORT_SHUFFLE_MIN_BUFFERS
        Minimum number of network buffers required per blocking result partition for sort-shuffle.

      • NETWORK_BUFFERS_REQUEST_TIMEOUT

        public static final ConfigOption<Duration> NETWORK_BUFFERS_REQUEST_TIMEOUT
        The timeout for requesting buffers for each channel.

      • NETWORK_HYBRID_SHUFFLE_EXTERNAL_REMOTE_TIER_FACTORY_CLASS_NAME

        @Experimental
public static final ConfigOption<String> NETWORK_HYBRID_SHUFFLE_EXTERNAL_REMOTE_TIER_FACTORY_CLASS_NAME
        The option to configure the tiered factory creator remote class name for hybrid shuffle.

      • NETWORK_HYBRID_SHUFFLE_REMOTE_STORAGE_BASE_PATH

        @Experimental
public static final ConfigOption<String> NETWORK_HYBRID_SHUFFLE_REMOTE_STORAGE_BASE_PATH
        The option to configure the base remote storage path for hybrid shuffle.

      • TCP_CONNECTION_REUSE_ACROSS_JOBS_ENABLED

        public static final ConfigOption<Boolean> TCP_CONNECTION_REUSE_ACROSS_JOBS_ENABLED
        Whether to reuse tcp connections across multi jobs. If set to true, tcp connections will not be released after job finishes. The subsequent jobs will be free from the overhead of the connection re-establish. However, this may lead to an increase in the total number of connections on your machine. When it reaches the upper limit, you can set it to false to release idle connections.

      • CLIENT_CONNECT_TIMEOUT_SECONDS

        public static final ConfigOption<Integer> CLIENT_CONNECT_TIMEOUT_SECONDS

      • CLIENT_TCP_KEEP_IDLE_SECONDS

        public static final ConfigOption<Integer> CLIENT_TCP_KEEP_IDLE_SECONDS

      • CLIENT_TCP_KEEP_INTERVAL_SECONDS

        public static final ConfigOption<Integer> CLIENT_TCP_KEEP_INTERVAL_SECONDS

      • NETWORK_REQUEST_BACKOFF_INITIAL

        public static final ConfigOption<Integer> NETWORK_REQUEST_BACKOFF_INITIAL
        Minimum backoff for partition requests of input channels.

      • NETWORK_REQUEST_BACKOFF_MAX

        public static final ConfigOption<Integer> NETWORK_REQUEST_BACKOFF_MAX
        Maximum backoff for partition requests of input channels.

      • NETWORK_PARTITION_REQUEST_TIMEOUT

        public static final ConfigOption<Duration> NETWORK_PARTITION_REQUEST_TIMEOUT
        The timeout for partition request listener in result partition manager.