Class BlobServerOptions


  • @PublicEvolving
    public class BlobServerOptions
    extends Object
    Configuration options for the BlobServer and BlobCache.
    • Field Detail

      • STORAGE_DIRECTORY

        public static final ConfigOption<String> STORAGE_DIRECTORY
        The config parameter defining the storage directory to be used by the blob server.
      • FETCH_RETRIES

        public static final ConfigOption<Integer> FETCH_RETRIES
        The config parameter defining number of retires for failed BLOB fetches.
      • FETCH_CONCURRENT

        public static final ConfigOption<Integer> FETCH_CONCURRENT
        The config parameter defining the maximum number of concurrent BLOB fetches that the JobManager serves.
      • FETCH_BACKLOG

        public static final ConfigOption<Integer> FETCH_BACKLOG
        The config parameter defining the backlog of BLOB fetches on the JobManager.
      • PORT

        public static final ConfigOption<String> PORT
        The config parameter defining the server port of the blob service. The port can either be a port, such as "9123", a range of ports: "50100-50200" or a list of ranges and or points: "50100-50200,50300-50400,51234"

        Setting the port to 0 will let the OS choose an available port.

      • SSL_ENABLED

        public static final ConfigOption<Boolean> SSL_ENABLED
        Flag to override ssl support for the blob service transport.
      • CLEANUP_INTERVAL

        public static final ConfigOption<Long> CLEANUP_INTERVAL
        Cleanup interval of the blob caches at the task managers (in seconds).

        Whenever a job is not referenced at the cache anymore, we set a TTL and let the periodic cleanup task (executed every CLEANUP_INTERVAL seconds) remove its blob files after this TTL has passed. This means that a blob will be retained at most 2 * CLEANUP_INTERVAL seconds after not being referenced anymore. Therefore, a recovery still has the chance to use existing files rather than to download them again.

      • OFFLOAD_MINSIZE

        public static final ConfigOption<Integer> OFFLOAD_MINSIZE
        The minimum size for messages to be offloaded to the BlobServer.
      • SO_TIMEOUT

        public static final ConfigOption<Integer> SO_TIMEOUT
        The socket timeout in milliseconds for the blob client.
      • CONNECT_TIMEOUT

        public static final ConfigOption<Integer> CONNECT_TIMEOUT
        The connection timeout in milliseconds for the blob client.
    • Constructor Detail

      • BlobServerOptions

        public BlobServerOptions()