Interface MultiModelConfig.Builder
-
- All Superinterfaces:
Buildable,CopyableBuilder<MultiModelConfig.Builder,MultiModelConfig>,SdkBuilder<MultiModelConfig.Builder,MultiModelConfig>,SdkPojo
- Enclosing class:
- MultiModelConfig
public static interface MultiModelConfig.Builder extends SdkPojo, CopyableBuilder<MultiModelConfig.Builder,MultiModelConfig>
-
-
Method Summary
All Methods Instance Methods Abstract Methods Modifier and Type Method Description MultiModelConfig.BuildermodelCacheSetting(String modelCacheSetting)Whether to cache models for a multi-model endpoint.MultiModelConfig.BuildermodelCacheSetting(ModelCacheSetting modelCacheSetting)Whether to cache models for a multi-model endpoint.-
Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder
copy
-
Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder
applyMutation, build
-
Methods inherited from interface software.amazon.awssdk.core.SdkPojo
equalsBySdkFields, sdkFields
-
-
-
-
Method Detail
-
modelCacheSetting
MultiModelConfig.Builder modelCacheSetting(String modelCacheSetting)
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to
Disabled.- Parameters:
modelCacheSetting- Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter toDisabled.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
ModelCacheSetting,ModelCacheSetting
-
modelCacheSetting
MultiModelConfig.Builder modelCacheSetting(ModelCacheSetting modelCacheSetting)
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to
Disabled.- Parameters:
modelCacheSetting- Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter toDisabled.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
ModelCacheSetting,ModelCacheSetting
-
-