Interface InferenceComponentRuntimeConfig.Builder

    • Method Detail

      • copyCount

        InferenceComponentRuntimeConfig.Builder copyCount​(Integer copyCount)

        The number of runtime copies of the model container to deploy with the inference component. Each copy can serve inference requests.

        Parameters:
        copyCount - The number of runtime copies of the model container to deploy with the inference component. Each copy can serve inference requests.
        Returns:
        Returns a reference to this object so that method calls can be chained together.