Interface ModelProvider

  • All Known Subinterfaces:
    AsyncPredictRuntimeProvider, PredictRuntimeProvider

    @PublicEvolving
    public interface ModelProvider
    Model Provider defines how to handle models from a particular provider. For example, how to do model inference for the models from a provider.

    There could be but not limited to these types of model providers:

    • Public vendors. (e.g.OpenAI, Anthropic, Deepseek etc.)
    • Flink native. (model trained natively by Flink)
    • Method Detail

      • copy

        ModelProvider copy()
        Creates a copy of this instance during planning. The copy should be a deep copy of all mutable members.