public interface InferenceRegistryPlugin
Plugins that provide inference services should implement this interface.
There should be a single one in the classpath, as we currently support a single instance for ModelRegistry / InfereceServiceRegistry.
-
Method Summary
Modifier and TypeMethodDescription
-
Method Details
-
getInferenceServiceRegistry
InferenceServiceRegistry getInferenceServiceRegistry() -
getModelRegistry
ModelRegistry getModelRegistry()
-