ParallelInference.Builder |
ParallelInference.Builder.batchLimit(int limit) |
This method defines, how many input samples can
be batched within given time frame.
|
ParallelInference.Builder |
ParallelInference.Builder.inferenceMode(@NonNull InferenceMode inferenceMode) |
This method allows you to define mode that'll be used during inference.
|
ParallelInference.Builder |
ParallelInference.Builder.loadBalanceMode(@NonNull LoadBalanceMode loadBalanceMode) |
This method allows you to specify load balance mode
|
ParallelInference.Builder |
ParallelInference.Builder.queueLimit(int limit) |
This method defines buffer queue size.
|
ParallelInference.Builder |
ParallelInference.Builder.workers(int workers) |
This method defines, how many model copies will be used for inference.
|