Package ai.vespa.feed.client.impl

Class DynamicThrottler

java.lang.Object

ai.vespa.feed.client.impl.StaticThrottler

ai.vespa.feed.client.impl.DynamicThrottler

public class DynamicThrottler
extends StaticThrottler

Samples latency as a function of inflight requests, and regularly adjusts to the optimal value.

Author:

jonmv

Field Summary

Fields inherited from class ai.vespa.feed.client.impl.StaticThrottler

maxInflight, minInflight

Constructor Summary

Constructors

Constructor	Description
DynamicThrottler(FeedClientBuilderImpl builder)

Method Summary

Modifier and Type	Method	Description
void	sent(long __, CompletableFuture<ai.vespa.feed.client.HttpResponse> ___)
void	success()
long	targetInflight()
void	throttled(long inflight)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DynamicThrottler

public DynamicThrottler(FeedClientBuilderImpl builder)

Method Detail

sent

public void sent(long __,
                 CompletableFuture<ai.vespa.feed.client.HttpResponse> ___)

Overrides:

sent in class StaticThrottler

success

public void success()

Overrides:

success in class StaticThrottler

throttled

public void throttled(long inflight)

Overrides:

throttled in class StaticThrottler

targetInflight

public long targetInflight()

Overrides:

targetInflight in class StaticThrottler