Hyperparameters

Value parameters

batchSize

Number of examples in each batch. A larger batch size means that model parameters are updated less frequently, but with lower variance.

beta

The beta value for the DPO method. A higher beta value will increase the weight of the penalty between the policy and reference model.

learningRateMultiplier

Scaling factor for the learning rate. A smaller learning rate may be useful to avoid overfitting.

nEpochs

The number of epochs to train the model for. An epoch refers to one full cycle through the training dataset.

Attributes

Companion

object

Graph

Reset zoomHide graphShow graph

Supertypes

trait Serializable

trait Product

trait Equals

class Object

trait Matchable

class Any

Show all