org.deeplearning4j.util

Class NetworkUtils

java.lang.Object

org.deeplearning4j.util.NetworkUtils

public class NetworkUtils
extends Object

Method Summary

Modifier and Type	Method and Description
static void	setLearningRate(ComputationGraph net, double newLr) Set the learning rate for all layers in the network to the specified value.
static void	setLearningRate(ComputationGraph net, org.nd4j.linalg.schedule.ISchedule newLrSchedule) Set the learning rate schedule for all layers in the network to the specified schedule.
static void	setLearningRate(ComputationGraph net, String layerName, double newLr) Set the learning rate for a single layer in the network to the specified value.
static void	setLearningRate(ComputationGraph net, String layerName, org.nd4j.linalg.schedule.ISchedule lrSchedule) Set the learning rate schedule for a single layer in the network to the specified value. Note also that setLearningRate(ComputationGraph, ISchedule) should also be used in preference, when all layers need to be set to a new LR schedule. This schedule will replace any/all existing schedules, and also any fixed learning rate values. Note also that the iteration/epoch counts will not be reset.
static void	setLearningRate(MultiLayerNetwork net, double newLr) Set the learning rate for all layers in the network to the specified value.
static void	setLearningRate(MultiLayerNetwork net, int layerNumber, double newLr) Set the learning rate for a single layer in the network to the specified value.
static void	setLearningRate(MultiLayerNetwork net, int layerNumber, org.nd4j.linalg.schedule.ISchedule lrSchedule) Set the learning rate schedule for a single layer in the network to the specified value. Note also that setLearningRate(MultiLayerNetwork, ISchedule) should also be used in preference, when all layers need to be set to a new LR schedule. This schedule will replace any/all existing schedules, and also any fixed learning rate values. Note also that the iteration/epoch counts will not be reset.
static void	setLearningRate(MultiLayerNetwork net, org.nd4j.linalg.schedule.ISchedule newLrSchedule) Set the learning rate schedule for all layers in the network to the specified schedule.
static ComputationGraph	toComputationGraph(MultiLayerNetwork net) Convert a MultiLayerNetwork to a ComputationGraph

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

toComputationGraph

public static ComputationGraph toComputationGraph(MultiLayerNetwork net)

Convert a MultiLayerNetwork to a ComputationGraph

Returns:

ComputationGraph equivalent to this network (including parameters and updater state)

setLearningRate

public static void setLearningRate(MultiLayerNetwork net,
                                   double newLr)

Set the learning rate for all layers in the network to the specified value. Note that if any learning rate schedules are currently present, these will be removed in favor of the new (fixed) learning rate.

Note: This method not free from a performance point of view: a proper learning rate schedule should be used in preference to calling this method at every iteration.

Parameters:

net - Network to set the LR for

newLr - New learning rate for all layers

setLearningRate

public static void setLearningRate(MultiLayerNetwork net,
                                   org.nd4j.linalg.schedule.ISchedule newLrSchedule)

Set the learning rate schedule for all layers in the network to the specified schedule. This schedule will replace any/all existing schedules, and also any fixed learning rate values.
Note that the iteration/epoch counts will not be reset. Use MultiLayerConfiguration#setIterationCount(int) and MultiLayerConfiguration#setEpochCount(int) if this is required

Parameters:

newLrSchedule - New learning rate schedule for all layers

setLearningRate

public static void setLearningRate(MultiLayerNetwork net,
                                   int layerNumber,
                                   double newLr)

Set the learning rate for a single layer in the network to the specified value. Note that if any learning rate schedules are currently present, these will be removed in favor of the new (fixed) learning rate.

Note: This method not free from a performance point of view: a proper learning rate schedule should be used in preference to calling this method at every iteration. Note also that setLearningRate(MultiLayerNetwork, double) should also be used in preference, when all layers need to be set to a new LR

Parameters:

layerNumber - Number of the layer to set the LR for

newLr - New learning rate for a single layers

setLearningRate

public static void setLearningRate(MultiLayerNetwork net,
                                   int layerNumber,
                                   org.nd4j.linalg.schedule.ISchedule lrSchedule)

Set the learning rate schedule for a single layer in the network to the specified value.
Note also that setLearningRate(MultiLayerNetwork, ISchedule) should also be used in preference, when all layers need to be set to a new LR schedule.
This schedule will replace any/all existing schedules, and also any fixed learning rate values.
Note also that the iteration/epoch counts will not be reset. Use MultiLayerConfiguration#setIterationCount(int) and MultiLayerConfiguration#setEpochCount(int) if this is required

Parameters:

layerNumber - Number of the layer to set the LR schedule for

lrSchedule - New learning rate for a single layer

setLearningRate

public static void setLearningRate(ComputationGraph net,
                                   double newLr)

Set the learning rate for all layers in the network to the specified value. Note that if any learning rate schedules are currently present, these will be removed in favor of the new (fixed) learning rate.

Note: This method not free from a performance point of view: a proper learning rate schedule should be used in preference to calling this method at every iteration.

Parameters:

net - Network to set the LR for

newLr - New learning rate for all layers

setLearningRate

public static void setLearningRate(ComputationGraph net,
                                   org.nd4j.linalg.schedule.ISchedule newLrSchedule)

Set the learning rate schedule for all layers in the network to the specified schedule. This schedule will replace any/all existing schedules, and also any fixed learning rate values.
Note that the iteration/epoch counts will not be reset. Use ComputationGraphConfiguration#setIterationCount(int) and ComputationGraphConfiguration#setEpochCount(int) if this is required

Parameters:

newLrSchedule - New learning rate schedule for all layers

setLearningRate

public static void setLearningRate(ComputationGraph net,
                                   String layerName,
                                   double newLr)

Set the learning rate for a single layer in the network to the specified value. Note that if any learning rate schedules are currently present, these will be removed in favor of the new (fixed) learning rate.

Note: This method not free from a performance point of view: a proper learning rate schedule should be used in preference to calling this method at every iteration. Note also that setLearningRate(ComputationGraph, double) should also be used in preference, when all layers need to be set to a new LR

Parameters:

layerName - Name of the layer to set the LR for

newLr - New learning rate for a single layers

setLearningRate

public static void setLearningRate(ComputationGraph net,
                                   String layerName,
                                   org.nd4j.linalg.schedule.ISchedule lrSchedule)

Set the learning rate schedule for a single layer in the network to the specified value.
Note also that setLearningRate(ComputationGraph, ISchedule) should also be used in preference, when all layers need to be set to a new LR schedule.
This schedule will replace any/all existing schedules, and also any fixed learning rate values.
Note also that the iteration/epoch counts will not be reset. Use ComputationGraphConfiguration#setIterationCount(int) and ComputationGraphConfiguration#setEpochCount(int) if this is required

Parameters:

layerName - Name of the layer to set the LR schedule for

lrSchedule - New learning rate for a single layer