org.deeplearning4j.optimize.solvers

Class LineGradientDescent

java.lang.Object

org.deeplearning4j.optimize.solvers.BaseOptimizer

org.deeplearning4j.optimize.solvers.LineGradientDescent

All Implemented Interfaces:

Serializable, ConvexOptimizer

public class LineGradientDescent
extends BaseOptimizer

Stochastic Gradient Descent with Line Search

Author:

Adam Gibson

See Also:

Serialized Form

Field Summary

Fields inherited from class org.deeplearning4j.optimize.solvers.BaseOptimizer

computationGraphUpdater, conf, GRADIENT_KEY, iteration, iterationListeners, lineMaximizer, log, model, oldScore, PARAMS_KEY, score, SCORE_KEY, SEARCH_DIR, searchState, step, stepFunction, stepMax, terminationConditions, updater

Constructor Summary

Constructors

Constructor and Description
LineGradientDescent(NeuralNetConfiguration conf, StepFunction stepFunction, Collection<IterationListener> iterationListeners, Collection<TerminationCondition> terminationConditions, Model model)
LineGradientDescent(NeuralNetConfiguration conf, StepFunction stepFunction, Collection<IterationListener> iterationListeners, Model model)

Method Summary

Modifier and Type	Method and Description
void	postStep(org.nd4j.linalg.api.ndarray.INDArray gradient) Post step to update searchDirection with new gradient and parameter information
void	preProcessLine() Pre preProcess to setup initial searchDirection approximation

Methods inherited from class org.deeplearning4j.optimize.solvers.BaseOptimizer

batchSize, checkTerminalConditions, getComputationGraphUpdater, getConf, getDefaultStepFunctionForOptimizer, getUpdater, gradientAndScore, optimize, postFirstStep, score, setBatchSize, setListeners, setUpdater, setUpdaterComputationGraph, setupSearchState, updateGradientAccordingToParams

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LineGradientDescent

public LineGradientDescent(NeuralNetConfiguration conf,
                           StepFunction stepFunction,
                           Collection<IterationListener> iterationListeners,
                           Model model)

LineGradientDescent

public LineGradientDescent(NeuralNetConfiguration conf,
                           StepFunction stepFunction,
                           Collection<IterationListener> iterationListeners,
                           Collection<TerminationCondition> terminationConditions,
                           Model model)

Method Detail

preProcessLine

public void preProcessLine()

Description copied from class: BaseOptimizer

Pre preProcess to setup initial searchDirection approximation

Specified by:

preProcessLine in interface ConvexOptimizer

Overrides:

preProcessLine in class BaseOptimizer

postStep

public void postStep(org.nd4j.linalg.api.ndarray.INDArray gradient)

Description copied from class: BaseOptimizer

Post step to update searchDirection with new gradient and parameter information

Specified by:

postStep in interface ConvexOptimizer

Overrides:

postStep in class BaseOptimizer