Packages

  • package root
    Definition Classes
    root
  • package com
    Definition Classes
    root
  • package thoughtworks
    Definition Classes
    com
  • package deeplearning

    This is the documentation for the DeepLearning.Scala

    This is the documentation for the DeepLearning.Scala

    Overview

    BufferedLayer, DifferentiableAny, DifferentiableNothing, Layer, Poly and Symbolic are base packages which contains necessary operations , all other packages dependent on those base packages.

    If you want to implement a layer, you need to know how to use base packages.

    Imports guidelines

    If you want use some operations of Type T, you should import:

    import com.thoughtworks.deeplearning.DifferentiableT._

    it means: If you want use some operations of INDArray, you should import:

    import com.thoughtworks.deeplearning.DifferentiableINDArray._

    If you write something like this:

    def softmax(implicit scores: INDArray @Symbolic): INDArray @Symbolic = {
      val expScores = exp(scores)
      expScores / expScores.sum(1)
    }

    If compiler shows error :

    Could not infer implicit value for com.thoughtworks.deeplearning.Symbolic[org.nd4j.linalg.api.ndarray.INDArray]

    you need add import this time :

    import com.thoughtworks.deeplearning.DifferentiableINDArray._

    If you write something like this:

    def crossEntropyLossFunction(
      implicit pair: (INDArray :: INDArray :: HNil) @Symbolic)
    : Double @Symbolic = {
     val score = pair.head
     val label = pair.tail.head
     -(label * log(score * 0.9 + 0.1) + (1.0 - label) * log(1.0 - score * 0.9)).mean
    }

    If the compiler shows error:

    value * is not a member of com.thoughtworks.deeplearning.Layer.Aux[com.thoughtworks.deeplearning.Layer.Tape.Aux[org.nd4j.linalg.api.ndarray.INDArray,org.nd4j.linalg.api.ndarray.INDArray],com.thoughtworks.deeplearning.DifferentiableINDArray.INDArrayPlaceholder.Tape]val bias = Nd4j.ones(numberOfOutputKernels).toWeight * 0.1...

    you need add import :

    import com.thoughtworks.deeplearning.Poly.MathMethods.*
    import com.thoughtworks.deeplearning.DifferentiableINDArray._

    If the compiler shows error:

    not found: value log -(label * log(score * 0.9 + 0.1) + (1.0 - label) * log(1.0 - score * 0.9)).mean...

    you need add import:

    import com.thoughtworks.deeplearning.Poly.MathFunctions.*
    import com.thoughtworks.deeplearning.DifferentiableINDArray._

    Those + - * / and log exp abs max min are defined at MathMethods and MathFunctions,those method are been implemented at DifferentiableType,so you need to import the implicit of DifferentiableType.

    Composability

    Neural networks created by DeepLearning.scala are composable. You can create large networks by combining smaller networks. If two larger networks share some sub-networks, the weights in shared sub-networks trained with one network affect the other network.

    Definition Classes
    thoughtworks
    See also

    Compose

  • trait CumulativeLayer extends Layer

    A Layer that minimizes the computation during both forward pass and backward pass.

    A Layer that minimizes the computation during both forward pass and backward pass.

    For forward pass, the result will be cached.

    For backward pass, the Tape is accumulated until flush.

    Author:

    杨博 (Yang Bo) <[email protected]>

    Definition Classes
    deeplearning
    See also

    Layer.Output

  • CumulativeTape
  • Input
  • MonoidTape
  • ReferenceCount
  • SemigroupTape

trait MonoidTape extends ReferenceCount

Attributes
protected
Self Type
MonoidTape with CumulativeTape
Linear Supertypes
ReferenceCount, Tape, AutoCloseable, AnyRef, Any
Type Hierarchy
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. MonoidTape
  2. ReferenceCount
  3. Tape
  4. AutoCloseable
  5. AnyRef
  6. Any
Implicitly
  1. by any2stringadd
  2. by StringFormat
  3. by Ensuring
  4. by ArrowAssoc
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. abstract type Data

    Type of the result of forward pass.

    Type of the result of forward pass.

    Definition Classes
    Tape
    See also

    value

  2. abstract type Delta

    Type of the information passing in backward pass, usually the partial derivative of Data.

    Type of the information passing in backward pass, usually the partial derivative of Data.

    Definition Classes
    Tape
    See also

    backward

Abstract Value Members

  1. abstract def closeUpstreams(): Unit
    Attributes
    protected
    Definition Classes
    ReferenceCount
  2. abstract def input: AnyRef
    Attributes
    protected
    Definition Classes
    ReferenceCount
  3. abstract def isTrainable: Boolean
    Definition Classes
    Tape
  4. implicit abstract def monoid: Monoid[(MonoidTape.this)#Delta]
    Attributes
    protected
  5. abstract def rawBackward(accumulatedDelta: (MonoidTape.this)#Delta): Unit

    Performs the underlying backward pass with the accumulated outputDeltas previously received from several forceBackward calls.

    Performs the underlying backward pass with the accumulated outputDeltas previously received from several forceBackward calls.

    Attributes
    protected
  6. abstract def value: (MonoidTape.this)#Data

    Value of the result of forward pass.

    Value of the result of forward pass.

    Definition Classes
    Tape
    See also

    Data

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. def +(other: String): String
    Implicit
    This member is added by an implicit conversion from MonoidTape to any2stringadd[MonoidTape] performed by method any2stringadd in scala.Predef.
    Definition Classes
    any2stringadd
  4. def ->[B](y: B): (MonoidTape, B)
    Implicit
    This member is added by an implicit conversion from MonoidTape to ArrowAssoc[MonoidTape] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()
  5. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  6. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  7. final def backward(delta: ⇒ (MonoidTape.this)#Delta): Unit

    invoke forceBackward if isTrainable is true

    invoke forceBackward if isTrainable is true

    Definition Classes
    Tape
    Annotations
    @inline()
    See also

    Delta

  8. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. final def close(): Unit
    Definition Classes
    ReferenceCount → AutoCloseable
  10. final def duplicate(): (MonoidTape.this)#Self

    Returns a wrapped Tape able to detect error of closing more than once if ASSERTION is enabled, or returns this ReferenceCount itself when ASSERTION is disabled hence no check.

    Returns a wrapped Tape able to detect error of closing more than once if ASSERTION is enabled, or returns this ReferenceCount itself when ASSERTION is disabled hence no check.

    Definition Classes
    ReferenceCountTape
  11. def ensuring(cond: (MonoidTape) ⇒ Boolean, msg: ⇒ Any): MonoidTape
    Implicit
    This member is added by an implicit conversion from MonoidTape to Ensuring[MonoidTape] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  12. def ensuring(cond: (MonoidTape) ⇒ Boolean): MonoidTape
    Implicit
    This member is added by an implicit conversion from MonoidTape to Ensuring[MonoidTape] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  13. def ensuring(cond: Boolean, msg: ⇒ Any): MonoidTape
    Implicit
    This member is added by an implicit conversion from MonoidTape to Ensuring[MonoidTape] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  14. def ensuring(cond: Boolean): MonoidTape
    Implicit
    This member is added by an implicit conversion from MonoidTape to Ensuring[MonoidTape] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  15. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  16. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  17. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  18. final def flush(): Unit
    Attributes
    protected
    Definition Classes
    MonoidTapeReferenceCount
  19. final def forceBackward(outputDelta: (MonoidTape.this)#Delta): Unit
    Attributes
    protected
    Definition Classes
    MonoidTapeTape
  20. def formatted(fmtstr: String): String
    Implicit
    This member is added by an implicit conversion from MonoidTape to StringFormat[MonoidTape] performed by method StringFormat in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()
  21. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
  22. def hashCode(): Int
    Definition Classes
    AnyRef → Any
  23. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  24. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  25. final def notify(): Unit
    Definition Classes
    AnyRef
  26. final def notifyAll(): Unit
    Definition Classes
    AnyRef
  27. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  28. def toString(): String
    Definition Classes
    AnyRef → Any
  29. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  32. def [B](y: B): (MonoidTape, B)
    Implicit
    This member is added by an implicit conversion from MonoidTape to ArrowAssoc[MonoidTape] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc

Inherited from ReferenceCount

Inherited from Tape

Inherited from AutoCloseable

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from MonoidTape to any2stringadd[MonoidTape]

Inherited by implicit conversion StringFormat from MonoidTape to StringFormat[MonoidTape]

Inherited by implicit conversion Ensuring from MonoidTape to Ensuring[MonoidTape]

Inherited by implicit conversion ArrowAssoc from MonoidTape to ArrowAssoc[MonoidTape]

Ungrouped