The softmax activation function is a neural transfer function. In neural networks, transfer functions calculate a layer's output from its net input. It is a biologically plausible approximation to the maximum operation . It is used to simulate an invariance operation of complex cells in where it is defined as y=g \left(\frac{\sum_{j=1}^n x_j^{q+1}} {k+\left} \right) \text{,} where <math>g is a sigmoid transfer function.

PropertyValue
dbpprop:abstract
  • The softmax activation function is a neural transfer function. In neural networks, transfer functions calculate a layer's output from its net input. It is a biologically plausible approximation to the maximum operation . It is used to simulate an invariance operation of complex cells in where it is defined as y=g \left(\frac{\sum_{j=1}^n x_j^{q+1}} {k+\left} \right) \text{,} where <math>g is a sigmoid transfer function. It is also represented as p_i = \frac{\exp(q_i)}{\sum_{j=1}^n\exp(q_j)} \text{,} where p is the value of an output node, q is the net input to an output node, and n is the number of output nodes. See Multinomial logit for a probability model which uses the softmax activation function.
dbpprop:hasPhotoCollection
dbpprop:reference
rdfs:comment
  • The softmax activation function is a neural transfer function. In neural networks, transfer functions calculate a layer's output from its net input. It is a biologically plausible approximation to the maximum operation . It is used to simulate an invariance operation of complex cells in where it is defined as y=g \left(\frac{\sum_{j=1}^n x_j^{q+1}} {k+\left} \right) \text{,} where <math>g is a sigmoid transfer function.
rdfs:label
  • Softmax activation function
owl:sameAs
skos:subject
foaf:page