`ELU(x) = "ELU"`

Enter a value for all fields

The ELU Function calculator computes the Exponential Linear Unit (ELU) value based on the input value and a hyperparameter.

INSTRUCTIONS: Enter the following:

• (x) A real number
• (α) Hyperparameter

ELU f(x): The calculator returns a real number

The Math / Science

`ELU(x)={[   x        if x > 0],[alpha(e^x-1) if x <=0]}`

Where α is a hyperparameter (usually set to 1.0 by default) that controls the value to which ELUs saturate for negative net inputs.

Key Characteristics:

• Smooth: ELU is continuous and differentiable, helping with gradient-based optimization.
• Avoids dead neurons: Unlike ReLU, ELU can output negative values, reducing the risk of neurons becoming inactive.
• Faster convergence: It can help neural networks learn faster and perform better by pushing mean activations closer to zero.

---

Artificial Intelligence and Machine Learning Calculators

• Sigmoid Function
• Number of Nodes in a Hidden Layer of a Neural Network
• tanh (hyperbolic tangent)
• ReLU (Rectified Linear Unit)
• ELU (Exponential Linear Unit)
• PReLU (Parametric Rectified Linear Unit)
• Leaky ReLU
• Signum
• Matthews Correlation Coefficient