Struct LeakyReLU 

pub struct LeakyReLU { /* private fields */ }

LeakyReLU activation: max(negative_slope * x, x)

Allows a small gradient when the unit is not active (x < 0). Default negative_slope = 0.01.

Implementations

impl LeakyReLU

pub fn new() -> LeakyReLU

Create with default negative_slope = 0.01.

pub fn with_slope(negative_slope: f64) -> LeakyReLU

Create with custom negative_slope.

Trait Implementations

impl Default for LeakyReLU

fn default() -> LeakyReLU

Returns the “default value” for a type.

impl<B> Module<B> for LeakyReLU

where B: Backend,

fn forward(&self, x: &Tensor<B>) -> Result<Tensor<B>, Error>

Compute the output tensor from the input tensor. This defines the layer’s computation (forward pass).

fn parameters(&self) -> Vec<Tensor<B>>

Return all trainable parameters of this module. The optimizer uses these to update weights during training.

fn set_training(&self, _training: bool)

Set training or evaluation mode.

fn is_training(&self) -> bool

Whether the module is in training mode (default: true).

fn train(&self)

Convenience: set training mode.

fn eval(&self)

Convenience: set evaluation mode.

fn num_parameters(&self) -> usize

Total number of scalar parameters in this module.

fn trainable_params_count(&self) -> usize

Number of trainable (variable) parameters.

fn frozen_parameters(&self) -> Vec<Tensor<B>>

Freeze all parameters: returns new parameter tensors with is_variable = false, preventing gradient accumulation.

fn named_parameters(&self) -> Vec<(String, Tensor<B>)>

Return all trainable parameters with human-readable names.

fn state_dict(&self) -> Vec<(String, Tensor<B>)>

Returns a state_dict-style map of parameter name → tensor.