Skip to main content

Mojo function

leaky_relu

leaky_relu[dtype: DType, simd_width: Int](x: SIMD[dtype, simd_width], negative_slope: Scalar[dtype]) -> SIMD[dtype, simd_width]

Compute the Leaky ReLU using the equation max(x,0)+negativeslopemin(x,0)max(x, 0) + negative_slope * min(x, 0).

Constraints:

Type must be a floating point Dtype.

Parameters:

  • dtype (DType): DType used for the computation.
  • simd_width (Int): SIMD width used for the computation.

Args:

  • x (SIMD): The value to compute the Leaky ReLU operation on.
  • negative_slope (Scalar): The slope for negative values.

Returns:

SIMD: The result of the Leaky ReLU operation.

Was this page helpful?