Skip to main content

Mojo function

leaky_relu

leaky_relu[dtype: DType, simd_width: Int](x: SIMD[dtype, simd_width], negative_slope: Scalar[dtype]) -> SIMD[dtype, simd_width]

Compute the Leaky ReLU using the equation max(x,0)+negativeslopeβˆ—min(x,0)max(x, 0) + negative_slope * min(x, 0).

Constraints:

Type must be a floating point Dtype.

Parameters:

  • ​dtype (DType): DType used for the computation.
  • ​simd_width (Int): SIMD width used for the computation.

Args:

Returns:

SIMD[dtype, simd_width]: The result of the Leaky ReLU operation.