Skip to main content

Mojo function

leaky_relu

leaky_relu[dtype: DType, simd_width: Int](x: SIMD[dtype, simd_width], negative_slope: SIMD[dtype, 1]) -> SIMD[dtype, simd_width]

Compute the Leaky ReLU using the equation max(0,x)+negativeslopemin(0,x)max(0, x) + negative_slope * min(0, x).

Constraints:

Type must be a floating point Dtype.

Parameters:

  • dtype (DType): DType used for the computation.
  • simd_width (Int): SIMD width used for the computation.

Args:

  • x (SIMD): The value to compute the Leaky ReLU operation on.
  • negative_slope (SIMD): The slope for negative values.

Returns:

SIMD: The result of the Leaky ReLU operation.

Was this page helpful?