For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo function

silu

def silu[dtype: DType, simd_width: SIMDSize, accum: DType = get_accum_type[dtype]()](x: SIMD[dtype, simd_width]) -> SIMD[dtype, simd_width]

Compute the SiLU (Swish) activation using the equation $x * sigmoid(x)$ .

Constraints:

Type must be a floating point Dtype.

Parameters:

dtype (DType): DType used for the computation.
simd_width (SIMDSize): SIMD width used for the computation.
accum (DType): Higher-precision accumulation dtype used internally; defaults to get_accum_type[dtype]().

Args:

x (SIMD[dtype, simd_width]): The value to compute the SiLU operation on.

Returns:

SIMD[dtype, simd_width]: The result of the SiLU operation.