For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo function

gelu_quick

def gelu_quick[dtype: DType, simd_width: Int, accum: DType = get_accum_type[dtype]()](x: SIMD[dtype, simd_width]) -> SIMD[dtype, simd_width]

Compute the quick (sigmoid) approximation of the GELU activation: $x * sigmoid(1.702 * x)$ .

Constraints:

Type must be a floating point Dtype.

Parameters:

dtype (DType): DType used for the computation.
simd_width (Int): SIMD width used for the computation.
accum (DType): Higher-precision accumulation dtype used internally; defaults to get_accum_type[dtype]().

Args:

x (SIMD[dtype, simd_width]): The value to compute the quick-GELU operation on.

Returns:

SIMD[dtype, simd_width]: The result of the quick-GELU operation.