Mojo function

gelu

gelu(value: Symbol) -> Symbol

Computes the elementwise gelu function of a symbolic tensor.

Creates a new op node to compute the elementwise gelu function of a symbolic tensor and adds it to the graph, returning the symbolic result.

gelu is defined as $gelu(x) = x \Phi(x)$ where $\Phi$ is the cumulative distribution function of the Gaussian distribution. See the paper for more details.

Args:

• ​value (Symbol): The symbolic tensor to use as the input to the gelu function computation.

Returns:

A new symbolic tensor value representing the output of the absolute value computation.

Raises:

If the symbol doesn't represent a tensor value.

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit