Mojo function
gelu
gelu(value: Symbol) -> Symbol
Computes the elementwise gelu function of a symbolic tensor.
Creates a new op node to compute the elementwise gelu function of a symbolic tensor and adds it to the graph, returning the symbolic result.
gelu
is defined as where is the
cumulative distribution function of the Gaussian distribution.
See the paper for more details.
Args:
- βvalue (
Symbol
): The symbolic tensor to use as the input to the gelu function computation.
Returns:
A new symbolic tensor value representing the output of the absolute value computation.
Raises:
If the symbol doesn't represent a tensor value.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!
π What went wrong?