For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_rope_ragged_paged
struct Struct_rope_ragged_paged[interleaved: Bool]
Registers the mo.rope.ragged graph op with the graph compiler.
Parameters
- interleaved (
Bool): Whether RoPE pairs adjacent real and imaginary components (real, imag, real, imag, ...) as in GGUF, rather than splitting them into halves (real, ..., real, imag, ..., imag) as in safetensors.
Implemented traits
Methods
execute
static def execute[out_dtype: DType, dtype: DType, freq_dtype: DType, //, target: StringSlice[ImmStaticOrigin]](output: ManagedTensorSlice[IOSpec[_, _].FusedOutput, static_spec=output.static_spec], x: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=x.static_spec], input_row_offsets: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=input_row_offsets.static_spec], start_pos: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=start_pos.static_spec], freqs_cis: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=freqs_cis.static_spec], ctx: DeviceContext)