For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_rope_ragged_paged_with_position_id
struct Struct_rope_ragged_paged_with_position_id[interleaved: Bool]
Registers the mo.rope.ragged.with_position_id graph op with the graph compiler.
Parameters
- interleaved (
Bool): Whether RoPE pairs adjacent real and imaginary components (real, imag, real, imag, ...) as in GGUF, rather than splitting them into halves (real, ..., real, imag, ..., imag) as in safetensors.
Implemented traits
Methods
execute
static def execute[dtype: DType, freq_dtype: DType, //, target: StringSlice[ImmStaticOrigin]](output: ManagedTensorSlice[IOSpec[_, _].FusedOutput, static_spec=output.static_spec], x: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=x.static_spec], input_row_offsets: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=input_row_offsets.static_spec], start_pos: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=start_pos.static_spec], freqs_cis: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=freqs_cis.static_spec], position_ids: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=position_ids.static_spec], ctx: DeviceContext)