For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
EaglePrefillShiftTokens
struct EaglePrefillShiftTokens
Registers the mo.eagle_prefill_shift_tokens graph op with the graph compiler.
Implemented traits
Methods
execute
static def execute[dtype: DType, rank: Int, //, target: StringSlice[ImmStaticOrigin]](output: ManagedTensorSlice[IOSpec[_, _].Output, static_spec=output.static_spec], tokens: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=tokens.static_spec], offsets: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=offsets.static_spec], shift_next_tokens: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=shift_next_tokens.static_spec], ctx: DeviceContext)