For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

naive_fa_decode_apple_stitch

def naive_fa_decode_apple_stitch[output_type: DType, p_type: DType, k_t: MHAOperand, v_t: MHAOperand, mask_t: MHAMask, output_layout: TensorLayout, p_layout: TensorLayout, valid_length_layout: TensorLayout, ragged: Bool = False, sink: Bool = False, _use_valid_length: Bool = False, _is_cache_length_accurate: Bool = False, *, SplitSize: Int](output: TileTensor[output_type, output_layout, MutAnyOrigin], o_partial: TileTensor[p_type, p_layout, ImmutAnyOrigin], m_partial: TileTensor[p_type, p_layout, ImmutAnyOrigin], l_partial: TileTensor[p_type, p_layout, ImmutAnyOrigin], k: k_t, valid_length: TileTensor[DType.uint32, valid_length_layout, ImmutAnyOrigin], max_prompt_len: Int32, max_cache_size: Int32, num_heads: Int32, depth: Int32, num_partitions: Int32)