Mojo function
fused_qk_rope
fused_qk_rope[dtype: DType, collection_t: KVCollectionT, //, cache_t: KVCacheT, *, interleaved: Bool, target: StringSlice[StaticConstantOrigin]](q_proj: NDBuffer[dtype, 4, origin, shape, strides], kv_collection: collection_t, freqs_cis: NDBuffer[dtype, 2, origin, shape, strides], layer_idx: SIMD[uint32, 1], output: NDBuffer[dtype, 4, origin, shape, strides], context: Optional[DeviceContext])
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!