Mojo function
generic_kv_cache_radd_dispatch
generic_kv_cache_radd_dispatch[dtype: DType, collection_t: KVCollectionT, //, target: StringSlice[StaticConstantOrigin]](a: NDBuffer[dtype, 2, origin, shape], cache: collection_t, input_row_offsets: NDBuffer[uint32, 1, origin, shape], batch_offset: SIMD[uint32, 1], layer_idx: SIMD[uint32, 1], ctx: Optional[DeviceContext])
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!