print_kv_cache_paged_generic_gpu

print_kv_cache_paged_generic_gpu[target: StringSlice[StaticConstantOrigin], type: DType, kv_params: KVCacheStaticParams, page_size: Int, assert_write_mode: Int = 0](valid_lengths: NDBuffer[uint32, 1, origin], kv_collection: PagedKVCacheCollection[type, kv_params, page_size, assert_write_mode], layer_idx: SIMD[uint32, 1], is_print_compact: Bool, context: DeviceContextPtr)

Was this page helpful?

Thank you! We'll create more content like this.