Skip to main content
Log in

Mojo function

print_kv_cache_paged_generic_gpu

print_kv_cache_paged_generic_gpu[target: StringSlice[StaticConstantOrigin], type: DType, kv_params: KVCacheStaticParams, page_size: Int](valid_lengths: NDBuffer[uint32, 1, origin], kv_collection: PagedKVCacheCollection[type, kv_params, page_size], layer_idx: SIMD[uint32, 1], is_print_compact: Bool, context: DeviceContextPtr)

Was this page helpful?