Python function
compute_num_host_blocks
compute_num_host_blocks()
max.nn.kv_cache.compute_num_host_blocks(params)
Computes the number of blocks that can be allocated on the host.
-
Returns:
-
The number of blocks that can be allocated on the host.
-
Parameters:
-
params (KVCacheParamInterface)
-
Return type:
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!