For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Python function
compute_num_host_blocks
compute_num_host_blocks()
max.nn.kv_cache.compute_num_host_blocks(params)
Computes the number of blocks that can be allocated on the host.
-
Returns:
-
The number of blocks that can be allocated on the host.
-
Parameters:
-
params (KVCacheParamInterface)
-
Return type: