Python class
ArchConfigWithKVCache
ArchConfigWithKVCache
class max.pipelines.lib.interfaces.ArchConfigWithKVCache(*args, **kwargs)
Bases: ArchConfig, Protocol
Config for a model architecture that uses a KV cache.
get_kv_params()
get_kv_params()
KV cache parameters to use when running the model.
-
Return type:
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!