Mojo trait
KVCollectionT
Trait for a pair of caches (keys and values).
Implemented traits
AnyType,
Copyable,
ExplicitlyCopyable,
Movable,
UnknownDestructibility
Aliases
CacheType
alias CacheType
dtype
alias dtype
kv_params
alias kv_params
name_str
alias name_str
Methods
__copyinit__
__copyinit__(out self: _Self, existing: _Self, /)
Create a new instance of the value by copying an existing one.
Args:
- existing (
_Self): The value to copy.
Returns:
_Self
__moveinit__
__moveinit__(out self: _Self, var existing: _Self, /)
Create a new instance of the value by moving the value of another.
Args:
- existing (
_Self): The value to move.
Returns:
_Self
get_key_cache
get_key_cache(self: _Self, layer_idx: Int) -> get_witness(_Self, kv_cache::types::KVCollectionT, CacheType)
Returns:
get_witness(_Self, kv_cache::types::KVCollectionT, CacheType)
get_value_cache
get_value_cache(self: _Self, layer_idx: Int) -> get_witness(_Self, kv_cache::types::KVCollectionT, CacheType)
Returns:
get_witness(_Self, kv_cache::types::KVCollectionT, CacheType)
cache_length
copy
copy(self: _Self) -> _Self
Explicitly construct a copy of self.
Returns:
_Self: A copy of this value.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!