Skip to main content

Mojo trait

KVCollectionT

Trait for a pair of caches (keys and values).

Implemented traits

AnyType, Copyable, ImplicitlyCopyable, ImplicitlyDestructible, Movable

comptime members

CacheType

comptime CacheType

dtype

comptime dtype

kv_params

comptime kv_params

name_str

comptime name_str

Required methods

__init__

__init__(out self: _Self, *, copy: _Self)

Create a new instance of the value by copying an existing one.

Args:

  • copy (_Self): The value to copy.

Returns:

_Self

__init__(out self: _Self, *, deinit take: _Self)

Create a new instance of the value by moving the value of another.

Args:

  • take (_Self): The value to move.

Returns:

_Self

get_key_cache

get_key_cache(self: _Self, layer_idx: Int) -> _Self.CacheType

Returns:

_Self.CacheType

get_value_cache

get_value_cache(self: _Self, layer_idx: Int) -> _Self.CacheType

Returns:

_Self.CacheType

cache_length

cache_length(self: _Self, bs_idx: Int) -> Int

Returns:

Int

Provided methods

copy

copy(self: _Self) -> _Self

Explicitly construct a copy of self, a convenience method for Self(copy=self) when the type is inconvenient to write out.

Returns:

_Self: A copy of this value.

Was this page helpful?