For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Python class
TransferReqData
TransferReqData
class max.pipelines.kv_cache.TransferReqData(*, dst_name, src_name, transfer_name, transfer_ids, src_idxs, dst_idxs, src_replica_idx, dst_replica_idx, is_read=False, tp_shard_count=0, local_shards_used=<factory>)
Bases: Struct
Metadata associated with a transfer request.
This is safe to send between threads/processes.
-
Parameters:
dst_idxs
Length of destination indices can differ from len(transfer_ids).
dst_name
dst_name: str
Base name of destination engine.
dst_replica_idx
dst_replica_idx: int
Index of the destination replica this transfer is to.
is_read
is_read: bool
True if this is a READ (pull) transfer initiated by the destination.
local_shards_used
Physical TP shard indices on the initiator that own this transfer’s handles. Empty means “all shards in the recorded replica” (pre-flatten behavior). Required to release/status-check transfers when flatten_local has picked a subset of shards.
src_idxs
Length of source indices can differ from len(transfer_ids).
src_name
src_name: str
Base name of source engine.
src_replica_idx
src_replica_idx: int
Index of the source replica this transfer is from.
tp_shard_count
tp_shard_count: int
Number of TP shards participating. 0 = all shards (backwards compat).
transfer_ids
Transfer IDs (one per TP shard in the replica).
transfer_name
transfer_name: str
Transfer name.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!