Python class
SupportsLoRA
SupportsLoRA
class max.nn.SupportsLoRA(*args, **kwargs)
Bases: Protocol
Base class for supporting LoRA functionality in Modules
set_lora_batch_info()
set_lora_batch_info(lora_ids, lora_ranks, lora_grouped_offsets, num_active_loras, lora_end_idx, batch_seq_len, lora_ids_kv, lora_grouped_offsets_kv)
-
Parameters:
-
- lora_ids (TensorValue)
- lora_ranks (TensorValue)
- lora_grouped_offsets (TensorValue)
- num_active_loras (TensorValue)
- lora_end_idx (TensorValue)
- batch_seq_len (TensorValue)
- lora_ids_kv (TensorValue)
- lora_grouped_offsets_kv (TensorValue)
-
Return type:
-
None
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!