Python class
ProcessorInputs
ProcessorInputs
class max.interfaces.ProcessorInputs(logits, context)
Bases: object
Inputs passed to a logits processor callback.
-
Parameters:
-
- logits (md.Buffer)
- context (TextGenerationContext)
context
context: TextGenerationContext
The generation context containing request state and sampling configuration.
logits
logits: md.Buffer
The model logits buffer with shape (N, vocab_size) and float32 dtype.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!