For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Python class
TextGenerationPipelineInterface
TextGenerationPipelineInterface
class max.pipelines.TextGenerationPipelineInterface(*args, **kwargs)
Bases: Pipeline[TextGenerationInputs[TextGenerationContextType], TextGenerationOutput], GenerateMixin[TextGenerationContextType, TextGenerationRequest], Generic[TextGenerationContextType]
Interface for text generation pipelines.
kv_manager
abstract property kv_manager: PagedKVCacheManager
Returns the KV cache managers for this pipeline.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!