For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Python class
ArchConfigWithPermissiveMaxSeqLen
ArchConfigWithPermissiveMaxSeqLen
class max.pipelines.lib.interfaces.ArchConfigWithPermissiveMaxSeqLen
Bases: object
Mixin for configs that honor max_length without bounding.
calculate_max_seq_len()
classmethod calculate_max_seq_len(pipeline_config, huggingface_config, model_config=None)
Uses max_length when set, else max_position_embeddings.
-
Parameters:
-
- pipeline_config (PipelineConfig)
- huggingface_config (AutoConfig)
- model_config (MAXModelConfig | None)
-
Return type:
get_max_seq_len()
get_max_seq_len()
Returns the resolved maximum sequence length stored on the config.
-
Return type:
max_position_embeddings
max_position_embeddings: int
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!