IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /max/get-started.md). For the complete documentation index, see llms.txt.

For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Python function

max_tokens_to_generate

`max_tokens_to_generate()`

max.pipelines.lib.max_tokens_to_generate(prompt_size, max_length, max_new_tokens=None)

source

Returns the max number of new tokens to generate.

Parameters:

prompt_size (int)
max_length (int | None)
max_new_tokens (int | None)

Return type:

int | None

max_tokens_to_generate()

max_tokens_to_generate()​

`max_tokens_to_generate()`