Python class

TextGenerationOutput

TextGenerationOutput

class max.interfaces.TextGenerationOutput(*, request_id, tokens, final_status, log_probabilities=None)

source

Bases: object

Represents the output of a text generation operation.

Combines token IDs, final generation status, request ID, and optional log probabilities for each token.

Parameters:

• request_id (RequestID)
• tokens (list[int])
• final_status (GenerationStatus)
• log_probabilities (list[LogProbabilities] | None)

final_status

final_status: GenerationStatus

source

The final status of the generation process.

is_done

property is_done: bool

source

Indicates whether the text generation process is complete.

Returns:

True if the generation is done, False otherwise.

log_probabilities

log_probabilities: list[LogProbabilities] | None = None

source

Optional list of log probabilities for each token.

merge()

classmethod merge(outputs)

source

Combine many TextGenerationOutput chunks into a single TextGenerationOutput.

Parameters:

outputs (list[TextGenerationOutput])

Return type:

TextGenerationOutput

request_id

request_id: RequestID

source

The unique identifier for the generation request.

tokens

tokens: list[int]

source

List of generated token IDs.

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit