Skip to main content
Log in

Python module

sampling

Token sampling algorithms.

argmax_sampler()

max.pipelines.sampling.argmax_sampler(dtype: DType)

token_sampler()

max.pipelines.sampling.token_sampler(top_k: int | None, in_dtype: DType, out_dtype: DType)