For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Python class

Llama3RopeScalingParams

`Llama3RopeScalingParams`

class max.nn.Llama3RopeScalingParams(factor, low_freq_factor, high_freq_factor, orig_max_position)

source

Bases: object

Scaling parameters for Llama3’s frequency-based context extension.

Parameters:

factor (float)
low_freq_factor (float)
high_freq_factor (float)
orig_max_position (int)

`factor`

factor: float

source

Main scaling factor for the frequency components of the rope.

`high_freq_factor`

high_freq_factor: float

source

Factor to scale the high frequency components of the rope.

`low_freq_factor`

low_freq_factor: float

source

Factor to scale the low frequency components of the rope.

`orig_max_position`

orig_max_position: int

source

The original maximum position length supported by the model.

Llama3RopeScalingParams​

factor​

high_freq_factor​

low_freq_factor​

orig_max_position​

`Llama3RopeScalingParams`

`factor`

`high_freq_factor`

`low_freq_factor`

`orig_max_position`