Python class

Llama3RopeScalingParams

`Llama3RopeScalingParams`

class max.nn.Llama3RopeScalingParams(factor, low_freq_factor, high_freq_factor, orig_max_position)

source

Scaling parameters for Llama3’s frequency-based context extension.

Parameters:

factor: float

source

Main scaling factor for the frequency components of the rope.

high_freq_factor: float

source

Factor to scale the high frequency components of the rope.

low_freq_factor: float

source

Factor to scale the low frequency components of the rope.

orig_max_position: int

source

The original maximum position length supported by the model.