Mojo module
mha_score_mod
Structs
-
AlibiScoreMod: AlibiScoreMod adds the appropriate ALiBi constant bias to attention score. -
IdentityScoreMod: IdentityScoreMod simply returns attention score.
Traits
-
ScoreModTrait: The ScoreMod trait desctribes score_mod for mha kernel like alibi bias.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!