Mojo module
sampling
Functionsβ
- βapply_penalties_to_logits: Apply penalties to the logits based on the frequency of the tokens in the batch.
- βupdate_frequency_data: Update the frequency data for the given new tokens.
- βupdate_frequency_data_kernel: GPU kernel to update token frequency data in CSR format.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!
