Mojo module

toppminp

Functions

• ​merge: Merge two sorted subarrays into one sorted array.
• ​merge_sort_recursive: Recursive merge sort implementation.
• ​min_p_sampling: Naive CPU implementation of Min-P sampling for token selection. This function applies temperature scaling, softmax, a merge sort, and then samples tokens based on the calculated probability threshold (Min-P).
• ​sort_buf_descending: Sort each batch separately in descending order using parallel merge sort.
• ​top_p_sampling: Naive CPU implementation of Top-P sampling for token selection. This function applies temperature scaling, softmax, a merge sort, and then samples tokens based on the cumulative probability mass (Top-P).

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit