Mojo module

gemv

comptime values

logger

comptime logger = Logger(stdout, prefix=String(""), source_location=False)

Structs

• ​GEMVAlgorithm:

Functions

• ​gemm_mma_cpasync: Launch the batched GEMM tensor-core kernel.
• ​gemm_mma_cpasync_kernel:
• ​gemv:
• ​gemv_gpu:
• ​gemv_gpu_dispatch:
• ​gemv_kernel:
• ​gemv_kernel_vector:
• ​gemv_split_k: GEMV with tiling in K dimension. Assuming the B (weight) matrix is transposed i.e. row major N x K, this kernel implements a vector (1 x K) times a matrix (N x K). The impl can actually handle M > 1 but it's only optimal for tiny M. We use it for M = 1 only.
• ​gevm_kernel:
• ​log_shape:
• ​naive_gemv:
• ​reverse_idx:

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit