Mojo module
gemv
comptime values
logger
comptime logger = Logger[DEFAULT_LEVEL](stdout, "", False)
UnsafePointer
comptime UnsafePointer = LegacyUnsafePointer[?, address_space=?, origin=?]
Structs
Functions
-
gemv: -
gemv_gpu: -
gemv_gpu_dispatch: -
gemv_kernel: -
gemv_kernel_vector: -
gemv_split_k: GEMV with tiling in K dimension. Assuming the B (weight) matrix is transposed i.e. row major N x K, this kernel implements a vector (1 x K) times a matrix (N x K). The impl can actually handle M > 1 but it's only optimal for tiny M. We use it for M = 1 only. -
gevm_kernel: -
log_shape: -
naive_gemv: -
reverse_idx:
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!