Mojo function
sub_col_inplace
sub_col_inplace(mut dst: TileTensor[DType.float32, address_space=AddressSpace.LOCAL], vec: TileTensor[DType.float32, address_space=AddressSpace.LOCAL])
dst[gr, gc] -= vec[gc] in place โ att_block - max_vec before exp2 in online softmax.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!