Skip to main content

Mojo function

sub_col_inplace

sub_col_inplace(mut dst: TileTensor[DType.float32, address_space=AddressSpace.LOCAL], vec: TileTensor[DType.float32, address_space=AddressSpace.LOCAL])

dst[gr, gc] -= vec[gc] in place โ€” att_block - max_vec before exp2 in online softmax.