For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo function

varlen_selective_state_update_cpu

varlen_selective_state_update_cpu[kernel_dtype: DType, DSTATE: Int](batch: Int, nheads: Int, dim: Int, nheads_ngroups_ratio: Int, pad_slot_id: Int32, dt_softplus: Int8, has_state_batch_indices: Int8, state: TileTensor[kernel_dtype, address_space=state.address_space, linear_idx_type=state.linear_idx_type, element_size=state.element_size], x: TileTensor[kernel_dtype, address_space=x.address_space, linear_idx_type=x.linear_idx_type, element_size=x.element_size], dt: TileTensor[kernel_dtype, address_space=dt.address_space, linear_idx_type=dt.linear_idx_type, element_size=dt.element_size], A: TileTensor[kernel_dtype, address_space=A.address_space, linear_idx_type=A.linear_idx_type, element_size=A.element_size], B: TileTensor[kernel_dtype, address_space=B.address_space, linear_idx_type=B.linear_idx_type, element_size=B.element_size], C: TileTensor[kernel_dtype, address_space=C.address_space, linear_idx_type=C.linear_idx_type, element_size=C.element_size], D: TileTensor[kernel_dtype, address_space=D.address_space, linear_idx_type=D.linear_idx_type, element_size=D.element_size], z: TileTensor[kernel_dtype, address_space=z.address_space, linear_idx_type=z.linear_idx_type, element_size=z.element_size], output: TileTensor[kernel_dtype, address_space=output.address_space, linear_idx_type=output.linear_idx_type, element_size=output.element_size], dt_bias: TileTensor[kernel_dtype, address_space=dt_bias.address_space, linear_idx_type=dt_bias.linear_idx_type, element_size=dt_bias.element_size], state_batch_indices: TileTensor[DType.int32, address_space=state_batch_indices.address_space, linear_idx_type=state_batch_indices.linear_idx_type, element_size=state_batch_indices.element_size], state_strides: IndexList[4], x_strides: IndexList[3], dt_strides: IndexList[3], dt_bias_strides: IndexList[2], A_strides: IndexList[3], B_strides: IndexList[3], C_strides: IndexList[3], D_strides: IndexList[2], z_strides: IndexList[3], out_strides: IndexList[3], ctx: Optional[DeviceContext] = None)

CPU kernel for varlen selective state update.