memorax.networks.ALiBi# class memorax.networks.ALiBi[source]# Bases: RelativePositionalEmbedding ALiBi(num_heads: int) num_heads: int# compute_coefficients()[source]# Return type: Array apply(query_pos, key_pos)[source]# Return type: Array Parameters: query_pos (Array) key_pos (Array) __call__(query, key, query_pos, key_pos)[source]# Call self as a function. Return type: tuple[Array, Array, Any] Parameters: query (Array) key (Array) query_pos (Array) key_pos (Array) __init__(num_heads)# Parameters: num_heads (int) Return type: None replace(**updates)# Returns a new object replacing the specified fields with new values.
