INNER CODE UNIT · Python

decode_tokens

lucidrains/x-transformers · train_belief_state.py:37

def decode_tokens(tokens):
    return ''.join(list(map(decode_token, tokens)))

# instantiate GPT-like decoder model for forward and backwards

forward_model = TransformerWrapper(
    num_tokens = 256,
    max_seq_len = SEQ_LEN,
    attn_layers = Decoder(
        dim = 512,
        depth = 6,
        heads = 8,
        rotary_pos_emb = True
    )
)

backward_model = None

View source record →