INNER CODE UNIT · Python

LEARNING_RATE

lucidrains/x-transformers · train_belief_state.py:18

LEARNING_RATE = 1e-4
VALIDATE_EVERY  = 100
GENERATE_EVERY  = 500
GENERATE_LENGTH = 256
SEQ_LEN = 256

FORWARD_BACKWARD_SAME_MODEL = True
DEVICE = default_device()

# helpers

def cycle(loader):
    while True:
        for data in loader:
            yield data

def decode_token(token):
    return str(chr(max(32, token)))

View source record →