INNER CODE UNIT · Python

main

lucidrains/x-transformers · train_discover_reversal.py:54

def main(
    *,
    num_fillers: int = 26,
    len_max: int = 3,
    batch_size: int = 128,
    train_steps: int = 12000,
    dim: int = 192,
    depth: int = 4,
    heads: int = 6,
    fit_lists: int = 9600,
    eval_lists: int = 600,
    surgeries: int = 256,
    tpr_steps: int = 1500,
    tpr_mlp: int = 0,
    seed: int = 0,
    lr: float = 3e-4
):
    bos_id = num_fillers

View source record →