INNER CODE UNIT · Python

token_types

IBM/transition-amr-parser · src/ibm_neural_aligner/main.py:406

                token_types = [-1, node_idx, -1]
                return tokens, token_types

            tokens, token_types = [], []

            for tgt in outoging_adjacency_graph[src]:
                xtokens, xtoken_types = render_tree(tgt)
                label = d_edge_labels[(src, tgt)]
                tokens += [label] + xtokens
                token_types += [-1] + xtoken_types

            node_name = amr.nodes[src]
            node_idx = d_node_idx[src]
            tokens = ['(', node_name] + tokens + [')']
            token_types = [-1, node_idx] + token_types + [-1]

            return tokens, token_types

View source record →