INNER CODE UNIT · Python

queries_per_passage

UKPLab/gpl · gpl/train.py:105

            queries_per_passage = math.ceil(
                250e3 / len(corpus)
            )  # Here use ceil to guarantee the QPP will not be too small
        else:
            queries_per_passage = 3
        logger.info(f"Automatically set `queries_per_passage` to {queries_per_passage}")

    #### Synthetic query generation ####
    #### This will be skipped if there is an existing `gen-queries.jsonl`file under `path_to_generated_data` ####
    if use_train_qrels == True:
        if qgen_prefix is not None:
            logger.warning(
                "Found `qgen_prefix` is not None. By setting `use_train_qrels == True`, the `qgen_prefix` will not be used"
            )

        if "qrels" in os.listdir(
            path_to_generated_data
        ) and "queries.jsonl" in os.listdir(path_to_generated_data):

View source record →