INNER CODE UNIT · Python

YourDataset

hooshvare/parsbert · scripts/run_clf_finetuning.py:115

class YourDataset(Dataset):
    """This will be superseded by a framework-agnostic approach soon."""

    args: DataTrainingArguments
    op_args: GeneralArguments
    output_mode: str
    features: List[InputFeatures]

    def __init__(
            self,
            args: DataTrainingArguments,
            op_args: GeneralArguments,
            tokenizer: PreTrainedTokenizer,
            limit_length: Optional[int] = None,
            mode: Split = Split.train,
            cache_dir: Optional[str] = None,
    ):
        self.args = args

View source record →