INNER CODE UNIT · Python

main

IlyaGusev/rulm · data_processing/clean_ficbook.py:10

def main(input_path, output_path):
    processor = TextProcessor(
        normalization="NFKC",
        min_chars=0,
        min_text_part=0,
        fix_punct=False,
        fix_spaces=True,
        fix_short_lines=True,
        check_languages=False,
        check_pii=False,
        check_code=False,
        check_links=False,
        check_email=False,
        check_text_part=False
    )

    records = []
    chunk_num = 0

View source record →