INNER CODE UNIT · Python
main
lefterisloukas/edgar-crawler · download_filings.py:54
def main():
"""
Orchestrates the entire flow of crawling and downloading filings from SEC EDGAR.
This function performs the following steps:
1. Loads the configuration file.
2. Creates necessary directories.
3. Filters out the unnecessary years.
4. Downloads the indices.
5. Gets specific indices according to the provided filing types and CIKs/tickers.
6. Compares the new indices with the old ones to download only the new filings.
7. Crawls through each index to download (.tsv files) and save the filing.
Raises:
SystemExit: If no filing types are provided or if there are no new filings to download.
"""
# Load the configuration file