- Years
- 2024
An internal tool that continuously watches for newly published SEC filings and archives them, building a reliable dataset for downstream analysis.
What I built
- Started the project from scratch and built the scraper pipeline: Celery-scheduled jobs detect newly published filings and save them to Amazon S3 for downstream use.
Stack
- Django
- Celery
- PostgreSQL
- AWS S3