Scraper loops with NEWS_SCRAPE_INTERVAL_S (default 10s after each crawl). Summarizer runs every NEWS_SUMMARIZE_INTERVAL_S (default 900) over the last 15 minutes of articles. Feed list replaced from the k8s scrapy-urls configmap (334 sources). |
||
|---|---|---|
| .. | ||
| tests | ||
| .dockerignore | ||
| Dockerfile | ||
| intel.py | ||
| nous_client.py | ||
| requirements.txt | ||
| run_news_summarizer.py | ||
| summarizer.py | ||