sirius/osint-dashboard
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

feat: continuous news scrape + 15-min analyst, expand urls.txt #11

Merged
sirius merged 2 commits from feat/news-cadence-feeds into master 2026-08-28 20:56:02 -04:00
Conversation 0 Commits 2 Files changed 11 +434 -376

2 commits

Author SHA1 Message Date
sirius
0d1c095296 Merge branch 'master' into feat/news-cadence-feeds 2026-08-28 20:55:43 -04:00
Sirius DevOps
8643153954 feat: continuous news scrape + 15-min analyst, expand urls.txt 
Scraper loops with NEWS_SCRAPE_INTERVAL_S (default 10s after each
crawl). Summarizer runs every NEWS_SUMMARIZE_INTERVAL_S (default 900)
over the last 15 minutes of articles. Feed list replaced from the
k8s scrapy-urls configmap (334 sources).
 2026-08-28 20:53:32 -04:00