osint-dashboard/news/scraper
Sirius DevOps d81ea68dec fix: pipeline reliability — WS, summarizer, ingest, health
Stop the live HUD reconnect storm (nginx WS snippet + backoff), copy
intel/nous_client into the summarizer image, and make event ingest
idempotent on URL. GDELT uses the DOC API; NWS no longer sends bbox;
FIRMS is one ON CONFLICT batch; GET /api/aircraft serves last-known.
Health reports freshness without 503ing docker. EONET + CISA KEV added.
2026-08-28 21:49:05 -04:00
..
newsScraper fix: pipeline reliability — WS, summarizer, ingest, health 2026-08-28 21:49:05 -04:00
.dockerignore Add news pipeline: hourly scraper + Gemini summarizer in compose 2026-08-24 17:28:46 -04:00
.gitignore Add news pipeline: hourly scraper + Gemini summarizer in compose 2026-08-24 17:28:46 -04:00
Dockerfile Add news pipeline: hourly scraper + Gemini summarizer in compose 2026-08-24 17:28:46 -04:00
requirements.txt Add news pipeline: hourly scraper + Gemini summarizer in compose 2026-08-24 17:28:46 -04:00
run_news_scraper.py feat: continuous news scrape + 15-min analyst, expand urls.txt 2026-08-28 20:53:32 -04:00
scrapy.cfg Add news pipeline: hourly scraper + Gemini summarizer in compose 2026-08-24 17:28:46 -04:00
urls.txt feat: continuous news scrape + 15-min analyst, expand urls.txt 2026-08-28 20:53:32 -04:00