osint-dashboard/news/scraper/newsScraper
Sirius DevOps d81ea68dec fix: pipeline reliability — WS, summarizer, ingest, health
Stop the live HUD reconnect storm (nginx WS snippet + backoff), copy
intel/nous_client into the summarizer image, and make event ingest
idempotent on URL. GDELT uses the DOC API; NWS no longer sends bbox;
FIRMS is one ON CONFLICT batch; GET /api/aircraft serves last-known.
Health reports freshness without 503ing docker. EONET + CISA KEV added.
2026-08-28 21:49:05 -04:00
..
spiders fix: pipeline reliability — WS, summarizer, ingest, health 2026-08-28 21:49:05 -04:00
__init__.py Add news pipeline: hourly scraper + Gemini summarizer in compose 2026-08-24 17:28:46 -04:00
feed_util.py fix: pipeline reliability — WS, summarizer, ingest, health 2026-08-28 21:49:05 -04:00
items.py Add news pipeline: hourly scraper + Gemini summarizer in compose 2026-08-24 17:28:46 -04:00
middlewares.py Add news pipeline: hourly scraper + Gemini summarizer in compose 2026-08-24 17:28:46 -04:00
pipelines.py fix: pipeline reliability — WS, summarizer, ingest, health 2026-08-28 21:49:05 -04:00
settings.py Fix news scraper feed discovery + summarizer startup race 2026-08-24 17:42:06 -04:00