fix(ingest): skip known KEV/FIRMS rows; CI skips unchanged images #31

Merged

sirius merged 1 commit from feat/lean-ingest-ci-skip-unchanged into master

2026-08-29 19:37:39 -04:00

Author	SHA1	Message	Date
Sirius DevOps	5651d251d0	fix(ingest): skip known KEV/FIRMS rows; CI skips unchanged images CISA KEV republished 1685 NIST URLs every 5 min; FIRMS re-inserted ~325k global hotspots every 15 min. Producer now skips URLs already in event_dedup and FIRMS CSVs that are unchanged (delta-only persist). CI rebuilds only images whose paths changed and never pulls/rebuilds Timescale or bounces osint-db unless Dockerfile.pg changes.	2026-08-29 19:32:00 -04:00

Author

SHA1

Message

Date

Sirius DevOps

5651d251d0

fix(ingest): skip known KEV/FIRMS rows; CI skips unchanged images

CISA KEV republished 1685 NIST URLs every 5 min; FIRMS re-inserted
~325k global hotspots every 15 min. Producer now skips URLs already
in event_dedup and FIRMS CSVs that are unchanged (delta-only persist).

CI rebuilds only images whose paths changed and never pulls/rebuilds
Timescale or bounces osint-db unless Dockerfile.pg changes.

2026-08-29 19:32:00 -04:00