masscan: active RTSP (554) camera discovery service
Continuous whole-IPv4 rolling sweep for open TCP 554, feeding the same
cameras table as the passive scraper (discovery_source=masscan).
- masscan_config.py: env-driven knobs (range, ports, rate, retries, excludes)
- masscan_scanner.py: JSON-lines parser, rtsp://IP/ URL + url_hash dedupe,
ip-api geolocation, insert/refresh, NATS publish for new finds
- run_masscan_service.py: long-lived rolling-sweep runner (streams results
in, restarts on pass completion); fails closed without an excludefile
- deploy/: systemd unit + README + excludes file for the Pi host
- .env.example: masscan section
Verified end-to-end against a local Postgres: parse, insert, and dedupe
(0 new on re-ingest) all pass.
2026-08-24 22:23:36 -04:00
|
|
|
# systemd unit template — copy to /etc/systemd/system/osint-masscan.service
|
|
|
|
|
#
|
|
|
|
|
# The masscan service is a CONTINUOUS rolling sweep (a full IPv4 pass at a
|
|
|
|
|
# conservative rate takes ~5 days), so it runs as a long-lived service, NOT a
|
|
|
|
|
# daily timer. The [Install] WantedBy means it starts at boot and Restart=always
|
|
|
|
|
# keeps it up. Install steps (run once on the Pi, as root):
|
|
|
|
|
#
|
|
|
|
|
# apt install -y masscan # or: apt-get install masscan
|
|
|
|
|
# mkdir -p /etc/osint-dashboard /opt/siriusdevops
|
|
|
|
|
# cp deploy/masscan-excludes.txt /etc/osint-dashboard/masscan-excludes.txt
|
|
|
|
|
#
|
|
|
|
|
# # Optional tuning (override env in this file; the DB_* values in the unit
|
|
|
|
|
# # already point at the host-published Postgres on 127.0.0.1:5432):
|
|
|
|
|
# cat > /etc/osint-dashboard/masscan.env <<'EOF'
|
|
|
|
|
# MASSCAN_RANGE=0.0.0.0/0
|
|
|
|
|
# MASSCAN_PORTS=554
|
2026-08-24 23:22:03 -04:00
|
|
|
# MASSCAN_RATE=1000
|
masscan: active RTSP (554) camera discovery service
Continuous whole-IPv4 rolling sweep for open TCP 554, feeding the same
cameras table as the passive scraper (discovery_source=masscan).
- masscan_config.py: env-driven knobs (range, ports, rate, retries, excludes)
- masscan_scanner.py: JSON-lines parser, rtsp://IP/ URL + url_hash dedupe,
ip-api geolocation, insert/refresh, NATS publish for new finds
- run_masscan_service.py: long-lived rolling-sweep runner (streams results
in, restarts on pass completion); fails closed without an excludefile
- deploy/: systemd unit + README + excludes file for the Pi host
- .env.example: masscan section
Verified end-to-end against a local Postgres: parse, insert, and dedupe
(0 new on re-ingest) all pass.
2026-08-24 22:23:36 -04:00
|
|
|
# EOF
|
|
|
|
|
#
|
|
|
|
|
# # Venv for the scanner (host-level, not the compose image):
|
|
|
|
|
# cd /opt/siriusdevops/osint-dashboard
|
|
|
|
|
# python3 -m venv .venv-masscan
|
|
|
|
|
# .venv-masscan/bin/pip install -r app/requirements.txt
|
|
|
|
|
#
|
|
|
|
|
# install -m 644 deploy/osint-masscan.service /etc/systemd/system/
|
|
|
|
|
# systemctl daemon-reload
|
|
|
|
|
# systemctl enable --now osint-masscan
|
|
|
|
|
#
|
|
|
|
|
# Watch: journalctl -u osint-masscan -f
|
|
|
|
|
# DB: writes into the same Postgres the compose stack uses (127.0.0.1:5432)
|
|
|
|
|
# so findings appear on the dashboard camera map automatically.
|
