Files
DECNET/CHANGELOG.md

4.6 KiB
Raw Blame History

Changelog

All notable changes to DECNET are documented here.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[Unreleased] (1.2.0)

Prefork worker consolidation — share the import floor across separate processes (own GIL, full isolation) via copy-on-write, for the heavy/isolation-critical workers the in-process supervisor can't co-host.

Added

  • decnet.prefork — prefork supervisor primitive: a master imports the base floor once, then forks one child per worker (own process/GIL, CoW-shared floor), reaps and restarts with backoff, and shuts down gracefully. CoW viability measured on CPython 3.14 (idle child ~1 MB private, ~71 MB shared; gc.freeze() unnecessary thanks to PEP 683 immortal objects).
  • decnet fleet <name> — prefork master that imports the shared base floor once then forks one child per worker. First fleet heavy = profiler + ttp (DB-only, process-isolated heavy tier); systemd unit decnet-fleet-heavy.service Conflicts= the units it replaces and carries no extra privilege. Live RSS delta + heavy-state warming pending a controlled swap.

Changed

  • MITRE ATT&CK Enterprise bundle pinned 19.0 → 19.1. The bundle and its LICENSE now resolve from decnet/data/ (hash-pinned in attack_version.py, fetched on demand via python -m decnet.ttp.attack_stix fetch, gitignored — not committed).

[1.1.1] - 2026-06-18

Fixed

  • Test suite: corrected 4 lifter clip tests that encoded the pre-ASVS confidence_max semantics (treating it as a base × ceiling multiplier). confidence_max is a true ceiling — min(base, ceiling) — since the ASVS hardening pass (BUG-8); the tests now assert the ceiling. They were masked by the make test-web ATT&CK-bundle fail-fast. No production code change.
  • test_topics_matches_documented_set: added attacker.fingerprinted to the documented topic set — the TTP worker legitimately subscribes to it (JARM/HASSH/tcpfp/ipv6_leak fingerprint results feed TTP tagging).

1.1.0 - 2026-06-18

Worker consolidation: cut the long-running worker fleet's resident memory by hosting co-resident workers in shared supervisor processes instead of one OS process per worker. Behaviour-preserving — workers run the same code; only where they are hosted changes, and any worker remains extractable back to its own unit.

Added

  • decnet supervise <group> — hosts a co-resident worker group in one process, paying the Python import floor and the DB connection pool once instead of once per worker. Groups: batch and cpu.
  • decnet.supervisor — in-process supervision primitive: each worker runs in its own restart loop with exponential backoff (in-process Restart=on-failure), run concurrently so one worker crashing never cancels its siblings. Deliberately not asyncio.TaskGroup, whose all-or-nothing cancellation would break worker isolation.
  • decnet.offload — shared-pool CPU-kernel offload. The cpu group runs its two O(n²) connected-components kernels (cluster_observations, cluster_identities) in one shared ProcessPoolExecutor (forkserver) so they run in parallel instead of serialising under the GIL. Inline when no pool is installed, so standalone workers and tests are unchanged.
  • systemd units decnet-supervise-batch.service and decnet-supervise-cpu.service (auto-rendered by decnet init); each Conflicts= the individual units it replaces, preventing accidental double-run.

Changed

  • decnet.topology no longer eagerly imports the topology generator (and the SQLModel ORM behind it) at package import. generate is now a lazy PEP 562 re-export; the public API is unchanged.

Performance

  • batch group (reconcile + enrich + orchestrate + mutate): 509 MB across 4 processes → 129 MB in one. 380 MB (75%), verified live.
  • cpu group (clusterer + campaign-clusterer + attribution + reuse-correlate): 502 MB → ~146 MB (incl. forkserver). 357 MB (71%), verified live.
  • Fleet total: 2.57 GB → ~1.83 GB (737 MB).

Notes

  • webhook (external-HTTP egress; needs hard timeouts) and canary (manages its own repo) intentionally remain standalone for now.
  • bus, api/web, profiler, and ttp remain separate by design (broker / multiprocess servers / heavy resident state + sustained CPU).

1.0.0 - 2026

Initial 1.0 release. See tag v1.0.0.