history: swamp.score_daily FINAL WHERE day < today()
today: swamp.score_grants WHERE granted_at >= toStartOfDay(...) GROUP BY distinct_id, grant_id

The second branch is a live scan of today's entire grant tail, on the request path, per viewer, uncached. It grows with the daily event rate, which is the fastest-growing quantity in the system.

Measured impact of the tail alone: on a day with 367K grants, one board render goes from 143 MiB / 40 ms to 264 MiB / 119 ms. The tail branch by itself reads 446K rows / 76 MiB. At 10B scale the modelled tail is ~14.5M grants/day, and the full render is 3,596 ms / 10.85 GiB (see #1572).

The observation that makes this cheap

score_daily already contains today's rows. The rollup projector's touched window is:

WHERE toDate(granted_at) >= today() - 2
   OR created_at >= now64(3) - INTERVAL 30 MINUTE

so today's grains are recomputed in full every tick. The read excludes them (day < today()) purely for staleness — the projector runs on a ~60s tick, and the current design wants a just-landed grant (a badge, a tier crossing) to appear immediately on every pod.

That is a freshness requirement, and phase 1 (#1572) supplies a better mechanism for it than a live scan.

Proposal

Move the history/today split so the board reads score_daily for today as well, and rely on the phase-1 epoch for freshness. Wire the tier crossing to poke the projector, then bump the epoch — in that order:

crossing claimed
projector run (runScoreRollupProjectorOnce, already exported and lease-gated)
epoch bump
next board read misses the cache and reads a fresh rollup

This is the eager-tick-plus-announcer-poke shape. A tier-up produces a fresh board because the same event drove both.

Design point to settle before starting

runScoreRollupProjectorOnce runs in telemetry; the tier-crossing watcher runs in the app. The poke therefore needs either an internal endpoint reached via serviceClient, or the watcher moves. Worth deciding up front — it is the main scoping question in this phase.

Expected effect

Deletes the today-tail from the read path entirely. After this, board read cost is a function of the owner population and history depth only — not of how many events/day the platform ingests. That decoupling is the actual goal of the epic.

Constraints and traps

This changes what the board counts, so parity is the gate, not a nice-to-have. Prove byte-identical board output old-query vs new-query across a prod-shaped mirror, including ghosts, multi-device operatives, and the label-only case.
The badge fold in ownedGrants depends on subject_id surviving only for grant_type = 'badge'; the projector preserves that. Confirm it still holds when today's rows come from the rollup rather than the live tail.
Genesis badge history is category='badges' but grant_type='genesis' with empty subject_id, and must keep summing like a normal grant. Existing trap, must not regress.
Worst-case staleness becomes "one projector tick" for anything that is not a significant event. State explicitly which events bust and which do not — that list is the user-visible contract.

Verification

Parity harness: identical results for both query shapes over the same dataset.
End-to-end: drive a real tier-up and assert the board reflects it, proving the poke-then-bump ordering works.
Assert the board read no longer references swamp.score_grants at all (a static check, so a future edit cannot silently reintroduce it).

Risk / rollback

Medium — correctness change. Rollback is reverting the split boundary; no data migration is involved, so it is a code-only revert.

02Bog Flow

In Progress

8/11/2026, 2:41:30 AM

Click a lifecycle step above to view its details.

03Sludge Pulse

keeb assigned keeb8/11/2026, 2:04:51 AM

Profile day drill-down returns 0 entries at the 5s ClickHouse ceiling for every operative

A ledger read failure still renders as 'no activity': loadProfileScore swallows to an empty standing behind HTTP 200

swamp quest: drop the heartbeat field the server no longer sends

reconcile_from_disk_bench.ts fails deno check (stale DenoRuntime stub)

Improve multi-word search query handling and guidance

Retire the genesis_public flag and delete the dead cutover transcription scaffolding

Leaderboard phase 1: cache the board read and bust it on tier crossings (no schema change)

Catalog backfill deletes rows for any model whose data names are numeric

migrate-index silently drops entries with shallow paths — all of workflows-evaluated/ and any root-level file

Docs: document catalog completeness check and --repair in doctor reference

Catalog backfill reconciles against the local cache, not the datastore

Leaderboard board windows re-anchor on wall-clock while the rest of the view is frozen at asOf

Decision: move per-event grant MVs to day-grain — ledger is on track for ~1.5B score_grants / ~4B quest_grants

Leaderboard phase 5: score-rollup-projector write cost at 10B — ~430M rows scanned per 60s tick

Profile candidateIds prune costs a full ledger scan to build itself — 42.88M rows for one keyed read

Leaderboard phase 3: owner-grain board_totals so a cache miss is survivable at 10B

Leaderboard phase 2: take score_grants off the board read path — read today from score_daily

Epic: /leaderboard and /u/{username} do not survive 10B events — measured audit + phased plan

Add native Bedrock Knowledge Base Retrieve support

Datastore-managed configuration for multi-instance serve deployments

Ghosts on the leaderboard 500

swamp command doesn't check cwd

swamp auth login process fails when run remotely

serve boot OOM: findAllGlobalSince loads all workflow runs as full aggregates during reconciliation

extension search: channel-filtered results carry null version fields, and multiple --channel values collapse instead of unioning

s3-datastore: localHasAllRemoteEntries uses bare rel instead of localRelPath, always returns false in namespaced mode

datastoreSetupExtension migrates .swamp/ to cache root instead of namespace directory

swamp serve writes outputs/ outside the bound namespace — silently never persisted to the remote datastore

s3-datastore: bulk pull writes to cache root instead of the namespace, wedging push and arming a full-datastore delete

git: add pull, fetch --tags, and cherry-pick methods

Workflow runs with wide dataArtifact fan-out (~400/run) OOM both workflow history get and swamp serve boot, crash-looping the scheduler; rollback doesn't help (state-triggered, not release-triggered)

Show user:<name> instead of user:<id> in grant list output

Reusable long-lived invite link: one URL to bring people into the swamp

Exclude swamp internal model types from model list output

Skill docs use invalid two-argument 'vault get' form

access token mint prints an invalid retrieval command (vault get, not vault read-secret)

serve reload and model edit timeout over --server in Kubernetes

swamp auth whoami should report paid tier and trial status

Use whoami entitlement to explain private-extension push refusals

Document --restricted-commands flag for swamp serve

vault put: pass tags through to extension provider CreateSecret/setSecret calls

Docs: update manual for 23 new --server commands

Update VaultProvider interface in @systeminit/swamp-testing to support optional tags in put()

Docs: document --grants-file flag for swamp serve

Docs: document --server support for serve reload

Docs: add --tag flag to vault put reference

Docs: update manual for --detach-runs deprecation and HA auto-detection

Document the Codex plugin in swamp docs

Add --server support to CLI commands missing it

Document the swamp Claude Code plugin in the swamp documentation

Make --server a global CLI option

Add --server support to model cancel (server-side run cancellation)

Load grants from external source on swamp serve startup

swamp vault put should support tags for secret governance

Improve hot reload of the deamon, include extension source/bundle changes

Authenticated users must re-login after swamp serve restart

Add --server support to serve reload

Harden queue claim semantics: atomic claims + status-guarded markDelivered/markFailed across app queues

Auto-detect HA mode and deprecate --detach-runs flag

version-drift check (from #236) is a raw string-inequality, false-positives on multi-model manifests and metadata-only bumps

Resend newsletter audience sync: contacts, segments, backfill, unsubscribe sync-back

Move per-login token secrets from vault to encrypted control-plane store

Docs: document macOS TLS trust limitation and SSL_CERT_FILE workaround

Validate swamp serve deployment stack on startup

Docs: serve config file (.swamp/serve.yaml) and --config flag

Serve config file — read swamp serve configuration from YAML

Deno runtime does not trust ISRG Root YR — extensions fail with valid Let's Encrypt certs

Docs: update hot-reload reference to include trust list refresh

Cross-instance client re-attach for multi-instance swamp serve

vercel codegen: inline rawSyncResult in non-unwrap sync path

vercel codegen: unused listAll import blocks extension publish for 4 models

vercel codegen: add round-trip idempotency test for the pipeline

Operatives button on Collectives page does nothing

Track active runs in the control-plane store for cross-instance visibility

validateGlobalArgInputRefs checks step-level inputs but step schema rejects 'inputs' key

Docs: document continuous reconciliation and multi-instance serve flags

Docs: update workflow guard skip output to include guardExpression and guardResult

Make it aware hot reload on the deamon does not take into account trust list changes, or do take into account the trust list for the hot reload.

workflow validate: new 'GlobalArgument input references' check resolves model-definition ${{ inputs.* }} against workflow inputs, false-failing steps that supply the input

Continuous reconciliation for multi-instance swamp serve