Skip to content

inkless: add last-successful-operation age gauges [KC-316] - #735

Merged
jeqo merged 1 commit into
mainfrom
jclarysse/add-last-operation-age-metrics
Aug 10, 2026
Merged

inkless: add last-successful-operation age gauges [KC-316]#735
jeqo merged 1 commit into
mainfrom
jclarysse/add-last-operation-age-metrics

Conversation

@jclarysse

@jclarysse jclarysse commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

Commit 9389b7a fixed a stuck write-path thread caused by a connection to a deleted PG node. The issue was only surfaced by the customer — no internal metric revealed the hang.

Add age-of-last-success gauges so a stuck operation becomes visible before a customer reports it:

  • FileCommitter.LastSuccessfulFileCommitAgeMs: milliseconds since the last file commit completed successfully.

  • PostgresControlPlane.{QueryName}LastSuccessfulQueryAgeMs: same pattern, one gauge per query type (CommitFile, FindBatches, etc.).

Both gauges return -1 before the first success, making "never ran" distinguishable from "ran very recently".

Also fix missing removal of RepairDisklessLog QueryMetrics alongside all other query metrics removals.

KC-316

Commit 9389b7a fixed a stuck write-path thread caused by a connection
to a deleted PG node. The issue was only surfaced by the customer —
no internal metric revealed the hang.

Add age-of-last-success gauges so a stuck operation becomes visible
before a customer reports it:

- FileCommitter.LastSuccessfulFileCommitAgeMs: milliseconds since the
  last file commit completed successfully.

- PostgresControlPlane.{QueryName}LastSuccessfulQueryAgeMs: same
  pattern, one gauge per query type (CommitFile, FindBatches, etc.).

Both gauges return -1 before the first success, making "never ran"
distinguishable from "ran very recently".

Also fix missing removal of RepairDisklessLog QueryMetrics alongside
all other query metrics removals.

[KC-316]
@jclarysse
jclarysse marked this pull request as draft August 10, 2026 10:23
@jclarysse
jclarysse marked this pull request as ready for review August 10, 2026 11:16
@jeqo
jeqo merged commit d02eaaf into main Aug 10, 2026
9 checks passed
@jeqo
jeqo deleted the jclarysse/add-last-operation-age-metrics branch August 10, 2026 13:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants