Skip to content

fix: expire recent throughput when the pipeline is idle - #481

Open
ac1982 wants to merge 1 commit into
allenai:mainfrom
ac1982:fix/expire-idle-metrics
Open

ac1982 wants to merge 1 commit into
allenai:mainfrom
ac1982:fix/expire-idle-metrics

Conversation

@ac1982

@ac1982 ac1982 commented Oct 7, 2026

Copy link
Copy Markdown

Fixes #480.

The pipeline's periodic metric display can show nonzero recent throughput forever after work stops: old samples are removed only when new metrics arrive. Expire the sliding window when rendering it as well, sharing the eviction logic with add_metrics(). Lifetime totals remain unchanged.

Two deterministic clock regressions reproduce full and partial expiry without new samples; both fail on the base and pass after the fix. Updated the Unreleased changelog.

Validation: pytest tests/test_metrics.py -q (2 passed), Black and isort checks passed. Ruff reports 10 pre-existing deprecated typing-import/annotation findings in metrics.py; none comes from the change. Mypy reports an existing summary-dictionary assignment error, reproduced against the unmodified base file. No model downloads, paid calls, or full OCR integration tests were run; the change and tests use the standard library in a dedicated Python 3.12 environment.

Searched existing open/closed issues and PRs for metrics, window, and throughput before implementing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Recent throughput never expires when no new work completes

1 participant