Skip to content

Tags: wwwcojp/ja_sentence_segmenter

Tags

v0.2.0

Toggle v0.2.0's commit message
Merge branch 'fix/concatenator-dos-guard': bound the concatenation, o…

…pt-in

Fixes the one finding that survived a Claude Security scan: the former
matching rule was re-applied to an unboundedly accumulated buffer once per
input line, and the buffer was rebuilt each time, making concatenate_matching
quadratic in the input size — 30s of CPU for a 1.8MB input.

Adds max_concatenate_length, defaulting to None. A workflow review showed a
default-on bound silently changes emitted text, not just split positions, so
the bound is opt-in and its three side effects are documented rather than
hidden. Also accepts str input, raises TypeError instead of discarding
unsupported iterables, and compiles the rules once per call.

Releases 0.2.0.

v0.1.0

Toggle v0.1.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Merge pull request #2 from wwwcojp/feature-modernize-tooling

Modernize tooling and CI (uv / Ruff / tox 4 / trusted publishing)

0.0.2

Toggle 0.0.2's commit message
[Fix]ライセンスファイル修正&PEP561対応

0.0.1

Toggle 0.0.1's commit message
[Fix] PyPI用の設定を追加