Skip to content

test(inkless): add test for verifying consolidating partition reassignment [POD-2396]#599

Merged
viktorsomogyi merged 1 commit into
mainfrom
EelisK/POD-2396
May 22, 2026
Merged

test(inkless): add test for verifying consolidating partition reassignment [POD-2396]#599
viktorsomogyi merged 1 commit into
mainfrom
EelisK/POD-2396

Conversation

@EelisK

@EelisK EelisK commented May 19, 2026

Copy link
Copy Markdown
Member

Add a test that verifies that reassignment of consolidating diskless partitions' local logs are not moved to other brokers. Instead, reassignment should restart the consolidation process on the new broker. This is to avoid inter-zone traffic

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a new integration test to ensure that when a consolidating diskless partition is reassigned, the new broker does not receive the existing local log via inter-broker transfer, and that the removed broker eventually cleans up its local log—supporting the goal of avoiding inter-zone traffic.

Changes:

  • Introduces InklessConsolidatedDisklessReassignmentTest covering reassignment behavior during consolidation.
  • Adds assertions for (1) consolidation restarting on the new broker and (2) old broker log cleanup after reassignment.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread core/src/test/java/kafka/server/InklessConsolidatedDisklessReassignmentTest.java Outdated
@EelisK EelisK force-pushed the EelisK/POD-2396 branch 2 times, most recently from 2395d6e to 271940b Compare May 19, 2026 10:38
@EelisK EelisK requested a review from Copilot May 19, 2026 10:43

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated 3 comments.

Comment thread core/src/test/java/kafka/server/InklessConsolidatedDisklessReassignmentTest.java Outdated
@EelisK EelisK force-pushed the EelisK/POD-2396 branch 2 times, most recently from 7b0b020 to e57280e Compare May 19, 2026 12:38
@EelisK EelisK marked this pull request as ready for review May 19, 2026 14:59
@EelisK EelisK requested a review from viktorsomogyi May 19, 2026 14:59
// LEO == originalLeaderLeo immediately. Instead, consolidation restarts from object
// storage, so the new broker should have significantly less data than the original leader.
long newBrokerLeoAfterReassignment = leoAtReassignment.get();
assertTrue(newBrokerLeoAfterReassignment < originalLeaderLeo,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this has the chance to be flaky. Would you mind adding a throttle to 1 on the reassignment and then lifting it once the assert is done?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good idea! Added ✅

@EelisK EelisK force-pushed the EelisK/POD-2396 branch from e57280e to 73de18f Compare May 22, 2026 11:22
@EelisK EelisK force-pushed the EelisK/POD-2396 branch from 73de18f to 5c58460 Compare May 22, 2026 11:27
@EelisK EelisK requested a review from viktorsomogyi May 22, 2026 11:42
@viktorsomogyi

Copy link
Copy Markdown
Contributor

Thank for the update, I'll merge it once the checks are green.

@viktorsomogyi viktorsomogyi merged commit f2d6653 into main May 22, 2026
4 checks passed
@viktorsomogyi viktorsomogyi deleted the EelisK/POD-2396 branch May 22, 2026 12:26
giuseppelillo pushed a commit that referenced this pull request May 29, 2026
giuseppelillo pushed a commit that referenced this pull request May 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants