Skip to content

[validation] add assertions for data_args#1280

Open
JJJYmmm wants to merge 1 commit into
QwenLM:mainfrom
JJJYmmm:patch-1
Open

[validation] add assertions for data_args#1280
JJJYmmm wants to merge 1 commit into
QwenLM:mainfrom
JJJYmmm:patch-1

Conversation

@JJJYmmm

@JJJYmmm JJJYmmm commented Jun 14, 2025

Copy link
Copy Markdown
Contributor

--data_flatten and --data_packing only work with flash-attn.
It would be helpful to add some pre-checks to avoid common issues like #1221, #1276, etc.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant