Skip to content

Commit

Permalink
Merge pull request jiaweizzhao#11 from darthjaja6/patch-1
Browse files Browse the repository at this point in the history
Update torchrun_main.py - c4
  • Loading branch information
jiaweizzhao authored Mar 15, 2024
2 parents e4fe249 + 29bea7c commit 864eeb3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion torchrun_main.py
Original file line number Diff line number Diff line change
Expand Up @@ -167,7 +167,7 @@ def main(args):
logger.info(f"{k:30} {v}")
logger.info("*" * 40)

data = datasets.load_dataset("c4", "en", split="train", streaming=True)
data = datasets.load_dataset("allenai/c4", "en", split="train", streaming=True)

seed_for_shuffle = 42

Expand Down

0 comments on commit 864eeb3

Please sign in to comment.