Skip to content

Tags: fafnirZ/paraX

Tags

v0.0.1

Toggle v0.0.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
feat: major upgrade adding `multi-tqdm` support, one for each worker (#3

)

* feat: adding initial decorator functions in preparation for multi tqdm logic

* feat: better deduplication

* chore: duplicated sample 1 example so I can use for multi-tqdm

* feat: fixing minor bugs introduced with refactor

* feat: introducing tqdm mode into base executor

* feat: updating, connecting the init functions with the base classes etc.

* feat: generating different tqdm instances based on number of workers

* feat: introducing the worker_id -> tqdm_index map

* feat: more updates for tqdm_map

* feat: more updates with map generation

* feat: handle update and handle future updated for the "multi" case

* fixing: bug

* feat: more updates

* feat: closing tqdm before we print stuff so we don't overwrite tqdm output (due to position=x) arg in tqdm

* fix: fixing more errors, but looking good honestly...

* feat: fixing error with worker discovery, due to NOOP_fn being too quick to finish, it doesnt discover all workers, so I added NOOP_sleep_fn which sleeps for 0.5 such that its guaranteed to no cause a race condition

* feat: process pool also uses multi

* chore: update readme