Skip to content

Tags: gomlx/gomlx

Tags

examples/gpt2/v0.0.1

Toggle examples/gpt2/v0.0.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Merge pull request #330 from gomlx/examples-gomod

Fixed gpt2 go.mod to allow for remote execution.

v0.26.0

Toggle v0.26.0's commit message
Updated gomlx_checkpoints internal dependency.

v0.26.0-rc2

Toggle v0.26.0-rc2's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Merge pull request #257 from gomlx/dtypes

GoMLX now has its own `dtypes` package, under `pkg/core/dtypes`.

v0.26.0-rc1

Toggle v0.26.0-rc1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Merge pull request #256 from gomlx/tests

Added GH_TOKEN to GitHub CI tests.

v0.26.0-rc0

Toggle v0.26.0-rc0's commit message
Updated to use new go-xla

cmd/gomlx_checkpoints/v0.1.3

Toggle cmd/gomlx_checkpoints/v0.1.3's commit message
Merge branch 'main' of github.com:gomlx/gomlx

v0.25.0

Toggle v0.25.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Merge pull request #250 from gomlx/v025rc1

Release candidate 1 fixes

v0.25.0-rc0

Toggle v0.25.0-rc0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Merge pull request #246 from gomlx/distributed

Hightlights:

- Distributed (cross-devices) execution: with AutoSharding and SPMD strategies; 
  Also added support for "portable device" execution.

- API changes: (will require simple fixes)
  - Most not graph building APIs now return errors (as opposed to panicking). Graph building functions
    still use panic to return error -- otherwise it's too painful to express math.
  - All "Rng" renamed to "RNG" -- acronyms in Go are usually capitalized.

- Package `graph`:
  - Fixed/improved documentation.
  - Added `IsNegative`, `IsPositive`, `IsNonNegative`, `IsNonPositive`.
  - Added `SubScalar` and tests for the '*Scalar' functions.
  - Added `Graph.WithDistributedStrategy`, `Graph.WithDeviceMesh`. `Graph.DeviceMesh` and `Graph.NumDevices`
  - Added `Graph.Distributed()` with "collective" (across devices) operations (like `AllReduce`).
  - Renamed: s/`Exec.InDevice`/`Exec.WithDevice`; s/`Exec.SetName`/`Exec.WithName`
  - Added `RunOnDevice`.
  - Added `Exec.AutoSharding` and `Exec.SPMD`.
- Package `context`:
  - Added `context.MustGetParam[T](ctx, key)` and `context.MustGetGraphParam[T](ctx, graph, key)`.
  - Added `Exec.AutoSharding` and `Exec.SPMD`.
  - Added `Variable.DistributedValue` and `Variable.SetDistributedValue`.
- Package `train`:
  - Added `train.DistributedDataset` and `train.BaseDataset`.
  - `Dataset.Reset` now returns an error.
  - `Trainer.TrainStep`, `Trainer.EvalStep` and `Trainer.Eval` now return errors as opposed to panicking.
  - Added `Trainer.WithDeviceAssignment`.
  - Added `Trainer.DistributedTrainStep`, `Trainer.DistributedEvalStep` and `Trainer.DistributedEval`.
- Package `datasets`:
  - Added `datasets.DistributedAccumulator`: converts a normal `Dataset` into a `DistributedDataset`.
  - Added `datasets.OnDevice`: pre-uploads data to devices.
- Package `backend`:
  - Added `Backend.CopyToDevice`
  - `Builder.Parameter()` now takes an optional `ShardingSpec` for sharded inputs.
  - Added ops: `AllReduce`
  - `Backend.NumDevices()` returns an int now.
  - Package `backends/notimplemented`:
    - Added dummy `Backend` that can be used to easily mock backends.
- Package `pkg/core/distributed`:
  -Added `DeviceMesh`, `ShardSpec` and `distributed.Tensor` objects.
- Package `pkg/core/tensors`:
  - Added `Tensor.CheckValid()`, `Tensor.Device()`, `Tensor.Backend()`
  - Changing it to return an error (as opposed to panic) where possible.
Distributed (across devices) execution

v0.24.1

Toggle v0.24.1's commit message
Updated README.

v0.24.1-cli-v0.1.2

Toggle v0.24.1-cli-v0.1.2's commit message
Fixed Dockerfile for v0.24.1