Skip to content

Tags: angelayi/ao

Tags

ciflow/rocm/1206

Toggle ciflow/rocm/1206's commit message
revert change in tensor_core_tile_layout.cu

ciflow/rocm/999

Toggle ciflow/rocm/999's commit message
trigger rebuild

v0.7.0-rc3

Toggle v0.7.0-rc3's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
update test-infra to release version (pytorch#1391)

* update test-infra to release version

Summary:

pytorch/test-infra#6016 landed recently which is
breaking our ROCm builds

We point to a special branch of test-infra created just before this PR
to unblock the v0.7.0 release.

Test Plan: CI

Reviewers:

Subscribers:

Tasks:

Tags:

* Update .github/workflows/build_wheels_linux.yml

---------

Co-authored-by: Andrey Talman <atalman@fb.com>

v0.7.0

Toggle v0.7.0's commit message
Add TTFT benchmarks + update sparsity benchmarks (pytorch#1140)

This PR adds in TTFT token benchmarks to torchAO, and also updates the benchmarking script to handle sparsity a bit nicer + use the 2:4 sparse checkpoints that are available.

Additionally also adds in padding support for int8 dynamic quant + 2:4 sparsity, which we were missing before.

v0.7.0-rc2

Toggle v0.7.0-rc2's commit message
Add TTFT benchmarks + update sparsity benchmarks (pytorch#1140)

This PR adds in TTFT token benchmarks to torchAO, and also updates the benchmarking script to handle sparsity a bit nicer + use the 2:4 sparse checkpoints that are available.

Additionally also adds in padding support for int8 dynamic quant + 2:4 sparsity, which we were missing before.

v0.7.0-rc1

Toggle v0.7.0-rc1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
check `scale.ndim` before applying `t`/`transpose` (pytorch#1339)

* check `scale.ndim` before applying `t`/`transpose`

because (a) `scale` could be 0D/1D and `transpose` and (b) the args and
kwargs of `torch.ops.aten.transpose.int` would supply `dim0` and `dim1`,
leading to cause dim canonicalization to fail.
e.g. [`torch._prims_common.canonicalize_dims`](https://github.com/pytorch/pytorch/blob/07906f2/torch/_prims_common/__init__.py#L704)

Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>

* add test of `.t()` and `.transpose(0, 1)`

Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>

* change cond to transpose scale

Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>

---------

Signed-off-by: Masaki Kozuki <mkozuki@nvidia.com>

v0.6.1

Toggle v0.6.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Fix 20x slowdown of FP6 kernel due to device properties query (pytorc…

…h#1128)

Fix 20x slowdown of FP6 kernel due to device properties query (pytorch#1092)

Replace `cudaGetDeviceProperties` with `cudaDeviceGetAttribute`

Co-authored-by: Tobias van der Werff <33268192+tobiasvanderwerff@users.noreply.github.com>

v0.6.1-rc2

Toggle v0.6.1-rc2's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Fix 20x slowdown of FP6 kernel due to device properties query (pytorc…

…h#1128)

Fix 20x slowdown of FP6 kernel due to device properties query (pytorch#1092)

Replace `cudaGetDeviceProperties` with `cudaDeviceGetAttribute`

Co-authored-by: Tobias van der Werff <33268192+tobiasvanderwerff@users.noreply.github.com>

v0.6.1-rc1

Toggle v0.6.1-rc1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Update README.md (pytorch#1036)

v0.6.0

Toggle v0.6.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Update README.md (pytorch#1036)