Commits

Breadcrumbs

History for

onqueue

User selector

All users

All time

Commit History

Commits on May 10, 2022

• fix(colab): use correct param name for CLIP

  borisdayma

  committed
  badd15c

  Copy full SHA for badd15c

Commits on May 9, 2022

• feat(colab): use full precision for clip & vqgan

  borisdayma

  committed
  8845d77

  Copy full SHA for 8845d77

• feat(colab): require less memory

  borisdayma

  committed
  5f16fb0

  Copy full SHA for 5f16fb0

Commits on May 5, 2022

• fix(train): overwrite dropout only when specified

  borisdayma

  committed
  89bc9d4

  Copy full SHA for 89bc9d4

• feat: allow eval only

  borisdayma

  committed
  65bb95f

  Copy full SHA for 65bb95f

Commits on May 3, 2022

• feat(colab): update mini checkpoint

  borisdayma

  committed
  a4d2af8

  Copy full SHA for a4d2af8

• feat(train): allow editing dropout during training

  borisdayma

  committed
  80d791a

  Copy full SHA for 80d791a

• feat(colab): require less resources

  borisdayma

  committed
  b6f5026

  Copy full SHA for b6f5026

Commits on May 2, 2022

• feat(colab): change defaults

  borisdayma

  committed
  3de3769

  Copy full SHA for 3de3769

• feat(colab): handle dalle-mega

  borisdayma

  committed
  024f8f5

  Copy full SHA for 024f8f5

Commits on Apr 29, 2022

• feat: support LR offset (#174)

  borisdayma

  authored
  c3e93df

  Copy full SHA for c3e93df

• feat: update shampoo

  borisdayma

  committed
  79a3849

  Copy full SHA for 79a3849

• feat(train): allow nesterov momentum

  borisdayma

  committed
  d08bf8d

  Copy full SHA for d08bf8d

Commits on Apr 28, 2022

• feat: allow weight decay

  borisdayma

  committed
  acc1a4a

  Copy full SHA for acc1a4a

Commits on Apr 20, 2022

• style: reformat

  borisdayma

  committed
  dca3ada

  Copy full SHA for dca3ada

Commits on Apr 19, 2022

• feat(train): use new HF _do_init api

  borisdayma

  committed
  6b84155

  Copy full SHA for 6b84155

• fix: model compatible with do_init

  borisdayma

  committed
  f3a8cbb

  Copy full SHA for f3a8cbb

Commits on Apr 16, 2022

• fix: apply learning rate offset only when requested

  borisdayma

  committed
  c6263f3

  Copy full SHA for c6263f3

• feat(train): arg to offset lr for resumed runs

  borisdayma

  committed
  89b4c45

  Copy full SHA for 89b4c45

Commits on Apr 15, 2022

• feat(demo): use vaild model

  borisdayma

  committed
  23c1ef6

  Copy full SHA for 23c1ef6

• feat(mega): switch to gelu

  borisdayma

  committed
  cdefdd0

  Copy full SHA for cdefdd0

• fix: use correctly cache during inference + allow unscan (#170)

  Show description for 42968cf
  borisdayma

  authored
  42968cf

  Copy full SHA for 42968cf

• fix: allow non-scanned models (#168)

  borisdayma

  authored
  8ae9176

  Copy full SHA for 8ae9176

Commits on Apr 11, 2022

• feat: vmap optimizer (#166)

  borisdayma

  authored
  b993d27

  Copy full SHA for b993d27

• feat(demo): use fixed commit

  borisdayma

  committed
  2f1e5d9

  Copy full SHA for 2f1e5d9

Commits on Apr 9, 2022

• feat: scan layers + gradient checkpointing (#161)

  Show description for 07a6f9a
  borisdayma

  authored
  07a6f9a

  Copy full SHA for 07a6f9a

Commits on Apr 8, 2022

• feat: better multi-node support (#158)

  Show description for 728a3c3
  borisdayma

  authored
  728a3c3

  Copy full SHA for 728a3c3

Commits on Apr 6, 2022

• feat: update shampoo

  borisdayma

  committed
  9ecdd3f

  Copy full SHA for 9ecdd3f

Commits on Apr 2, 2022

• feat(demo): update model

  borisdayma

  committed
  b9a1a7d

  Copy full SHA for b9a1a7d

Commits on Mar 30, 2022

• feat(model): allow bias (#152)

  borisdayma

  authored
  361a994

  Copy full SHA for 361a994

Commits on Mar 29, 2022

• feat(train): google-cloud-storage is optional

  borisdayma

  committed
  02b2308

  Copy full SHA for 02b2308

• feat(train): rename logged config

  borisdayma

  committed
  955dc20

  Copy full SHA for 955dc20

Commits on Mar 28, 2022

• feat: add mini_glu config

  borisdayma

  committed
  a7e5050

  Copy full SHA for a7e5050

Commits on Mar 25, 2022

• feat: update mini config

  borisdayma

  committed
  d9a16f2

  Copy full SHA for d9a16f2

Commits on Mar 24, 2022

• feat: implement transformer variants (#144)

  Show description for 542378c
  borisdayma

  authored
  542378c

  Copy full SHA for 542378c