Commits

Commit history

1. Commits on Feb 7, 2023

   • Merge pull request #9 from Andrei-Aksionov/feature/shape_description_fix

     Show description for 5220142
     karpathy

     authored
     5220142View commit details

     Copy full SHA for 5220142

     Browse repository at this point

   • Clarify shape descriptions inside forward method

     Andrei-Aksionov

     committed
     4c8e902View commit details

     Copy full SHA for 4c8e902

     Browse repository at this point
2. Commits on Feb 6, 2023

   • adding this even though the first gpt video didn't cover it, because init is very important to good performance. will cover it in followup video in more detail

     karpathy

     committed
     d38c865View commit details

     Copy full SHA for d38c865

     Browse repository at this point
3. Commits on Jan 31, 2023

   • soften the wording a bit to not scare people too much

     karpathy

     committed
     5301c27View commit details

     Copy full SHA for 5301c27

     Browse repository at this point

   • attach a note about init

     karpathy

     committed
     dfc4eceView commit details

     Copy full SHA for dfc4ece

     Browse repository at this point

   • Merge branch 'master' of https://github.com/karpathy/ng-video-lecture

     karpathy

     committed
     ddf200aView commit details

     Copy full SHA for ddf200a

     Browse repository at this point

   • rename the class it's a remnant of the past

     karpathy

     committed
     d5ae96fView commit details

     Copy full SHA for d5ae96f

     Browse repository at this point
4. Commits on Jan 27, 2023

   • Merge pull request #6 from vineetm/master

     Show description for 17115f7
     karpathy

     authored
     17115f7View commit details

     Copy full SHA for 17115f7

     Browse repository at this point
5. Commits on Jan 25, 2023

   • scale by head size

     vineet-irl

     committed
     988848aView commit details

     Copy full SHA for 988848a

     Browse repository at this point
6. Commits on Jan 17, 2023

   • small readme file

     karpathy

     committed
     381c613View commit details

     Copy full SHA for 381c613

     Browse repository at this point

   • rename v2 to gpt hah

     karpathy

     committed
     3fdc1eaView commit details

     Copy full SHA for 3fdc1ea

     Browse repository at this point

   • might as well add these too

     karpathy

     committed
     d3df5cfView commit details

     Copy full SHA for d3df5cf

     Browse repository at this point
7. Commits on Jan 16, 2023

   • parameter count

     karpathy

     committed
     e93a8c5View commit details

     Copy full SHA for e93a8c5

     Browse repository at this point

   • add dropout, slight refactoring of variables

     karpathy

     committed
     482b15dView commit details

     Copy full SHA for 482b15d

     Browse repository at this point

   • and add layernorms, down to 2.06

     karpathy

     committed
     0016836View commit details

     Copy full SHA for 0016836

     Browse repository at this point

   • introduce the residual block

     karpathy

     committed
     5c3a2d2View commit details

     Copy full SHA for 5c3a2d2

     Browse repository at this point

   • add a computation block, down to 2.24

     karpathy

     committed
     97dd3f9View commit details

     Copy full SHA for 97dd3f9

     Browse repository at this point

   • multi-headed attention, down to 2.28 now

     karpathy

     committed
     a6e0beeView commit details

     Copy full SHA for a6e0bee

     Browse repository at this point

   • add a single self-attention head, reach 2.5 val loss

     karpathy

     committed
     10024b1View commit details

     Copy full SHA for 10024b1

     Browse repository at this point

   • add positional embeddings too

     karpathy

     committed
     28e5fd7View commit details

     Copy full SHA for 28e5fd7

     Browse repository at this point

   • indirectionv2

     karpathy

     committed
     8050fdeView commit details

     Copy full SHA for 8050fde

     Browse repository at this point
8. Commits on Jan 15, 2023

   • v2 starter

     karpathy

     committed
     28ef287View commit details

     Copy full SHA for 28ef287

     Browse repository at this point

   • bigram model

     karpathy

     committed
     83f7d22View commit details

     Copy full SHA for 83f7d22

     Browse repository at this point