Skip to content

Akhilez/lexical_lab

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

54 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

lexical_lab

TODO:

  • FSDP Experiments
  • RoPE Embeddings
  • MoE Architecture
  • MLA Latent Attention
  • Grouped Query Attention
  • Pre-Training
  • LLM Evaluation
  • SFT Training.
  • RLHF Data + Training
  • RL based on rule-based reward

About

NLP

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published