Search results

difference during inference with or without kvcache

bugSomething isn't workingSomething isn't working

Status: Open.

#2165 In Lightning-AI/litgpt;

· guangyuli-uoe opened on Nov 27, 2025

Cut cross entropy for pretraining and finetuning

enhancementNew feature or requestNew feature or request

Status: Open.

#2163 In Lightning-AI/litgpt;

· Aceticia opened on Nov 19, 2025

Support for SSM models (Mamba, Mamba2)

enhancementNew feature or requestNew feature or request

Status: Open.

#2158 In Lightning-AI/litgpt;

· radulescupetru opened on Nov 14, 2025

<code>jsonargparse==4.42.0</code> causing <code>test_config_help</code> failure

Status: Open.

#2150 In Lightning-AI/litgpt;

· bhimrazy opened on Oct 30, 2025

Request to support OLMoE

enhancementNew feature or requestNew feature or request

Status: Open.

#2133 In Lightning-AI/litgpt;

· yangdongchao opened on Sep 12, 2025

Initial and final evaluation in <code>finetune</code> scripts do not accumulate over devices

bugSomething isn't workingSomething isn't working

Status: Open.

#2116 In Lightning-AI/litgpt;

· mseeger opened on Aug 30, 2025

Bitsandbytes quantization for litgpt 2d parallel model (TP+FSDP) within LightningTrainer

questionFurther information is requestedFurther information is requested

Status: Open.

#2115 In Lightning-AI/litgpt;

· radulescupetru opened on Aug 29, 2025

Efficient Model Loading

questionFurther information is requestedFurther information is requested

Status: Open.

#2100 In Lightning-AI/litgpt;

· prabhuteja12 opened on Aug 5, 2025

Secrets exfiltration vulnerability

Status: Open.

#2090 In Lightning-AI/litgpt;

· darryk10 opened on Jul 7, 2025

How to bring my tokenizer and set vocabulary size accordingly for training a model with loaded weights

questionFurther information is requestedFurther information is requested

Status: Open.

#2087 In Lightning-AI/litgpt;

· zvimarko opened on Jul 3, 2025

support swanlab

enhancementNew feature or requestNew feature or request

Status: Open.

#2071 In Lightning-AI/litgpt;

· guangyuli-uoe opened on Jun 12, 2025

How to use fabric.clip_gradients in 16-mixed?

help wantedExtra attention is neededExtra attention is needed

questionFurther information is requestedFurther information is requested

Status: Open.

#2042 In Lightning-AI/litgpt;

· VJJJJJJ1 opened on May 15, 2025