Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
-
Updated
Dec 17, 2024 - Python
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
Constrained optimization toolkit for PyTorch
[ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
[CVPR 2026] Official PyTorch implementation of WaDi: Weight Direction-aware Distillation for One-step Image Synthesis
This repository contains the code to train flan t5 with alpaca instructions and low rank adaptation.
xKV: Cross-Layer SVD for KV-Cache Compression
[ICLRW'26] EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation
[ICLR 2020, Oral] Harnessing Structures for Value-Based Planning and Reinforcement Learning
「Low-Rank Decay」的官方实现。
Bayesian Optimization-Based Global Optimal Rank Selection for Compression of Convolutional Neural Networks, IEEE Access
Demo code for CVPR2023 paper "Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers"
Voice Music Separation competing for 6th Huawei Cup in ZJU
Lowrankdensity
[COLM 2025] LoX: Low-Rank Extrapolation Robustifies LLM Safety Against Fine-tuning
Official repository for the ICASSP 2024 paper 'Learning a Low-Rank Feature Representation: Achieving Better Trade-Off between Stability and Plasticity in Continual Learning'.
Sparse and Low-Rank Paradigm Free Mapping.
Empirical discovery: Semaev's S₃ relation matrix over j=0 elliptic curves stabilizes at rank 3. Optimizes ECC cryptanalysis & finite-field linear algebra.
8-bit Adafactor Optimizer with Fused CUDA Kernels
Add a description, image, and links to the low-rank topic page so that developers can more easily learn about it.
To associate your repository with the low-rank topic, visit your repo's landing page and select "manage topics."