The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

Curated list of papers and resources focused on 3D Gaussian Splatting, intended to keep pace with the anticipated surge of research in the coming months.

[ECCV`24&ICLR`25] CityGaussian Series for High-quality Large-Scale Scene Reconstruction with Gaussians

how to optimize some algorithm in cuda.

计算机自学指南

Ongoing research training gaussian splatting at scale by distributed system

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search…

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Code accompanying the paper "Massive Activations in Large Language Models"

Official implementation of the paper: "A Refined Analysis of Massive Activations in LLMs".

Minimalistic 4D-parallelism distributed training framework for education purpose

Pointcept: a codebase for point cloud perception research. Latest works: PTv3 (CVPR'24 Oral), PPT (CVPR'24), OA-CNNs (CVPR'24), MSC (CVPR'23)

The official implementation of the NeurIPS 2024 paper: DOGS: Distributed-Oriented Gaussian Splatting for Large-Scale 3D Reconstruction Via Gaussian Consensus

🎉CUDA 笔记 / 大模型手撕CUDA / C++笔记，更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.

本项目旨在分享大模型相关技术原理以及实战经验。

Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"

The simplest, fastest repository for training/finetuning medium-sized GPTs.

A PyTorch implementation of NeRF (Neural Radiance Fields) that reproduces the results.