SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.

About Awesome things towards foundation agents. Papers / Repos / Blogs / ...

AIInfra（AI 基础设施）指AI系统从底层芯片等硬件，到上层软件栈支持AI大模型训练和推理。

Use PEFT or Full-parameter to finetune 450+ LLMs (Qwen2.5, InternLM3, GLM4, Llama3.3, Mistral, Yi1.5, Baichuan2, DeepSeek-R1, ...) and 150+ MLLMs (Qwen2.5-VL, Qwen2-Audio, Llama3.2-Vision, Llava, I…

learning how CUDA works

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

FPGA modules used together with the PCILeech Direct Memory Access (DMA) Attack Software

A curated list of open source tools used in analytics platforms and data engineering ecosystem

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

主要记录大语言大模型（LLMs） 算法（应用）工程师相关的知识及面试题

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

Tile primitives for speedy kernels

主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识

LLMs interview notes and answers:该仓库主要记录大模型（LLMs）算法工程师相关的面试题和参考答案

Repo for external large-scale work

Ongoing research training transformer models at scale

The official GitHub page for the survey paper "A Survey of Large Language Models".

Langchain + Docker + Neo4j

The Mojo Programming Language

A high-performance, zero-overhead, extensible Python compiler using LLVM

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Fast and flexible reference benchmarks

Disaggregated APIs for SONiC Hosts

The seL4 microkernel

Deep Reinforcement Learning Lab, a platform designed to make DRL technology and fun for everyone

Stream real-time screen capture data out of Android devices.

Online CUDA Occupancy Calculator

Eclipse iceoryx™ - true zero-copy inter-process-communication

Multi-Agent Resource Optimization (MARO) platform is an instance of Reinforcement Learning as a Service (RaaS) for real-world resource optimization. It can be applied to many important industrial d…

A realtime distributed messaging platform