Kimi K2 is the large language model series developed by Moonshot AI team

Nano vLLM

A globally distributed container orchestrator

unsloth vlm grpo

Entropy Based Sampling and Parallel CoT Decoding

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

Fast, flexible LLM inference

A toolkit for building computer use AI agents

LLM101n: Let's build a Storyteller

A daemon that makes a desktop OS accessible to AI agents

A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...

Minimalist ML framework for Rust

Machine Learning Engineering Open Book

Web site source code

Inference Llama 2 in one file of pure Rust 🦀

Inference Llama 2 in one file of pure C

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable…

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

Enables developers to use AWS Identity and Access Management (IAM) to connect to their Amazon Managed Streaming for Apache Kafka (Amazon MSK) clusters.

🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.

An awesome & curated list of best LLMOps tools for developers

Examples and guides for using the OpenAI API

Get the users tickets data into a beautiful word cloud image sent to your email

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…

Extremely fast Query Engine for DataFrames, written in Rust

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

Deep learning in Rust, with shape checked tensors and neural networks