LLM inference in C/C++

Qwen Code is a coding agent that lives in the digital world.

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

A high-throughput and memory-efficient inference and serving engine for LLMs

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.

You like pytorch? You like micrograd? You love tinygrad! ❤️

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo…

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN

Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.

Roo Code gives you a whole dev team of AI agents in your code editor.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

Visualizer for neural network, deep learning and machine learning models

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

Multi-agent framework, runtime and control plane. Built for speed, privacy, and scale.

MLX: An array framework for Apple silicon

Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.

Label Studio is a multi-type data labeling and annotation tool with standardized output format

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

⏩ Ship faster with Continuous AI. Open-source CLI that can be used in TUI mode as a coding agent or Headless mode to run background agents

Klipper is a 3d-printer firmware

💧 A server-side Swift HTTP web framework.

Models and examples built with TensorFlow

Open-source keyboard firmware for Atmel AVR and Arm USB families

A community-maintained Python framework for creating mathematical animations.

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

JupyterLab computational environment.

Large Language Model Text Generation Inference