Stars
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
A high-throughput and memory-efficient inference and serving engine for LLMs
An Open Source Machine Learning Framework for Everyone
SGLang is a high-performance serving framework for large language models and multimodal models.
FlashInfer: Kernel Library for LLM Serving
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
C-based/Cached/Core Computer Vision Library, A Modern Computer Vision Library
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
OpenBLAS is an optimized BLAS library based on GotoBLAS2 1.13 BSD version.
Open standard for machine learning interoperability
LLM驱动的 A/H/美股智能分析器：多数据源行情 + 实时新闻 + LLM决策仪表盘 + 多渠道推送，零成本定时运行，纯白嫖. LLM-powered stock analysis system for A/H/US markets.
LlamaIndex is the leading document agent and OCR platform
Cross-platform, customizable ML solutions for live and streaming media.
Visualizer for neural network, deep learning and machine learning models
The Compute Library is a set of computer vision and machine learning functions optimised for both Arm CPUs and GPUs using SIMD technologies.
Image annotation with Python. Supports polygon, rectangle, circle, line, point, and AI-assisted annotation.
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Light Image Video Generation Inference Framework
FlashMLA: Efficient Multi-head Latent Attention Kernels
Enjoy the magic of Diffusion models!
General technology for enabling AI capabilities w/ LLMs and MLLMs
Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
Models and examples built with TensorFlow
A SOTA open-source image editing model, which aims to provide comparable performance against the closed-source models like GPT-4o and Gemini 2 Flash.
Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX
SuperSonic is the next-generation AI+BI platform that unifies Chat BI (powered by LLM) and Headless BI (powered by semantic layer) paradigms.
🐍 Geometric Computer Vision Library for Spatial AI