Stars
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
DeepGEMM: clean and efficient BLAS kernel library on GPU
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
Zotero is a free, easy-to-use tool to help you collect, organize, annotate, cite, and share your research sources.
An agentic system that auto-optimizes LLM workloads on AMD GPUs.
ArcticInference: vLLM plugin for high-throughput, low-latency inference
Perplexity open source garden for inference technology
⚙️ Create and run workflows (RPA 2.0)
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…
See, hear, and interact on your local devices.
A modular graph-based Retrieval-Augmented Generation (RAG) system
[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
A modern model graph visualizer and debugger
A Pythonic framework to simplify AI service building
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
A high-throughput and memory-efficient inference and serving engine for LLMs
OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
Think fearlessly with end-to-end encrypted notes and files. For issues, visit https://standardnotes.com/forum or https://standardnotes.com/help.
Xournal++ is a handwriting notetaking software with PDF annotation support. Written in C++ with GTK3, supporting Linux (e.g. Ubuntu, Debian, Arch, SUSE), macOS and Windows 10. Supports pen input fr…
Training and serving large-scale neural networks with auto parallelization.
Flax is a neural network library for JAX that is designed for flexibility.
A Python-level JIT compiler designed to make unmodified PyTorch programs faster.
The minimal javascript library to create flowcharts ✨