A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.…

DDT: Decoupled Diffusion Transformer

A minimalistic and opinionated Obsidian theme for the keyboard-centric user.

A list of ICs and IPs for AI, Machine Learning and Deep Learning.

Windows alt-tab on macOS

Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)

Fast Multimodal LLM on Mobile Devices

ShortcutsBench: A Large-Scale Real-World Benchmark for API-Based Agents

Bamboo-7B Large Language Model

High-speed Large Language Model Serving for Local Deployment

📖《网络代理与VPN应用详解》 详细阐述代理、隧道、VPN运作过程，并对GFW策略如：地址端口封锁、服务器缓存投毒、数字验证攻击、SSL连接阻断做相关的原理说明

基于 ChatGPT API 的划词翻译浏览器插件和跨平台桌面端应用 - Browser extension and cross-platform desktop application for translation based on ChatGPT API.

我的GoldenDict辞典配置文件和词库

Enabling PyTorch on XLA Devices (e.g. Google TPU)

A high-throughput and memory-efficient inference and serving engine for LLMs

🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation

Inference Llama 2 in one file of pure 🔥

Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository for mainline development. This repository houses branches and …

Nix, the purely functional package manager

《Machine Learning Systems: Design and Implementation》- Chinese Version

Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"

A library of GPU kernels for sparse matrix operations.

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Development repository for the Triton language and compiler

AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

A GPU-accelerated graph learning library for PyTorch, facilitating the scaling of GNN training and inference.