Starred repositories
The Language Virtual Machine for Agent Skills
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
Tools and pipelines for automated LLM performance evaluation
LangGPT: Empowering everyone to become a prompt expert! 🚀 📌 结构化提示词（Structured Prompt）提出者 📌 元提示词（Meta-Prompt）发起者 📌 最流行的提示词落地范式 | Language of GPT The pioneering framework for structured & meta-prompt…
A curated list of awesome resources, tools, research papers, and projects related to the concept of Large Language Model Operating Systems (LLM-OS).
Visual Blocks for ML is a Google visual programming framework that lets you create ML pipelines in a no-code graph editor. You – and your users – can quickly prototype workflows by connecting drag-…
本文原文由知名 Hacker Eric S. Raymond 所撰寫，教你如何正確的提出技術問題並獲得你滿意的答案。
High-performance In-browser LLM Inference Engine
Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
Must read research papers and links to tools and datasets that are related to using machine learning for compilers and systems optimisation
An open source platform for Python in the browser. https://pyscript.net Docs: https://docs.pyscript.net/ Try it: https://pyscript.com/ Community: https://discord.gg/HxvBtukrg2
This is an online course where you can learn and master the skill of low-level performance analysis and tuning.
EasyView is an extension atop vscode. EasyView can show multiple interactive views for the profiling data collected by many mainstream profilers. It is tightly integrated into vscode for source cod…
DrCCTProf is a fine-grained call path profiling framework for binaries running on ARM and X86 architectures.
Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks
☄🌌️ The minimal, blazing-fast, and infinitely customizable prompt for any shell!
felixge's notes on the various go profiling methods that are available.
[Official] Android reverse engineering tool focused on dynamic instrumentation automation leveraging Frida. It disassembles dex, analyzes it statically, generates hooks, discovers reflected methods…
HPCToolkit performance tools: libmonitor - a substrate for monitoring tools
Eclipse Theia trace viewer extension using the Trace Server Protocol (TSP), through the tsp-typescript-client. Also the home for reusable JavaScript libraries: traceviewer-base, traceviewer-react-c…
TensorFlow's Visualization Toolkit