Stars
A curated list of Large Language Model resources, covering model training, serving, fine-tuning, and building LLM applications.
Compute substrate for AI agents: lightweight enough to live on your laptop, elastic enough to scale into the cloud and unleash unlimited resources.
Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C#, GoLang, and Wolfram 🔍
slime is an LLM post-training framework for RL Scaling.
A professional, enterprise-grade StarRocks database cluster management tool
Infrastructure for Machine Learning Guided Optimization (MLGO) in LLVM.
Sampling CPU and HEAP profiler for Java featuring AsyncGetCallTrace + perf_events
Unstable O(n log n) sorting algorithm with O(n) memory
AI-Powered Data Processing: Use LOTUS to process all of your datasets with LLMs and embeddings. Enjoy up to 1000x speedups with fast, accurate query processing, that's as simple as writing Pandas code
ChatDBG - AI-assisted debugging. Uses AI to answer 'why'
Benchmark hash tables vs hashed sorting
TPC-H benchmark data generation in pure Rust
pprof is a tool for visualization and analysis of profiling data
BCC - Tools for BPF-based Linux IO analysis, networking, monitoring, and more
Continuous Profiling Platform. Debug performance issues down to a single line of code
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
SQLStorm: Taking Database Benchmarking into the LLM Era
Fast and memory efficient c++ flat hash table/map/set
C++ wrappers for SIMD intrinsics and parallelized, optimized mathematical functions (SSE, AVX, AVX512, NEON, SVE, WebAssembly, VSX, RISC-V))
Performance-portable, length-agnostic SIMD with runtime dispatch
Real-time analytics on Postgres tables