A curated list of awesome resources for LLM, data engineering, vector databases, RAG, and inference optimization.
Building open intelligent data & LLM infrastructure. Maintained by Intelvor.
- LLM Foundations
- Open-Source LLMs
- Prompting & Agents
- RAG & Vector Databases
- Data Engineering
- Streaming & Real-Time
- Storage & Lakes
- Inference & Serving
- Training & Fine-Tuning
- Evaluation & Observability
- Orchestration & MLOps
- Roadmaps & Learning Paths
- Books & Courses
- Communities
Papers, surveys, and theory to build a deep understanding.
- Attention Is All You Need - The original Transformer paper.
- The Illustrated Transformer - Visual walkthrough of attention.
- The Annotated Transformer - Line-by-line implementation.
- GPT-3: Language Models are Few-Shot Learners - Paper that kicked off the scaling era.
- InstructGPT: Training language models to follow instructions - RLHF in practice.
- Chinchilla: Training Compute-Optimal LLMs - Optimal data/compute scaling ratio.
- LLM Survey (Zhao et al., 2023) - Comprehensive survey of LLMs.
- Andrej Karpathy - Neural Networks: Zero to Hero - Build GPT from scratch.
- Hugging Face NLP Course - Free, hands-on transformers course.
- Llama - Meta's Llama family.
- Llama 3 - Latest open Llama release.
- Mistral - Mistral 7B reference.
- Mixtral - Sparse mixture-of-experts.
- Qwen - Alibaba's open models.
- DeepSeek - Strong open reasoning models.
- Hugging Face Open LLM Leaderboard - Track the best open models.
- Prompt Engineering Guide - Comprehensive open guide.
- Awesome Prompt Engineering - Curated prompt resources.
- LangChain - Framework for LLM-powered applications.
- LlamaIndex - Data framework for LLM apps.
- AutoGPT - Autonomous agent experiments.
- CrewAI - Role-based multi-agent orchestration.
- Microsoft AutoGen - Conversational multi-agent framework.
- ReAct: Synergizing Reasoning and Acting - Paper basis for agent loops.
- LangChain RAG cookbook - End-to-end RAG.
- LlamaIndex docs - RAG-first framework.
- Pinecone learning center - Excellent RAG primers.
- Milvus - Open-source vector database.
- Qdrant - Rust-based vector search.
- Weaviate - Vector search with modules.
- Chroma - Lightweight embedded vector DB.
- pgvector - Vector search in PostgreSQL.
- Faiss - Facebook's similarity search library.
- Awesome RAG - Curated RAG resources.
- The Data Engineering Cookbook - Recipes and patterns.
- Awesome Data Engineering - Classic curated list.
- Data Engineering Zoomcamp - Free 12-week course.
- Apache Spark - Unified analytics engine.
- Apache Flink - Stream and batch processing.
- Apache Airflow - Workflow orchestration.
- dbt - Analytics engineering.
- Dagster - Data orchestration with asset model.
- Prefect - Modern workflow orchestration.
- Apache Kafka - Distributed event streaming.
- Redpanda - Kafka-compatible, faster.
- Apache Pulsar - Multi-tenant pub-sub.
- Kafka: The Definitive Guide - Core concepts.
- Stream Processing with Apache Flink - Flink deep dive.
- Apache Iceberg - Open table format for huge datasets.
- Delta Lake - Lakehouse storage format.
- Apache Hudi - Upserts and CDC on lake storage.
- Apache Parquet - Columnar storage format.
- MinIO - S3-compatible object storage.
- Lakehouse paper - The original lakehouse proposal.
- vLLM - High-throughput LLM serving with PagedAttention.
- Text Generation Inference (TGI) - HF's production server.
- TGI paper: Continuous batching - Batching that boosts throughput.
- TensorRT-LLM - NVIDIA-optimized inference.
- llama.cpp - C++ inference, runs on CPU/Mac.
- Ollama - Local LLM runtime, friendly UX.
- MLC-LLM - Universal LLM deployment.
- Xinference - Model serving platform.
- Axolotl - Config-driven fine-tuning.
- Unsloth - Fast LoRA/QLoRA training.
- PEFT - Parameter-efficient fine-tuning library.
- TRL - RLHF, DPO, and friends.
- DeepSpeed - Massively distributed training.
- Megatron-LM - NVIDIA's LLM training framework.
- LoRA paper - Low-rank adaptation.
- QLoRA paper - Quantized LoRA.
- lm-evaluation-harness - Standard benchmark runner.
- Open LLM Leaderboard - Live benchmark results.
- HELM - Stanford holistic evaluation.
- Ragas - RAG-specific evaluation.
- Langfuse - Open-source LLM observability.
- Phoenix (Arize) - Tracing and eval.
- Promptfoo - Prompt testing and eval.
- Kubeflow - ML on Kubernetes.
- MLflow - Experiment tracking and registry.
- Weights & Biases - Managed experiment tracking.
- Determined AI - Distributed training platform.
- Ray - Distributed compute for ML.
- Kubernetes - Container orchestration base.
- Docker - Container runtime base.
- Data Engineer Roadmap - What to learn in order.
- ML Roadmap - Practical ML path.
- Hugging Face LLM Course - Free, structured LLM training.
- MLOps Zoomcamp - Free MLOps course.
- LLM Engineer Roadmap - Comprehensive LLM learning path.
- Designing Data-Heavy Applications - DDIA, the data engineering bible.
- Speech and Language Processing (Jurafsky & Martin) - Free NLP textbook.
- Dive into Deep Learning - Free interactive DL book.
- Full Stack Deep Learning - Production ML course.
- Stanford CS224N - NLP with deep learning.
- Stanford CS25 - Transformers united.
- Hugging Face Discord - LLM and open-source ML chat.
- MLOps Community - Slack and events.
- r/LocalLLaMA - Local LLM discussion.
- DataTalks.Club - Data, ML, and MLOps community.
- Latent Space - AI engineering podcast & Discord.
Contributions are welcome! Please read the contribution guidelines before submitting a pull request.