A curated, hands-on library of notebooks, demos, and resources for AI/ML, Deep Learning, Generative AI, RAG, agents, fine-tuning, and modern tooling.
pip install instructvault- PyPI: https://pypi.org/project/nonconvexoptimzationfunclib/
- GitHub: https://github.com/05satyam/nonconvexoptimizationfunclib
A Python library of standard non-convex benchmark functions for evaluating and comparing optimization algorithms.
pip install nonconvexoptimzationfunclib- Mission & Scope
- Pick your path
- Foundations (AI/ML Core)
- LangChain (All Notebooks)
- LlamaIndex (All Notebooks)
- RAG Systems (All Variants)
- Agents & Orchestration
- Graph & Multimodal
- MCP (Model Context Protocol)
- Observability
- Interview Experiences
- Useful AI Agent Skills
- External Resources
- Utils
- Repository Rules
- Contributing & Support
- License & Citation
This repository is a living library of practical AI/ML and Generative AI knowledge.
The focus is on learning by doing β notebooks and guides are reproducible, intuitive, and easy to extend.
If you're new, start with the path that matches your goal such as:
flowchart LR
%% ========== Styles ==========
classDef start fill:#E8F5E9,stroke:#2E7D32,stroke-width:1px,color:#1B5E20;
classDef step fill:#E3F2FD,stroke:#1565C0,stroke-width:1px,color:#0D47A1;
classDef choice fill:#FFF8E1,stroke:#F57F17,stroke-width:1px,color:#E65100;
classDef path fill:#F3E5F5,stroke:#6A1B9A,stroke-width:1px,color:#4A148C;
classDef build fill:#FFEBEE,stroke:#C62828,stroke-width:1px,color:#B71C1C;
%% ========== Flow ==========
A["π Start Here<br/>Clone repo + setup venv"]:::start
C{"Pick your learning path"}:::choice
subgraph P["β¨ Learning Paths"]
direction TB
F["π§ Foundations<br/>Tokens β’ Embeddings β’ Transformers"]:::path
H["π οΈ Hands-on Notebooks<br/>Run examples first"]:::path
R["π RAG Systems<br/>Naive β Hybrid β Graph β Multimodal"]:::path
AG["π€ Agents<br/>ReAct β’ Plan&Execute β’ Reflexion"]:::path
I["π― Interview Prep<br/>System design + Q&A"]:::path
end
D["π Observability & Evaluation<br/>Tracing β’ quality checks"]:::step
E["ποΈ Build Mini-Projects<br/>End-to-end demo apps"]:::build
Z["π Keep iterating<br/>Add your own examples + PRs"]:::start
%% ========== Edges ==========
A --> C
C --> F
C --> H
C --> R
C --> AG
C --> I
F --> H
H --> AG
R --> AG
AG --> D --> E --> Z
| Notebook | What youβll learn | Level |
|---|---|---|
| Tokens in GenAI | Tokenization intuition + cost/latency impact | Beginner |
| ML Word Embeddings | Word2Vec/GloVe/CBOW intuition | Beginner |
| Simple LoRA Fine-Tuning | PEFT/LoRA fine-tuning end-to-end | All Levels |
| Best Practices for Building AI Agents (Framework-Agnostic) | Best Practices | All Levels |
Everything that uses LangChain / LangGraph / LCEL lives here.
| Notebook | What it does | Level | Tags |
|---|---|---|---|
| LangChain Prompt Chains | Prompt chaining + LCEL patterns | All Levels | #prompting #lcel |
| Plan & Execute (LangGraph) | Multi-step planning + execution | All Levels | #langgraph #agents |
| Reflexion Pattern | Self-critique agent loops | All Levels | #agents #reasoning |
| LangGraph Agents | Tool-calling agents with graphs | All Levels | #langgraph #tools |
Everything that uses LlamaIndex lives here.
| Notebook | What it does | Level | Tags |
|---|---|---|---|
| Text-to-SQL w/ LlamaIndex | Natural language β SQL over DB | All Levels | text2sql, llamaindex |
| LlamaExtract (LlamaIndex) | Structured extraction from invoices using LlamaIndex | All Levels | llamaindex, extraction |
All Retrieval-Augmented Generation notebooks, grouped by type.
| Notebook | RAG Type | What it does | Level |
|---|---|---|---|
| Hybrid Search RAG | Hybrid RAG | BM25 + vectors + reranking | All Levels |
| Semantic Search (Pinecone) | Vector RAG | Simple embedding retrieval | All Levels |
| GraphRAG | Graph RAG | Graph retrieval + LLM answering | Advanced |
| Multimodal RAG: Text + Images | Multimodal RAG | Retrieve across text & images | All Levels |
| Corrective RAG (CRAG) | Corrective RAG | Retrieval grading with query rewriting and web-search fallback | Intermediate |
| Notebook / Resource | What it does | Level |
|---|---|---|
| LLM Query Router | Route queries to best chain/tool | All Levels |
| PydanticAI Agents And Tools | Typed agents + strict tool schemas | All Levels |
| PydanticAI Agentic Lib | Agentic patterns using PydanticAI | All Levels |
| Crew AI Agents | Multi-agent teams + roles | All Levels |
| Agentic Webcrawler Chatbot | Crawl web + answer with agents | All Levels |
| Agentic Design Patter Cookbook | Agentic Design Pattern cookbook β ReAct, Plan & Execute, Self Check using Langchain | All levels |
| Notebook | What it does | Level |
|---|---|---|
| GraphMyDoc | Build doc knowledge graphs | All Levels |
| GraphNavAI | Navigate knowledge as graph | All Levels |
| Demo | What it does | Level |
|---|---|---|
| Hello World β MCP | Hello World β MCP | All Levels |
| MCP Server Demo | MCP server-client tooling end-to-end | All Levels |
| Notebook | What it does | Level |
|---|---|---|
| LlamaTrace β Observability | Tracing, evals, monitoring with Phoenix | All Levels |
| ARIZE β Observability | AI-AGENT Tracing, evals, monitoring with ARIZE | All Levels |
| Doc | Focus Area |
|---|---|
| LLM Architecture Comparison | Evolution of LLM architectures (2017β2025) |
| Interview Q&A | Common AI/ML/LLM interview questions |
| Contextual & GPT Embeddings | Embedding types + intuition |
| AI Agent Memory Types | Memory patterns for agents |
| Stanford LLM Cheatsheet | Compact transformer/LLM summary |
Agent skills are reusable SKILL.md playbooks that help coding agents follow better workflows for documents, coding, research, data work, planning, and tool usage. Start with trusted catalogs, review skills before installing them, and prefer project-local skills when you want repo-specific behavior.
| Repository | Best for |
|---|---|
| anthropics/skills | Official Agent Skills examples and reference implementations for documents, development, communication, and skill design |
| openai/skills | Codex-oriented skill examples and historical patterns for SKILL.md workflows |
| ComposioHQ/awesome-claude-skills | Large curated index of practical skills across productivity, docs, code, data, app automation, writing, and collaboration |
| composio-community/awesome-codex-skills | Codex-focused skills such as code review, CI fixes, meeting notes, issue triage, invoices, and Notion capture |
| VoltAgent/awesome-agent-skills | Cross-agent skill discovery for Claude Code, Codex, Gemini CLI, Cursor, OpenCode, and similar tools |
| huggingface/skills | Hugging Face Hub workflows, model search, datasets, Spaces, jobs, and AI/ML ecosystem tasks |
| nvidia/skills | NVIDIA ecosystem skills for optimization, GPU-oriented workflows, and technical computing |
| MicrosoftDocs/Agent-Skills | Microsoft Learn, Azure, GitHub Copilot, and enterprise agent-skill patterns |
| DietrichGebert/ponytail | YAGNI-style agent behavior that pushes coding agents toward the smallest correct implementation |
| JuliusBrussee/caveman | Terse agent communication that removes filler while preserving technical substance |
| vercel-labs/skills | Open Skills CLI and discovery workflow for finding, installing, updating, and removing agent skills |
| OthmanAdi/planning-with-files | Persistent markdown planning for long-running coding-agent tasks and context recovery |
| psenger/ai-agent-skills | Production-oriented reusable skills for project structure, notes, and repeatable engineering workflows |
| mxyhi/ok-skills | Compact multilingual skill/playbook collection for Codex, Claude Code, Cursor, and OpenClaw |
| kodustech/awesome-agent-skills | Software engineering skill catalog covering frontend, backend, DevOps, testing, security, observability, and AI/ML |
| π§ Provider | π Resource | π Focus Area |
|---|---|---|
| OpenSource Book: Agentic Design Patterns | Agentic Design Patterns | Hands-on agentic systems |
| LangChain | Chat LangChain | Chat with LangChain docs |
| LangChain for LLM App Dev | Prompting, chains, memory | |
| Functions, Tools & Agents | Tool calling, agents | |
| LangGraph Intro Course | Agentic execution | |
| LangChain Tutorials | End-to-end apps | |
| LlamaIndex | Chat LlamaIndex | Chat with LlamaIndex docs |
| Advanced RAG Certification | Production RAG | |
| Agentic RAG Course | Agentic RAG | |
| LlamaIndex Docs | Indexing & ingestion | |
| Hugging Face | LLM Course | Transformers & tokenizers |
| AI Agents Course | Agent architectures | |
| Diffusion Models Course | Image diffusion | |
| Open Source Models | Discovery & eval | |
| Microsoft | Generative AI for Beginners | GenAI foundations |
| AI for Beginners | Classical AI/ML | |
| AI Agents for Beginners | Agent systems | |
| AWS | Intro to GenAI | Enterprise GenAI |
| Prompt Engineering Essentials | Prompting | |
| Responsible AI | Governance | |
| AWS PartyRock | No-code GenAI apps | |
| Meta (LLaMA) | Building with Llama 4 | Llama models |
- Deep Dive into LLMs β Andrej Karpathy
- Deep Dive into LLMs like ChatGPT
- Software Is Changing (Again)
- Making AI accessible
- What is Agentic AI?
- Discover AI β Code4AI
- The AI GRID
- Krish Naik
- AI by Hand β Dr. Tom Yeh
- LLM Watch β Pascal Biese
- LangChain Blog
- LlamaIndex Blog
- MLOps Architect Mindset
- ByteByteGo Newsletter
Contributions are welcome!
If you spot an error, want a new notebook, or have an improvement idea:
- Read the Contributing Guide
- Open a PR / issue with a clear description
Security issues should be reported privately (see SECURITY.md).
This project is licensed under the MIT License β see the LICENSE file for details.
These notebooks reflect personal learnings and experiments.
Mistakes are part of the journey β use this repo as a starting point and adapt freely.
If this helps you, consider giving it a β on GitHub β it helps others find it too.