A high-throughput and memory-efficient inference and serving engine for LLMs

The best-benchmarked open-source AI memory system. And it's free.

Fully automatic censorship removal for language models

The Data Engineering Cookbook

Unified framework for building enterprise RAG pipelines with small, specialized models

Jobs scraper library for LinkedIn, Indeed, Glassdoor, Google, ZipRecruiter & more

Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion

Scripts of possible interest to macOS admins

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-fri…

Example detection of compromise credentials in AWS

Like gmail for your coding agents. Lets various different agents communicate and coordinate with each other.

A brain harness for large language models. Long-term memory, Trinity dialectic, research corridors, biomimetic architecture. LLM-agnostic.