A high-throughput and memory-efficient inference and serving engine for LLMs

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr…

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous …

🪨 why use many token when few token do trick — Claude Code skill that cuts 65% of tokens by talking like caveman

A library that allows you to easily mock out tests based on AWS infrastructure.

SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing

Mail hosting made simple

A Web UI for easy subtitle using whisper model.

4Bit Quantized Model for HiDream I1

Main pip package location for Masonite

The amavis frontend of Modoboa