Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

Swift library to work with llama and other large language models.

校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。

LLaVA server (llama.cpp).

Runs LLaMA with Extremely HIGH speed

Explore LLM model deployment based on AXera's AI chips

on-chain LLMs

Llama causal LM fully recreated in LibTorch. Designed to be used in Unreal Engine 5

Node.js binding of Llama.cpp

Super easy to use library for doing LLaMA/GPT-J stuff! - Mirror of: https://gitlab.com/niansa/libjustlm

Multi-Model and multi-tasking llama Discord Bot - Mirror of: https://gitlab.com/niansa/discord_llama