DEV Community

# localllm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Privacy-Routed LLM Inference: Keeping Sensitive Data Out of the Cloud

Privacy-Routed LLM Inference: Keeping Sensitive Data Out of the Cloud

Comments
6 min read
Localmaxxing isn't theory. Here's what my 3-GPU rig actually does.

Localmaxxing isn't theory. Here's what my 3-GPU rig actually does.

Comments
4 min read
[Day 6] I Had an AI Look at 25,000 iPhone Photos and It Decided My Mom and I Are the Same Person

[Day 6] I Had an AI Look at 25,000 iPhone Photos and It Decided My Mom and I Are the Same Person

Comments
8 min read
TextGen vs LM Studio: Picking a Local LLM Runner in 2026

TextGen vs LM Studio: Picking a Local LLM Runner in 2026

1
Comments
5 min read
Local LLMs in 2026: What Actually Works on Consumer Hardware

Local LLMs in 2026: What Actually Works on Consumer Hardware

Comments
7 min read
[Day 2] I Trained an AI on 22 Photos of My Cat — Now It Draws Her in Any Scene

[Day 2] I Trained an AI on 22 Photos of My Cat — Now It Draws Her in Any Scene

Comments
6 min read
Devstral 2: Run Mistral's Open Coding Agent Locally

Devstral 2: Run Mistral's Open Coding Agent Locally

Comments
9 min read
My AI Experience in Russia as a European🤯

My AI Experience in Russia as a European🤯

Comments
4 min read
[Day 5] I Trained My Cat-LoRA on 22 vs 213 Photos and the Results Were Basically Identical

[Day 5] I Trained My Cat-LoRA on 22 vs 213 Photos and the Results Were Basically Identical

Comments
9 min read
How to Run Qwen 3.6 Locally - 27B Dense, 35B MoE, and Coding Variants Setup Guide

How to Run Qwen 3.6 Locally - 27B Dense, 35B MoE, and Coding Variants Setup Guide

Comments
3 min read
Run Gemma 3 Locally on Windows: The VRAM Guide Nobody Gave You [2026]

Run Gemma 3 Locally on Windows: The VRAM Guide Nobody Gave You [2026]

Comments
8 min read
Local LLM for Log Analysis: Privacy-First Debugging with Ollama

Local LLM for Log Analysis: Privacy-First Debugging with Ollama

Comments
7 min read
Locally Uncensored v2.4.0 — Settings Polish, Linux Drag Fix, and Configurable HuggingFace Path

Locally Uncensored v2.4.0 — Settings Polish, Linux Drag Fix, and Configurable HuggingFace Path

Comments
3 min read
GPU Prices Up 48% in Two Months. I Run LLMs in My Garage.

GPU Prices Up 48% in Two Months. I Run LLMs in My Garage.

Comments
3 min read
Local LLM on NVIDIA GPU vs Cloud API: A Real Cost Analysis

Local LLM on NVIDIA GPU vs Cloud API: A Real Cost Analysis

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.