DEV Community

#llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to Run LLMs Locally on a Mac in 2027 (Even with 8GB or 16GB)

How to Run LLMs Locally on a Mac in 2027 (Even with 8GB or 16GB)

Comments
16 min read
I let coding agents use my Android phone, then made one run on the phone's NPU

I let coding agents use my Android phone, then made one run on the phone's NPU

Comments 1
3 min read
How Far Has the 'AI Writes the Paper' Era Actually Come? Reading Sakana AI's AI Scientist Series

How Far Has the 'AI Writes the Paper' Era Actually Come? Reading Sakana AI's AI Scientist Series

Comments
23 min read
How the basal LLM saves time and compute on text decisions

How the basal LLM saves time and compute on text decisions

Comments
12 min read
How long does Qwen3.8-27B take with a long document?

How long does Qwen3.8-27B take with a long document?

Comments
8 min read
How to build a self-hosted LLM API, from GPU to customer

How to build a self-hosted LLM API, from GPU to customer

Comments
11 min read
Keeping a 3B model honest: source-checked song facts for live streams

Keeping a 3B model honest: source-checked song facts for live streams

Comments
5 min read
The most dangerous AI claims aren’t wrong — they’re overstated

The most dangerous AI claims aren’t wrong — they’re overstated

Comments
2 min read
37.1 MiB/s with Zero Token Overflows: Guaranteed Token Budgets and Table-Aware Chunking in text-chipper

37.1 MiB/s with Zero Token Overflows: Guaranteed Token Budgets and Table-Aware Chunking in text-chipper

Comments
5 min read
Why AI Apps Crash Under Real Traffic (And How to Fix It in 2 Lines)

Why AI Apps Crash Under Real Traffic (And How to Fix It in 2 Lines)

Comments
6 min read
Walkthrough up: Inkling 2 Mini ties Qwen3.8-27B at a sixth of the inference cost

Walkthrough up: Inkling 2 Mini ties Qwen3.8-27B at a sixth of the inference cost

1
Comments
1 min read
Why your LLM is slow twice, and why it runs out of memory: prefill, decode and the KV cache

Why your LLM is slow twice, and why it runs out of memory: prefill, decode and the KV cache

Comments
3 min read
YodaMan 0.6.7 and Context Expert 1.4.0: we wrote down what our tool does, and found 50 bugs

YodaMan 0.6.7 and Context Expert 1.4.0: we wrote down what our tool does, and found 50 bugs

Comments
5 min read
The AI-Assisted Riemann Hypothesis Proof: What Independent Checks Actually Show

The AI-Assisted Riemann Hypothesis Proof: What Independent Checks Actually Show

Comments
5 min read
Hammer Drill vs. Chisel: Why Working Without AI Feels Slow Now

Hammer Drill vs. Chisel: Why Working Without AI Feels Slow Now

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.