PinnedAndrew Zhu·Jun 30, 2024I wrote a book for Using Stable Diffusion with PythonBehind the scenes of writing book: Using Stable Diffusion with PythonA response icon1A response icon1
Andrew Zhu·1h agoHow Modern LLMs Actually Generate Text: A Pure Python WalkthroughLoading real Qwen3–0.6B weights in 200 lines of MLX — no PyTorch, no transformers library, pure simple Python code
Andrew Zhu·1d agoWhy DeepSeek Open Sources EverythingYesterday, I came across the full transcript of an internal investor talk delivered by Liang Wenfeng, founder of DeepSeek.A response icon3A response icon3
Andrew Zhu·1d agoLaguna S 2.1: My First Few Hours Running It on 3 RTX 3090s — Community Fears Were WrongThree RTX 3090s humming in my garage. Twenty-four gigabytes of VRAM each, 72GB total. When I told people I was going to run Laguna S 2.1 —…A response icon1A response icon1
Andrew Zhu·2d agoLaguna S 2.1: What Is the Community’s Voice About This 118B MoE Model?I have the weights downloading as I write this. Four RTX 3090s are being cabled together in my garage, and I’m about to rebuild llama.cpp…A response icon2A response icon2
Andrew Zhu·2d agoOpenAI Swear It Was an “Accident.” — Is It?The wolf dressed as a sheepdog just admitted it broke into the barn — and now wants you to believe it was just looking for directionsA response icon4A response icon4
Andrew Zhu·3d agoLlama.cpp Two Batch Sizes: --n_batch and --n_ubatch- Why They are Actually Matter (And When They…If you’ve ever stared at a llama.cpp command and seen:
Andrew Zhu·4d agoWhat We Can Learn From The HuggingFace AttackLast week, something unprecedented happened. An autonomous AI agent system hacked into HuggingFace’s production infrastructure over a…A response icon10A response icon10
Andrew Zhu·5d agoWhat to Prepare While You Still Have a JobA survival guide if you’re still employed but worried about tomorrow
Andrew Zhu·6d agoSelling AI APIs Is A Dead EndThe subscription model hyperscalers bet everything on can’t survive physics, competition, or their own greedA response icon5A response icon5