No one is certain who first made the observation that "writing about music is like dancing about architecture". I assume it was intended to convey the impossibility of capturing one medium of expression in another. On the other hand, we write about music just as we write about every form of human experience.
We write to describe, to inform, to analyze, to criticize, to opine, to rage, to enthuse, and to connect with others. "These are my thoughts, my feelings, my passions and fears: what are yours?"
As a teen, I wrote a fanzine to share my enthusiasms, and to connect with fellow fans. Upon discovering music blogs, I recognized them as the new fanzines, and again felt the impulse to connect.
This is a lengthy preface to another of Stinky's Homemade Records. His concept is songs by writers who became musicians. Together, we fleshed out a list. Some are well-known, like Lenny Kaye and Lester Bangs. Patti Smith penned record reviews; so did Chrissie Hynde. Crocus Behemoth was a pen name before it became a stage name for David Thomas (who performed with writer-musician Peter Laughner).
Punk inspired another wave of writers turned performers: Nick Kent, Vivien Goldman, Sylvie Simmons, and Mark Perry. "Ranking Jeffrey Lee" reviewed reggae and dub for Slash before forming The Gun Club; Chris D also wrote for Slash while fronting the Flesh Eaters, running his own label and producing records.
Ira Kaplan and Glenn Morrow started at NY Rocker. Steve Albini wrote for Matter magazine and Forced Exposure (which, like Slash and Sub Pop, was a zine turned record label).
Gregg Turner and Mike Saunders wrote for zines before backing critic Richard Meltzer in VOM, and then forming the Angry Samoans. Michael Hall was a music writer before he led The Wild Seeds. Neil Tennant wrote for Smash Hits, and Marilyn Manson was first a music journalist. We're still coming up with more examples, and maybe you have suggestions for Journalists Turned Recording Artists Vol. 2. For now, here's Volume One!