awesome fringe books from 2004. love the site design and wanna check out the books.

These days, I’m exploring the field of natural language generation, using auto-regressive models such as GPT-2. HuggingFace transformers offers a host of pretrained language models, many of which can be used off the shelf with minimal fine-tuning. In this post, however, we will try to build a small GPT model from scratch using PyTorch. I’ve realized that sometimes I feel eerily insecure about using things without truly understanding how they work. This post is an attempt at understanding the GPT model. Turns out that its implementation is actually quite similar to the transformers implementation I wrote about in an earlier post, so you will see some repeats here and there. Also helpful was Karpathy’s minGPT repository, which I heavily referenced for this particular implementation. With that sorted, let’s get started!

Musings of a Computer Scientist.

A cozy command-line clubhouse for computer people. Chat, music, games, art, coding, and tech news. Connect with any SSH client!

:set virtualedit=all

These are some products that I’m excitedly following (or am keen to get) because they’re technologies without the intent to dominate.

Continuing his quest for a healthier, more handsome Hitch, the author puts himself in the hands of four experts. Yes, a Brazilian wax was involved.

There’s an entire micro-economy based on the pursuit of betterment. The author—58, full-figured, and ferocious in his consumption of cigarettes and scotch—agreed to test its limits, starting with the Executive De-Stress Treatment at a high-end spa.

Millenarianism or millenarism (from Latin millenarius ‘containing a thousand’ and -ism) is the belief held by a religious, social, or political group or movement in a coming fundamental transformation of society, after which “all things will be changed”. Millenarianism exists in various cultures and religions worldwide, with various interpretations of what constitutes a transformation.

via: https://www.marginalia.nu/log/a_138_systemdocker/

Stitch generates UIs for mobile and web applications, making design ideation fast and easy.