The enormous energy requirement of these brute force statistical models is due to the following attributes:

• Requires millions or billions of training examples
• Requires many training cycles
• Requires retraining when presented with new information
• Requires many weights and lots of multiplication

ChatGPT and other AI applications such as Midjourney have pushed “Artificial Intelligence” high on the hype cycle. In this article, I want to focus specifically on the energy cost of training and using applications like ChatGPT, what their widespread adoption could mean for global CO₂ emissions, and what we could do to limit these emissions.

Key points

• Training of large AI models is not the problem
• Large-scale use of large AI models would be unsustainable
• Renewables are not making AI more sustainable

The author shares how he leveraged Chat-GPT to solve some of the CTF hacking challenges at BSides 2023.

No matter what, though, I argue that “information retrieval” is—despite how LLMs are marketed—is one of the least interesting and reliable things you can do with them. It’s mostly interesting, as described above, a “common wisdom” sampler to examine the common narratives that show up repeatedly in the corpus.

One of the relatively little-discussed phenomena in the social critique of AI is the fact that it is not only a centralizing technology, but also one that increases the distance between people and the power of the owners of the coordinating infrastructure. Of course, there is no direct determinism of the infrastructure, but it matters in which way the playing field is tilted.

This is aguide for how to build the LLM from Facebook in an M2 Macbook Pro

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.