Robin Sloan’s take on AI training on Everything.

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄. - vanna-ai/vanna: 🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.

In this post, we’ll talk about why fine-tuning is probably not necessary for your app, and why applying two of the most common techniques to the base GPT models — few-shot prompting and retrieval-augmented generation (RAG) — are sufficient for most use cases.

The enormous energy requirement of these brute force statistical models is due to the following attributes:

• Requires millions or billions of training examples
• Requires many training cycles
• Requires retraining when presented with new information
• Requires many weights and lots of multiplication