A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a fast serving framework for large language models and vision language models.

A shell script for easy dependencies cleanup.

Code for AINL 2020 paper Advances of Transformer-Based Models for News Headline Generation

The Python micro framework for building knowledge base powered ChatGPT assistants

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

Yulia-Lingo telegram bot can help you to learn new English vocabulary.

Telegram bot which enables to get the timetable

a online Marketplace for coffee retail (QA)

a online Marketplace for coffee retail (Frontend)

a online Marketplace for coffee retail (Backend)

Embedding Studio is a framework which allows you transform your Vector Database into a feature-rich Search Engine.

Friends don't let friends make certain types of data visualization - What are they and why are they bad.

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading