[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

troposphere - Python library to create AWS CloudFormation descriptions

Zep | Examples, Integrations, & More

Best practice and tips & tricks to write scientific papers in LaTeX, with figures generated in Python or Matlab.

Task-Aware Agent-driven Prompt Optimization Framework

Because sometimes you need to do it live

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Turn a MacBook into a Touchscreen with $1 of Hardware

A framework for prompt tuning using Intent-based Prompt Calibration

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"

The Security Toolkit for LLM Interactions

PyTorch and TensorFlow implementation of NCP, LTC, and CfC wired neural models

An LLM-based autonomous agent controlling real-world applications via RESTful APIs

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

A framework for comprehensive diagnosis and optimization of agents using simulated, realistic synthetic interactions

Closed-form Continuous-time Neural Networks

Code for our ACL 2023 Paper "Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models".

lightweight, python based chat ui

Bears for coala

A Sublime Text 2/3 plugin for maintaining local history of files. [backup | open | compare | incremental diff]

[USENIX Security 2025] PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models

Build Generative AI applications with Langchain on AWS

Convert number words (eg. twenty one) to numeric digits (21)

Create a pdf with barcodes to backup text files on paper. Designed to backup ASCII-armored GnuPG and SSH key files and ciphertext.

Converts text such as "twenty three" to number/digit "23" in any sentence

DSTC 11 Track 2: Intent Induction from Conversations for Task-Oriented Dialogue

This repository makes the integral Let's Go dataset publicly available.

DSTC11 Track 5 - Task-oriented Conversational Modeling with Subjective Knowledge