react-llm

Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. As simple as useLLM().

Features

Supports Vicuna 7B
Use custom system prompts and "user:"/"assistant:" role names
Completion options like max tokens and stop sequences
No data leaves the browser. Accelerated via WebGPU
Hooks built to 'Bring your own UI'
Persistent storage for conversations in browser storage. Hooks for loading and saving conversations

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow react-llm

react-llm Web Site

Other Useful Business Software

Get the most trusted enterprise browser

Advanced built-in security helps IT prevent breaches before they happen

Defend against security incidents with Chrome Enterprise. Create customizable controls, manage extensions and set proactive alerts to keep your data and employees protected without slowing down productivity.

Download Chrome

Rate This Project

User Reviews

Be the first to post a review of react-llm!

Additional Project Details

Programming Language

TypeScript

Related Categories

TypeScript Large Language Models (LLM), TypeScript Headless Browsers

Registered

2023-08-25

Similar Business Software

PhantomJS

PhantomJS is a headless web browser scriptable with JavaScript, running on Windows, macOS, Linux, and FreeBSD. Utilizing QtWebKit as its back-end, it offers fast and native support for various web standards, including DOM handling, CSS selectors, JSON, Canvas, and SVG. This makes it an optimal...

See Software
Browserbase

Headless browsers that work everywhere, every time. Control fleets of stealth browsers to build reliable browser automation. Focus on your code with autoscaled browser instances, and best-in-class stealth features. Run hundreds of browsers with powerful resources to power uninterrupted...

See Software
LM-Kit.NET

LM-Kit.NET is a cutting-edge, high-level inference SDK designed specifically to bring the advanced capabilities of Large Language Models (LLM) into the C# ecosystem. Tailored for developers working within .NET, LM-Kit.NET provides a comprehensive suite of powerful Generative AI tools, making...

See Software
SlimerJS

SlimerJS is a free, open source scriptable browser for web developers, allowing interaction with web pages through external JavaScript scripts. It enables tasks such as opening web pages, clicking links, and modifying content, making it useful for functional tests, page automation, network...

See Software
Vertex AI

Build, deploy, and scale machine learning (ML) models faster, with fully managed ML tools for any use case. Through Vertex AI Workbench, Vertex AI is natively integrated with BigQuery, Dataproc, and Spark. You can use BigQuery ML to create and execute machine learning models in BigQuery...

See Software
NetNut

Get ready to experience unmatched control and insights with our user-friendly dashboard tailored to your needs. Monitor and adjust your proxies with just a few clicks. Track your usage and performance with detailed statistics. Our team is devoted to providing customers with proxy solutions...

See Software

Report inappropriate content

react-llm

Easy-to-use headless React Hooks to run LLMs in the browser with WebGP

Get an email when there's a new version of react-llm

Features

Project Samples

Project Activity

Categories

License

Follow react-llm

User Reviews

Additional Project Details

Programming Language

Related Categories

Registered