Skip to content

ivostoykov/localAI

Repository files navigation

localAI

Use local AI within the browser

alt text

What is LocalAI?

LocalAI is designed to bridge the gap where traditional tools fall short—offering access to web content, local files, and on-the-go resource fetching.

Why use it?

If you value privacy but still want the power of LLMs, LocalAI is for you. There’s no need to install applications, deal with configurations, or handle version compatibility issues. It works seamlessly with Chrome, Firefox, and their derivatives.

Key Benefits:

  • Local Control: Your data stays on your device—no sharing or storing of your actions. You control what to keep or delete.
  • Task Assistance: Need summaries or quick insights? LocalAI helps with tasks using the information in your active tab.
  • Web Search: Ask the AI to search the web and it will use your configured search engine in a background tab — no external APIs, no credential sharing.
  • Custom Prompts: Create, store, and execute your own prompts locally for a personalised experience.
  • External Hooks: Enhance functionality by integrating your own solutions and resources.

What do you need to use it?

You’ll need enough hardware power, preferably with a GPU.

A local AI tool—these are easy to set up, usually just download and run:

  • Ollama server is used as the API endpoint.

If you use Ollama Cloud, the current preferred setup is still the local Ollama endpoint. Sign in with the Ollama app or CLI first, then keep the extension pointed at your local '/api/*' endpoint. Cloud-tagged models exposed by the signed-in local daemon can then be used without storing API keys in the extension.

The model picker now loads two catalogues:

  • Local models are fetched from your configured Ollama endpoint '/api/tags'.
  • Cloud models are fetched from https://ollama.com/api/tags.

If Ollama Cloud access is a concern in your environment, note that refreshing the model catalogue will make that external request for the cloud tab.

[! Warning]: The following API providers are deprecated for now and will only be reinstated upon request.

And the browser extension.

It’s easy—give it a try and let us know your thoughts!

Where to get it?

Browser Extension
Chrome Chrome link
Firefox Firefox link

Important

If you are a Firefox user, please read this.


Here is the documenration where you can get a deepr understanding.

About

Use local AI within the browser

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors