Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enh: pip open-webui[min] installation #6369

Open
AntonKrug opened this issue Oct 23, 2024 · 0 comments
Open

enh: pip open-webui[min] installation #6369

AntonKrug opened this issue Oct 23, 2024 · 0 comments

Comments

@AntonKrug
Copy link

Feature Request

Is your feature request related to a problem? Please describe.
The docker has a option for the cases when you run ollama and models on a separate machine, however local pip install is installing the fullest set of nvidia and cuda drivers which i will not use. Is there a way to make a very minimalistic install just for the front end UI without the bulky rest?

Describe the solution you'd like
Cleaner separation of backend and frontend when installing through pip.

Describe alternatives you've considered
I was trying to install it as is, but it's really unecesary bulky, the torch library depends on ram, the nvidia cuda drivers depend on storage, and they will not even get used as the machine run diferent a VM where there is a GPU passed through, has most of the ram and most of the storage allocated. I would strongly prefer to have this separation even if the UI would end up having some features disabled. Forcing me make huge LXC container. Making multi GB LXC container feels to me almost abusing the concept of lightweight containers. At what point it's actually maybe better to make a dedicated VM instead of container.

Additional context
I do not want to use docker as I already have LXC support in my proxmox and so far everything can be done through LXC containers, installing docker for just one app feels to me overkill.

@tjbck tjbck changed the title More lightweight installation thorugh pip enh: pip open-webui[min] installation Oct 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant