This project is exactly what I was looking for. Thank you for creating it!

small pull request which just allows people to easily use their own proxies allowing for use of free versions of openai, and allows use for better management of keys through account tokens in the proxy.

What are free versions of openai @RayBytes ?

small pull request which just allows people to easily use their own proxies allowing for use of free versions of openai, and allows use for better management of keys through account tokens in the proxy.

What are free versions of openai @RayBytes ?

Basically, many people have created free APIs which harness the power of openai (either through hosting it themselves or staying alive from donations or other etc) and people can use them for free rather than having to pay for openai.

@RayBytes Could you provide examples of those free APIs ?

I do not see a reason to do that.

If you want to find them, search them up online. This pull request is just to add the base option for support of it, and this is going off-topic.

Why is this still not merged? I run it locally all the time with text-generation-webui and OpenAI API using the changes proposed in this PR