This repository offers a streamlined solution for deploying local LLM applications, utilizing the Llama-2-7B model as its backbone, yet it's fully adaptable to any LLM framework. It serves as a prototype for a creative writer application, generating articles from user-defined topics. Its core functionality—prompt-based response generation from the LLM—enables the development of a tons of applications by simply altering the prompts.

1. Repository Cloning: Clone the repository to initiate your local setup.
2. Download Model: Download LLM model from the HuggingFace and save it in /models

   Download link: (https://huggingface.co/BashitAli/llama-2-7b-chat.ggmlv3.q5_K_M)

3. Virtual Environment: Establish an isolated environment for dependency management

   conda create -p env_name python==3.9 -y
   

4. Dependency Installation: Install necessary dependencies using requirements.txt

   pip install -r requirements.txt

5. Application Initialization: Launch the application through Streamlit

   streamlit run app.py

The modular design of this framework permits the creation of diverse LLM applications through prompt customization: We can implement minor modifications to get the target application as follows:

• Prompt Customization for Application: change the prompt to get the desired result.

  ## PromptTemplate
    template = """ WRITE THE PROMPT FOR NEW APPLICATION """

    prompt = PromptTemplate(input_variables = ["input_text", "no_words", "blog_style"],
                            template = template)

• Temperature: Change the value of temperature to make model response more or less creative