Practical Llama 3 inference in Java
-
Updated
Jan 16, 2025 - Java
Practical Llama 3 inference in Java
GPU-accelerated Llama3.java inference in pure Java using TornadoVM.
Odin Runes, a java-based GPT client, facilitates interaction with your preferred GPT model right through your favorite text editor. There is more: It also facilitates prompt-engineering by extracting context from diverse sources using technologies such as OCR, enhancing overall productivity and saving costs.
V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!
Llama3.java Inference engine with OpenAI Chat Completion REST API/
Spring AI, Ollama, llama3.1, nomic-embed-text, PGVector
A collection of Spring AI examples
Bot MicroIA es un bot inteligente para Telegram, diseñado para ofrecer respuestas dinámicas y contextuales mediante modelos de lenguaje avanzados como LLaMA 2 y LLaMA 3, integrados a través de Ollama. Su arquitectura basada en Java y Spring Boot, junto con una API REST, permite una comunicación fluida y escalable entre el bot y los servicios.
A high-performance Llama3 implementation using Micronaut and GraalVM Native Image
ChatLlama🦙 is an AI chat bot inspired by ChatGPT running LLMs locally on an Ollama Server via Docker
A local AI-powered chatbot built with Spring Boot for interactive conversations and intelligent assistance. This project focuses on developing a self-hosted, customizable AI chatbot suitable for various use cases.
Spring AI Functions With Local Ollama and Mistral
Spring AI, Ollama, model llama3.1
A multiple choice practice application
Add a description, image, and links to the llama3 topic page so that developers can more easily learn about it.
To associate your repository with the llama3 topic, visit your repo's landing page and select "manage topics."