Use HuggingFace's Candle with Go.

LR Schedulers for Candle

ChatFlameBackend is an innovative backend solution for chat applications, leveraging the power of the Candle AI framework with a focus on the Mistral model

An extension library to Candle that provides PyTorch functions not currently available in Candle

An unofficial implementation of BitNet

Implementing the BitNet model in Rust

A lightweight Rust application to test interaction with large language models. Currently supports running GGUF quantized models with hardware acceleration.

Using YoloV8 in Candle to capture skeleton poses and map that to a Collada model

Rust Microservice for generating sentence embeddings through gRPC & HTTP.

Tutorial for Porting PyTorch Transformer Models to Candle (Rust)

Fullstack chatbot built using Rust. Made using Candle, Leptos, Actix, Tokio and Tailwind. Uses quantized Mistral 7B Instruct v0.1 GGUF models.

bilibili视频【CUDA 12.x 并行编程入门(Rust版)】配套代码

Token Classification for BERT-like models via Candle

An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Wasm) frontend packaged with Tauri!

Real-time camera feed object detection with React.js, WASM, Rust, Candle ML, and YOLO

deploy some machine learning models(CV, NLP,...) locally with candle, for fun

A minimalistic demo on semantic search based on Rust ecosystem (pipeline)

yet another chat application for LLMs using rust (axum, diesel) & SvelteKit, Ollama & candle, tools

Rust implementation of Surya

RWKV models and examples powered by candle.