#hugging-face

  1. tokenizers

    today's most used tokenizers, with a focus on performances and versatility

    v0.23.1 2.0M #bpe #nlp #hugging-face #tokenize #tokenizer
  2. safetensors

    functions to read and write safetensors which aim to be safer than their PyTorch counterpart. The format is 8 bytes which is an unsized int, being the size of a JSON header, the JSON…

    v0.7.0 1.4M #tensor #pytorch #hugging-face #tensorflow
  3. fastembed

    generating vector embeddings, reranking locally

    v5.13.4 246K #onnx #embedding-model #generator #text-embedding #reranking #vector-embedding #reranker #vector-search #hugging-face #qwen3
  4. hf-hub

    This crates aims ease the interaction with huggingface It aims to be compatible with the huggingface_hub python package, but only implements a smaller subset of functions

    v0.5.0 1.3M #hugging-face #machine-learning #hub
  5. llm-tokenizer

    LLM tokenizer library with caching and chat template support

    v1.3.2 169K #chat-template #llm #hugging-face #tiktoken
  6. hf-xet

    Client library and tooling for the Hugging Face Xet data storage system

    v1.5.2 46K #hugging-face #cloud-storage #dataset #large-files
  7. xet-data

    Data processing pipeline for chunking, deduplication, and file reconstruction; used in the Hugging Face Xet client tools. Intended to be used through the API in the hf-xet package.

    v1.5.2 48K #hugging-face #deduplicate #chunking
  8. xet-core-structures

    Core data structures including MerkleHash, metadata shards, and Xorb objects

    v1.5.2 48K #hash-map #hugging-face #xorb
  9. xet-client

    Client library for communicating with Hugging Face Xet storage servers. Use through the hf-xet crate.

    v1.5.2 17K #hugging-face #xorb #artificial-intelligence
  10. hf-fetch-model

    Download, inspect, and compare HuggingFace models from Rust. Multi-connection parallel downloads plus safetensors header inspection via HTTP Range. No weight data downloaded.

    v0.10.2 #download #hugging-face #model #machine-learning
  11. rust-hf-downloader

    TUI and CLI for searching and downloading HuggingFace models

    v1.4.0 #tui #downloader #hugging-face #model #rate-limiting #incomplete-download #gguf #authentication #download-speed #sha-256
  12. synaptic-openai

    OpenAI integration for Synaptic: ChatModel + Embeddings

    v0.4.0 #openai #embedding #synaptic #hugging-face #aws-bedrock #cohere #deepseek #pipe-operator #chat #compat
  13. toktrie_hf_tokenizers

    HuggingFace tokenizers library support for toktrie and llguidance

    v1.7.5 37K #tokenize #structured-output #hugging-face #llguidance #toktrie #byte-level #json-schema #context-free-grammar #llama-cpp
  14. plakat

    Local text-to-image, style transfer, LoRA, upscale and color-key CLI built on candle

    v0.4.0 #hugging-face #stable-diffusion #candle #image-generation
  15. xet-runtime

    Async runtime, configuration, logging, and utility infrastructure for the Hugging Face Xet client tools

    v1.5.2 36K #hugging-face #async-runtime #thread-pool
  16. puma

    A lightweight, high-performance inference engine for local AI

    v0.0.3 #artificial-intelligence #inference-engine #chat #chat-completion #hugging-face #openai #health-check #model-inference #gpu
  17. api_huggingface

    HuggingFace's API for accessing large language models (LLMs) and embeddings

    v0.3.0 280 #hugging-face #web-api #general-purpose
  18. object_detector

    Object detection using ORT and the yoloe-26-seg model. This model can detect multiple objects per image, each having a tag, pixel-level mask, and a boundingbox. It's pretrained, it has a vocabulary of 4000+ objects.

    v0.5.0 #object-detection #detect #bounding-box #vocabulary #ort #hugging-face #cuda #promptable #tensor-rt #onnx
  19. golem-ai-embed-hugging-face

    working with Hugging face embeding APIs on Golem Cloud

    v0.5.2 #hugging-face #golem #provider #cloud #embeding #web-search #video
  20. miktik

    A unified, multi-backend tokenizer library for LLMs

    v0.2.0 460 #tiktoken #hugging-face #llm #rust #tokenize #tokenizer
  21. hf-kernel-builder

    Build Hugging Face Hub kernels

    v0.14.1 #kernel #hugging-face #hub #compute #version #pytorch
  22. gradio

    Client in Rust

    v0.4.1 #hugging-face #client
  23. synaptic

    agent framework with LangChain-compatible architecture

    v0.4.0 #openai #agent-framework #graph #lang-chain #hugging-face #ollama #gemini #cohere #mcp #pdf
  24. bbpe

    Binary byte pair encoding (BPE) trainer and CLI compatible with Hugging Face tokenizers

    v0.6.3 #bpe #malware #hugging-face #binary #tokenizer
  25. chat-rs

    Build LLM clients with ease, attach them to your tools

    v0.2.0 #artificial-intelligence #gemini #multi-provider #tool-calling #claude #hugging-face #ollama #llm #cerebras #websocket
  26. hf-mem

    CLI to estimate inference memory requirements from the Hugging Face Hub

    v0.0.5 220 #hugging-face #inference #hub #cli #estimation #safetensors
  27. synaptic-huggingface

    HuggingFace Inference API integration for Synaptic: Embeddings

    v0.4.0 #inference #hugging-face #embedding #api-integration #synaptic #api-key #llm-provider #chat-template #qdrant-vector-store #openai
  28. rustyface

    A Huggingface downloading CLI tool written in Rust

    v0.1.3 200 #hugging-face #downloader #cli
  29. infernum

    CLI - From the depths, intelligence rises

    v0.2.0-rc.2 #inference #chat #cache #chat-history #depths #hugging-face #cuda #metal #gpu #local-llm
  30. bintensors

    high-performance binary tensor serialization format designed to be faster eliminating use of JSON serialization metadata

    v0.1.1 370 #tensor #hugging-face #pytorch #serde
  31. candle-pipelines

    intuitive pipelines for local LLM inference in Rust, powered by Candle. Inspired by Python's Transformers library.

    v0.0.7 #llm-inference #llama #pipeline #candle #hugging-face #tool-calling #local-llm #qwen3 #classification #text-output
  32. ztensor-cli

    Command-line tool for zTensor

    v1.2.3 #safetensors #compression #convert #tensor #format #migrate #zstd #hugging-face
  33. voice-tts

    Rust TTS library backed by MLX, starting with Kokoro

    v0.2.1 #text-to-speech #kokoro #mlx #cache #hugging-face #phoneme #apple-silicon
  34. icebreaker

    A local AI chat app powered by 🦀Rust, 🧊iced, 🤗Hugging Face, and 🦙llama.cpp

    v2026.2.0 #artificial-intelligence #llama-cpp #hugging-face #iced #local #chat
  35. facecrab

    Asset management and model downloading for rusty-genius

    v0.1.6 #hugging-face #model #download #llm
  36. model-rs

    CLI tool for downloading HuggingFace models and running local LLM inference

    v0.1.1 #llm-inference #hugging-face #llm #machine-learning
  37. pf-registry

    ProcessFork registry adapters: file, Hugging Face Hub, S3-compatible, IPFS, local OCI

    v1.0.15 #artificial-intelligence #amazon-s3 #ipfs #oci #process-fork #claude #hugging-face #vllm #push-pull #s3-compatible
  38. gradio_macro

    A macro for generating Gradio interfaces

    v0.5.0 #hugging-face #gradio #macro
  39. flodl-hf

    HuggingFace integration for flodl: safetensors, hub, tokenizers, pre-built models

    v0.5.3 #safetensors #artificial-intelligence #hugging-face #flodl #deep-learning
  40. toktrie_hf_downloader

    HuggingFace Hub download library support for toktrie and llguidance

    v1.7.5 600 #structured-output #hugging-face #tokenize #llguidance #toktrie #context-free-grammar #json-schema #llama-cpp #llm
  41. synthclaw

    Lightweight synthetic data generation library/CLI

    v0.1.3 #hugging-face #data-generation #synthetic-data-generation #synthetic-data #llm
  42. llm-kit-huggingface

    Hugging Face provider for LLM Kit

    v0.1.0 #hugging-face #api-bindings #llm
  43. autotokenizer

    我就只是想要rust能有一個簡單的,從hg上拉下config並製作chat prompt的,也這麼難!要我發明輪子,天啊!

    v0.1.5 #hugging-face #prompt #token #python
  44. jammi-ai

    Embeddable AI engine for inference, embeddings, vector search, and fine-tuning

    v0.2.0 #artificial-intelligence #vector-search #safetensors #inference-engine #onnx #fine-tuning #jammi #classification #hugging-face #ann
  45. am-compact

    Qwen3 inference engine with Attention Management KV-cache compaction (CUDA + Apple Silicon via MLX)

    v0.3.0 #inference-engine #safetensors #apple-silicon #mlx #qwen3 #compaction #bf16 #compacted #hugging-face #gpu
  46. shimmyjinja

    Minimal Jinja-like engine for Hugging Face chat_template strings

    v0.2.1 #chat-template #hugging-face #llm #jinja
  47. blazen-model-cache

    Shared model download and cache layer for Blazen local-inference backends

    v0.5.3 #cache-layer #model-download #blazen #shared #back-ends #hugging-face #ml
  48. rig-fastembed

    Rig vector store index integration for Fastembed. https://github.com/Anush008/fastembed-rs

    v0.4.1 600 #embedding-model #fastembed #rig #integration #vector #vector-store #onnx #artificial-intelligence #hugging-face #large-language-model
  49. mutranscriber

    transcribe video files using Qwen3-ASR

    v0.2.0 #video #gstreamer #transcribe #hugging-face #metal #audio #gpu-acceleration #transcription #audio-transcription #gstreamer-audio
  50. llmvm-outsource

    An llmvm backend which sends text and chat generation requests to known hosted language model providers

    v1.3.1 310 #hugging-face #llm #openai #api-bindings
  51. whisperforge-convert

    Convert HuggingFace Whisper safetensors to Burn with INT8 quantization support

    v0.3.1 #safetensors #hugging-face #whisper #model-conversion
  52. transformers

    Looking for HuggingFace Transformers in Rust? Check out candle-pipelines!

    v0.0.15 #hugging-face #transformer #candle-pipelines #python #looking #llm-inference
  53. tauri-plugin-huggingface-downloader-android

    lightweight Tauri 2.0 Android plugin for downloading large files from Hugging Face repositories. Features real-time progress tracking via optimized callbacks, background thread execution…

    v0.1.1 #tauri-plugin #hugging-face #downloader #android #background-thread #real-time #model-management
  54. triplets-hf-source

    Hugging Face integration for the triplets data pipeline framework

    v0.23.0-alpha #hugging-face #dataset-sampling #triplet-mining #train-test-split
  55. hmll

    Safe, idiomatic Rust bindings to the hmll library for high-performance ML model loading

    v0.1.0-rc.1 #safetensors #ml-model #model-loading #machine-learning #hugging-face
  56. rten-text

    Text tokenization and other ML pre/post-processing functions

    v0.24.0 170 #tokenize #token-id #text-tokenization #text-tokenizer #hugging-face #post-processing #bert #transformer-models #eg #canonical
  57. voice-stt

    Speech-to-text library backed by MLX, starting with Moonshine

    v0.1.0 #text-to-speech #mlx #moonshine #audio-samples #tokenize #hugging-face #cache #transcribe #conv #filesystem-access
  58. paca-cli

    Helpers for interacting with llama.cpp

    v0.2.0 #llama #llama-cpp #helper #model #hugging-face #cache-directory #local-models #local-cache
  59. hanzo-engine

    Hanzo Engine - canonical inference + embedding engine for the Hanzo stack

    v0.6.0 #inference-engine #artificial-intelligence #hanzo #canonical #stack #embedding #hugging-face
  60. kitsune-stt

    Speech-to-Text tool using Candle and Voxtral

    v0.1.0 #text-to-speech #candle #audio #audio-processing #voxtral #cuda #cudnn #hugging-face #gpu #transcribe
  61. hugging-face-client

    rust implment of Hugging Face Hub API

    v0.6.0 380 #hugging-face #api #hf
  62. sonr-daemon

    Background daemon for sonr, providing semantic search capabilities using local LLMs

    v0.1.7 #semantic-search #llama #local-llm #daemon #semantic-search-tool #model-context-protocol #gpu #hugging-face #embedding #tool-for-local
  63. kokorox

    Lightning fast text-to-speech with the Kokoro model in rust

    v0.1.5 #text-to-speech #kokoro #hugging-face #spanish #japanese #espeak-ng #french #language-detection #onnx
  64. smolagents-rs

    port of the the HuggingFace smolagents library. Build LLM agents with tools and code execution.

    v0.1.2 #hugging-face #google-search #llm #agent #port #task-execution #duckduckgo #code-execution #function-calling #logging
  65. blazen-embed-candle

    Local embedding backend for Blazen using HuggingFace candle

    v0.5.3 #hugging-face #blazen #inference #candle #local #embedding-model #cuda #metal #text-embedding #stub
  66. tokenizers-enfer

    today's most used tokenizers, with a focus on performances and versatility

    v0.21.1 #tokenize #hugging-face #word-piece #bpe #tokenizer
  67. gradio_client_rs

    Async Rust client for Gradio apps

    v0.1.0 #hugging-face #gradio #client #api-bindings
  68. alith-models

    Load and Download LLM Models, Metadata, and Tokenizers

    v0.4.3 #gguf #model #tokenize #hugging-face #metadata #llm #embedding #artificial-intelligence
  69. dsq-io-huggingface

    HuggingFace Hub I/O plugin for dsq

    v0.2.0 #hugging-face #hub #io
  70. entrenar-shell

    Interactive REPL for HuggingFace model exploration and distillation

    v0.1.0 #model-distillation #interactive-repl #entrenar #hugging-face #exploration
  71. Try searching with DuckDuckGo.

  72. coze

    An egui app for playing with a local open source LLM

    v0.1.7 550 #local-llm #egui #model #mistral #zephyr #candle #cache #instruct #model-weights #hugging-face
  73. burn_dragon_sudoku

    Sudoku datasets and training for burn_dragon

    v0.4.0 #burn-dragon #training #sudoku #dataset #inference #metrics #hugging-face #positional #cache #alt-text
  74. training-tools

    Training monitoring, HuggingFace integration, and checkpoint management for rust-ai

    v0.1.0 #hugging-face #training #monitoring #machine-learning
  75. candle_embed

    Text embeddings with Candle. Fast and configurable. Use any model from Hugging Face. CUDA or CPU powered.

    v0.1.4 130 #hugging-face #cuda #vector-embedding #search #embeddings
  76. candle-hf-hub

    crates aims ease the interaction with huggingface It aims to be compatible with huggingface_hub python package…

    v0.3.3 1.7K #hugging-face #hf-hub #machine-learning #hub
  77. aleph-alpha-tokenizer

    A fast implementation of a wordpiece-inspired tokenizer

    v0.3.1 #tokenize #aleph-alpha #hugging-face #tokenizer
  78. oxidized-transformers

    Transformers library (not functional yet)

    v0.1.1 #llama #transformer-models #hugging-face #bert #oxidized #cuda #albert #float16
  79. llmvm-outsource-lib

    outsource backend for llmvm

    v1.3.1 #hugging-face #openai #llm #api-bindings
  80. canon-embed

    Local embedding generation for Canon (MiniLM, CPU-only)

    v0.2.0 #embedding-generation #model #cache #hugging-face #local #canon #cp
  81. hmll-sys

    Low-level FFI bindings to the hmll library for high-performance ML model loading

    v0.1.0-rc.1 #machine-learning #hugging-face #ffi #ffi-bindings #ml
  82. hf-hub-simple-progress

    Simplified download callback for hf-hub

    v0.1.2 170 #hf-hub #hugging-face #machine-learning #hub
  83. diskard-core

    Core library for diskard — developer-aware disk cleanup

    v0.2.0 #cleanup #disk-cleanup #xcode #docker #ollama #hugging-face #config-file #npm #cache
  84. content-semantic

    UCFP semantic fingerprinting (embedding generation) crate

    v0.1.0 #onnx #embedding-generation #fingerprinting #ucfp #semantic #stub #hugging-face #similarity-search #file-api
  85. hf-hub-enfer

    crates aims ease the interaction with huggingface It aims to be compatible with huggingface_hub python package…

    v0.3.2 #hugging-face #hf-hub #machine-learning #hub
  86. aiha

    🦉 AIHA helps you to find the minimal requirements for any model on the 🤗 Hub

    v0.0.4 #hugging-face #advisor #nlp #hardware
  87. huggingface

    v0.1.0 #huggingface
  88. huggingface_inference_rs

    this package is a small wrapper for hugging face Inference API

    v0.5.0 #hugging-face #inference #classification #questions #wrapper #emotions
  89. spn-native

    Native model inference and storage for SuperNovae ecosystem

    v0.2.0 #gguf #hugging-face #inference #llm-inference #llm #supernovae
  90. entrenar-common

    Shared infrastructure for entrenar CLI tools

    v0.2.0 1.7K #shared-infrastructure #entrenar #model-training #hugging-face #actionable #progress-indicator #aprender #artificial-intelligence #lora #gpu-monitoring
  91. aprender-train-distill

    End-to-end knowledge distillation CLI

    v0.31.2 #gguf #distillation #end-to-end #aprender #knowledge #progressive #attention #student #teacher #hugging-face
  92. image_captioner

    Create captions for images automatically using the BLIP deep learning model

    v0.2.2 #caption #model #blip #automatic #image #generate-image #deep-learning #image-processing #hugging-face
  93. aprender-train-shell

    Interactive REPL for HuggingFace model exploration and distillation

    v0.31.2 #interactive-repl #hugging-face #exploration #aprender #distillation
  94. llm-bloom

    BLOOM (BigScience Large Open-science Open-access Multilingual Language Model) for the llm ecosystem

    v0.1.1 390 #large-language-model #ggml #llm #llama-cpp #ecosystem #llm-cli #multilingual #llm-inference #open-access #hugging-face
  95. token-counter

    wc for tokens: count tokens in files with HF Tokenizers

    v0.1.0 #tokenize #hugging-face #tokenizer #cli
  96. ggml-sys

    Raw bindings (i.e. bindgen output) for the ggml library.

    v0.1.1 390 #artificial-intelligence #bindings #llm #bindgen #ml #quantize #hugging-face