Lib.rs

› Keywords #database #logging #key-value-store #embedded-database #cloud-storage

#storage-engine

  1. slatedb

    A cloud native embedded storage engine built on object storage

    v0.13.0 75K #object-storage #storage-engine #cloud-storage #sst #embedded-database #bloom-filter #block-cache #compaction #disk-cache #rocksdb

  2. libmdbx

    Idiomatic and safe MDBX wrapper

    v0.6.6 60K #mdbx #database #bindings #storage-engine

  3. rustack-dynamodb-core

    DynamoDB business logic and storage engine for Rustack

    v0.7.1 #dynamo-db #rustack #storage-engine #business-logic #aws #aws-dynamo-db #mb #emulation #metrics #amazon-s3

  4. ankurah-storage-common

    Ankurah storage engine common libraries

    v0.7.23 #storage-engine #ankurah #state-sync #define #once #data-model #multi-player #data-synchronization #state-management #real-time

  5. lsmlite-rs

    Helsing's Rust bindings for sqlite3's lsm1 extension in stand-alone fashion

    v0.2.2 210 #storage-engine #persistence #embedded #lsm

  6. simd-r-drive

    SIMD-optimized append-only schema-less storage engine. Key-based binary storage in a single-file storage container.

    v0.16.2-alpha 550 #storage-engine #mmap #binary-storage #simd #append-only

  7. rustack-dynamodbstreams-core

    DynamoDB Streams business logic and storage engine for Rustack

    v0.7.1 #dynamo-db #rustack #storage-engine #business-logic #stream #aws #logging #aws-dynamo-db #amazon-s3

  8. fsqlite-btree

    B-tree storage engine

    v0.1.3 2.3K #b-tree #storage-engine #database #cursor-position #chain #learned-index #mvcc #cracking #table-index #cursor-table

  9. aeternusdb

    An embeddable, persistent key-value store built on an LSM-tree architecture

    v1.0.1 #database #key-value #embedded-database #lsm-tree #storage-engine

  10. meshdb-storage

    RocksDB-backed storage engine for Mesh

    v0.2.0 #graph-database #mesh #rocksdb #properties #deployment #storage-engine #rocks-db-backed #neo4j #distributed #apoc

  11. raft-storage

    Custom LSM-tree storage engine with WAL, MemTable, SSTables, bloom filters, and leveled compaction

    v0.1.2 #storage-engine #raft #key-value-store #raft-consensus #lsm-tree #bloom-filter #wal #compaction #mem-table #mvcc

  12. raft-engine

    A persistent storage engine for Multi-Raft logs

    v0.4.2 24K #storage-engine #key-value-store #multi-raft #logging #raft-log #garbage-collection #log-entries #persistent-storage #raft-storage #protobuf

  13. garage_db

    Abstraction over multiple key/value storage engines that supports transactions

    v2.3.0 100 #garage #key-value-store #transaction #abstraction #storage-engine #git #self-hosting #matrix-channel #storage-service #object-storage

  14. segcache

    Segment-structured cache storage engine with eager TTL expiration

    v0.2.0 #cache-expiration #storage-engine #object-storage #ttl #key-value-store #ttl-cache #fixed-size #nearby #lifting

  15. canopydb

    Transactional key-value storage engine

    v0.2.5 #storage-engine #embedded-database #database

  16. lmdb-rkv

    Idiomatic and safe LMDB wrapper

    v0.14.0 66K #database #lmdb #bindings #lmdb-bindings #library #storage-engine

  17. raft-mvcc

    MVCC layer with versioned keys, snapshot isolation, OCC transactions, and TTL key expiry

    v0.1.2 #raft #key-value-store #raft-consensus #mvcc #ttl #isolation #storage-engine #lsm-tree #occ #production-grade

  18. append_kv

    persistent append-only key-value store built in Rust

    v0.1.0 #database #rust #storage-engine #key-value

  19. apex-store-rs

    A high-performance, embedded LSM-tree storage engine with SSTable V2 format, LZ4 compression, and Bloom Filters

    v2.1.1 #storage-engine #database #key-value #lsm-tree #embedded-database

  20. graft-proto

    Protocol definitions for the Graft storage engine

    v0.1.5 800 #database #graft #storage-engine #transaction #data-replication #lazy-evaluation #offline-first #database-replication #embedded #object-storage

  21. cobble

    A flexible embedded key-value storage engine for distributed systems as well as single-node applications

    v0.1.1 #distributed-systems #storage-engine #key-value-store #lsm

  22. expman

    Core logic and storage engine for expman

    v1.0.0 #metrics #storage-engine #experiment #logging #background-tokio-task #mpsc #parquet #non-blocking #apache-arrow

  23. ankurah-storage-sled

    Ankurah storage engine using Sled

    v0.7.23 #ankurah #storage-engine #query #sled #database #multi-player #data-model #real-time #state-management #mobile-app

  24. datatier

    Abstractions for byte storage pools

    v0.1.1 #abstraction #byte #storage-pool #cache #mmap #file-backed #eviction #storage-engine

  25. raft-common

    Shared types, configuration, error handling, and Prometheus metrics for the raft distributed KV store

    v0.1.2 #prometheus #raft #key-value-store #raft-consensus #distributed #mvcc #lsm-tree #storage-engine #leader-election #metrics

  26. log_structured_store

    A high-throughput append-oriented storage engine built in Rust using batched buffer-ring writes, direct I/O (O_DIRECT), and async io_uring dispatch

    v0.1.0 #storage-engine #io-uring #lock-free #log-structured #store #high-throughput #concurrency #logging #llama #byte-offset

  27. iridium-db

    A high-performance vector-graph hybrid storage and indexing engine

    v0.4.0 #storage-engine #service #iridium #candidate #zig #vector-graph #hybrid

  28. dustdata

    A data concurrency control storage engine to Rustbase

    v2.0.0-beta.6 2.0K #storage-engine #concurrency-control #rustbase #key-value-store #data-collection

  29. ankurah-storage-indexeddb-wasm

    Ankurah storage engine using IndexedDB in the browser

    v0.7.23 #indexed-db #ankurah #storage-engine #database #across #multi-player #data-model #real-time #mobile-app #collaborative

  30. slatedb-common

    Common utilities and types shared across SlateDB

    v0.13.0 34K #slate-db #slatedb #clock #timeout #storage-engine

  31. lupabase

    Blazingly fast (work-in-progress) database engine written entirely in Rust

    v2.0.0-dev.2 #in-memory-database #embedded-database #storage-engine #database-storage #database-engine #database-json #database #in-memory

  32. mdbx-sys

    Rust bindings for libmdbx

    v13.11.0 37K #bindings #database #library #storage-engine

  33. rldb

    A dynamo-like key/value database written in rust

    v0.1.13 1.1K #distributed-systems #gossip-protocol #dynamo-db #storage-engine

  34. mentedb-storage

    Storage engine for MenteDB

    v0.9.2 360 #artificial-intelligence #storage-engine #database #database-engine #database-storage

  35. keyvalue

    Shared key-value item types for cache storage engines

    v0.1.0 #key-value-cache #storage-engine #shared-key-value #representation #header

  36. foyer-storage-bench

    storage engine bench tool for foyer - the hybrid cache for Rust

    v0.7.5 800 #hybrid-cache #storage-engine #foyer #in-memory-cache #bench #concurrency

  37. lsm_storage_engine

    A high-performance, zero-dependency LSM-Tree storage engine in pure Rust

    v0.1.0 #storage-engine #database #lsm #kv-storage #kv

  38. normfs-wal

    Write-ahead log implementation for NormFS with crash recovery

    v0.1.0-beta.1 #robotics #write-ahead-log #crash-recovery #embedded #persistent-queue #storage-engine #data-ingestion #persistent-storage #event-sourcing #cloud-storage

  39. kotoba-db

    High-performance embedded database for Kotoba ecosystem

    v0.1.16 #storage-engine #embedded-database #database-storage #database #key-value

  40. cvx-storage

    Tiered storage engine (hot/warm/cold) with WAL and compaction

    v0.1.1 #storage-engine #tiered #chronos-vector #wal #warm #cvx #in-memory-store #cold #compaction #write-ahead-log

  41. kotoba-db-engine-memory

    In-memory database engine for KotobaDB

    v0.1.16 #storage-engine #database #database-engine #memory-engine #database-storage

  42. toondb-storage

    ToonDB storage engine (WAL, block store, compaction, sync-first I/O)

    v0.3.4 #storage-engine #vector-search #llm #embedded-database #vector-database

  43. simd-r-drive-ws-server

    Experimental WebSocket server for SIMD R Drive

    v0.16.1-alpha #storage-engine #binary-storage #mmap #append-only #simd

  44. kotoba-db-engine-lsm

    LSM-Tree based database engine for KotobaDB

    v0.1.16 #storage-engine #database #rocksdb #lsm #database-engine

  45. simd-r-drive-extensions

    Storage extensions for SIMD R Drive

    v0.16.2-alpha 100 #storage-engine #binary-storage #mmap #append-only #simd

  46. simd-r-drive-entry-handle

    Standalone mmap-friendly entry handles for SIMD R Drive

    v0.16.2-alpha 650 #storage-engine #binary-storage #mmap #simd #append-only

  47. aingle-lmdb

    Idiomatic and safe LMDB wrapper for AIngle

    v0.1.0 #database #aingle #lmdb #storage-engine

  48. sochdb-storage

    SochDB storage engine (WAL, block store, compaction, sync-first I/O)

    v2.0.2 #storage-engine #vector-search #embedded-database #llm #vector-database

  49. plato-room-persist

    Append-only storage engine for PLATO rooms — mmap reads, WAL writes, snapshot/restore

    v0.1.0 #storage-engine #room #read #write-ahead-log #plato #restore #compaction #mmap

  50. graft-kernel

    The Graft storage engine

    v0.2.0-rc.5 #storage-engine #graft #transaction #replication #serialization #database-replication #lazy-evaluation #offline-first #mobile-app #strong-consistency

  51. quickwit-storage

    Quickwit's storage abstraction

    v0.3.0 #amazon-s3 #cloud-storage #quickwit #search-engine #storage-abstraction #distributed-tracing #bundle-storage #logging #log-management #storage-engine

  52. qbice_storage

    The Query-Based Incremental Computation Engine

    v0.6.3 #rocksdb #storage-engine #wide-column #incremental-computation #interning #cache #qbice #fjall #thread-safe #multi-value

  53. reifydb-column

    Columnar storage engine for ReifyDB

    v0.5.6 #storage-engine #column #columnar-storage #reify-db #reader #statistics #compression

  54. quickwit-cluster

    Quickwit's cluster membership

    v0.3.0 #quickwit #search-engine #cloud-storage #distributed-tracing #cluster #storage-engine #sub-second #log-management #logging #cloud-search

  55. quickwit-doc-mapper

    Quickwit index configuration

    v0.3.0 #quickwit #search-engine #cloud-storage #distributed-tracing #documentation #convert-json #storage-engine #logging #tantivy #sub-second

  56. quickwit-directories

    containing all of the custom tantivy Directory used in quickwit

    v0.3.0 #quickwit #search-engine #cloud-storage #tantivy #directory-cache #distributed-tracing #storage-engine #full-text-search #proxy #google-cloud-storage

  57. quickwit-config

    Quickwit configuration

    v0.3.0 #cloud-storage #quickwit #search-engine #amazon-s3 #distributed-tracing #logging #storage-engine #log-management #sub-second

  58. raft-engine-ctl

    A control tool for Raft Engine

    v0.4.1 330 #raft #storage-engine #logging #multi-raft #key-value-store #persistent-storage #log-entries #garbage-collection

  59. simd-r-drive-muxio-service-definition

    Experimental Muxio service definitions for SIMD R Drive

    v0.16.2-alpha #storage-engine #binary-storage #mmap #append-only #simd

  60. simd-r-drive-ws-client

    Experimental WebSocket client for SIMD R Drive

    v0.16.2-alpha #storage-engine #binary-storage #mmap #append-only #simd

  61. fathomdb-engine

    Storage engine and write coordinator for the fathomdb agent datastore

    v0.5.6 #fts #database #vector-search #data-store #fathomdb #graph-database #storage-engine #embedded-database

  62. yykv-types

    Core type definitions for yykv storage engine

    v0.1.0 300 #yykv #storage-engine #define #error #abstraction

  63. quickwit-telemetry

    Quickwit's telemetry

    v0.3.0 #quickwit #cloud-storage #search-engine #telemetry #distributed-tracing #storage-engine #logging #sub-second #log-management

  64. quickwit-proto

    Quickwit's protos

    v0.3.0 #search-engine #quickwit #cloud-storage #distributed-tracing #logging #storage-engine #log-management #sub-second

  65. apfsds-storage

    Persistent storage layer for APFSDS (WAL, ClickHouse, PostgreSQL)

    v0.4.0 #storage-engine #wal #clickhouse #tree-index #apfsds #write-ahead-log #backup #compaction #persistent-storage #postgresql

  66. ankurah-storage-sqlite

    Ankurah storage engine using SQLite

    v0.7.23 #storage-engine #sqlite-storage #ankurah #sql #query #in-memory-database #sql-server #single-file #backup #ios

  67. quickwit-aws

    working with AWS

    v0.3.0 #cloud-storage #quickwit #search-engine #distributed-tracing #aws #storage-engine #log-management #sub-second #logging

  68. lmdb-sys

    Rust bindings for liblmdb

    v0.8.0 17K #database #bindings #lmdb-bindings #library #storage-engine

  69. ucotron-core

    Core traits, types, and data generation for Ucotron cognitive memory framework

    v0.1.0 #knowledge-graph #storage-engine #data-generation #traits #multimodal #graph-storage #graph-vector #llm #episodic #data-model

  70. canon-store

    SQLite + HNSW storage engine for Canon

    v0.2.0 #hnsw #graph-vector #vector-store #storage-engine #canon #vector-data #knowledge-graph #cp #data-structures

  71. xz-memory

    Layered memory storage engine — short-term, summary, fact, vector

    v0.1.0 #vector-search #storage-engine #fact #layered #summary #in-memory-store #short-term #pagination #fts5 #unit-testing

  72. graph-types

    Shared types for graph theory

    v0.0.13 160 #graph-theory #storage-engine #edge #adjacency-list #node #graph-data

  73. sc-consensus-pow

    PoW consensus algorithm for substrate

    v0.56.0 2.3K #consensus-algorithm #pow #worker #substrate #blockchain #import-queue #auxiliary #storage-engine

    74. Try searching with DuckDuckGo.

  74. rivven-core

    Core library for Rivven distributed event streaming platform

    v0.0.22 #storage-engine #encryption #cloud-storage #prometheus #tls #cold-storage #lock-free-queue #wal #statistics #event-streaming

  75. ora-storage-fjall

    Part of the Ora scheduler framework

    v0.2.0 #fjall #storage #storage-engine #persistent-storage #ora

  76. cabin-storage

    LSMTree based storage engine

    v0.1.1 #storage-engine #lsm-tree

  77. monero-lmdb-rkv

    Idiomatic and safe LMDB wrapper

    v0.1.0 #database #bindings #lmdb #lmdb-bindings #library #storage-engine

  78. bitkv-rs

    k/v store API inspired by bitcask

    v0.2.1 #bitcask #api #b-tree #write-batch #skip-list #key-value-store #write-operations #storage-engine #low-latency

  79. flash-kv

    k/v store API inspired by bitcask

    v0.2.1 #bitcask #api #b-tree #write-batch #skip-list #key-value-store #write-operations #storage-engine #low-latency #benchmark

  80. hash-engine

    An Engula engine that provides simple key-value storage

    v0.2.0 #key-value-store #storage-engine #engula

  81. lmdb

    Idiomatic and safe LMDB wrapper

    v0.8.0 6.8K #database #bindings #lmdb-bindings #library #storage-engine

  82. irondb

    Key-value storage engine

    v0.1.0 #storage-engine #key-value-store #audio #name #huh

  83. light_kv

    embeddable K/V storage engine inspired by RocksDB

    v0.1.0 #storage-engine #rocksdb #kv-storage #storage #kv

  84. quickwit-core

    Core crate of quickwit

    v0.3.0 #cloud-storage #search-engine #distributed-tracing #storage-engine #log-management #logging #sub-second

  85. expman-core

    Core logic and storage engine for expman

    v0.2.2 #storage-engine #logging #experiment #logic #python #non-blocking #jupyter

  86. distill-downstream-lmdb-rkv

    Idiomatic and safe LMDB wrapper

    v0.11.0-windows-fix 120 #database #bindings #lmdb #lmdb-bindings #library #storage-engine

  87. hold

    Rust file storage engine, supporting multiple storage backends

    v0.1.0-alpha.5 #storage-engine #file-storage #back-ends #supporting #blob #storage-provider #binary-interface

  88. pezsc-consensus-pow

    PoW consensus algorithm for bizinikiwi

    v0.33.0 #consensus-algorithm #pow #worker #bizinikiwi #prefix #auxiliary #storage-engine #blockchain

  89. distill-downstream-lmdb-sys

    Rust bindings for liblmdb

    v0.8.0-windows-fix #database #bindings #lmdb #lmdb-bindings #library #storage-engine

  90. photondb

    A storage engine for modern hardware

    v0.0.4 #storage-engine #database #photon-io #set #modern #engine-for-modern #log-structured #hardware-and-platforms #io-uring #programming-language

  91. mdbx-ffi

    Rust bindings for mdbx

    v0.0.5 #mdbx #bindings #database #library #storage-engine

  92. soil-pow

    PoW consensus algorithm for Soil

    v0.2.0 #consensus-algorithm #pow #soil #worker #import-queue #storage-engine #auxiliary #substrate

  93. engula

    command line tool

    v0.3.0 #database #storage-engine

  94. hold_s3

    AWS S3 provider for Hold, the Rust file storage engine

    v0.1.0-alpha.5 #amazon-s3 #storage-engine #file-storage #hold #provider #aws #binary-interface

  95. yykv-wal

    Write-Ahead Log (WAL) implementation for yykv

    v0.0.1 #write-ahead-log #yykv #wal-manager #storage-engine #data-recovery #crash-recovery #mem-table

  96. yykv-scheduler

    Task and background job scheduler for yykv

    v0.0.1 #scheduler #yykv #task-background #job-scheduler #io #storage-engine

  97. yykv-hal

    Hardware Abstraction Layer for yykv

    v0.0.1 #hal #yykv #block-device #detect #storage-engine #cross-platform

  98. yykv-compute

    Near-storage computation and filtering for yykv

    v0.0.1 #computation #yykv #operator #filtering #engine #multimodal #storage-engine #compute-kernel

  99. yykv-tiering

    Storage tiering and data migration for yykv

    v0.0.1 #storage #yykv #tiering #data-migration #cold #hard-drive #storage-engine #ssd

  100. yykv-compaction

    Compaction and garbage collection logic for yykv

    v0.0.1 #compaction #yykv #garbage-collection #logic #layout #storage-engine #lsm-tree