v0.7.0

• Implements RAGFlow tokenizer with DP.
• Support json data type and related functions.
• Support secondary index on json member.

v0.6.0

Core

• Unify the memory management of index and data
• Use memory usage to decide when flush the memory index Dump bmp index #2367 Dump fulltext index #2336
• Use mmap to replace buffer manager for sealed data unit Mmap4 #2424 Mmap3 #2419 Update SecondaryIndex #2391
• Switch for near-real-time and real-time index Fulltext realtime index #2450
• Support Rank feature query [Feature Request]: Support Rank feature query  #2309
• Use KV store as the meta data store. Add third_party rocksdb #2486
• Rename table
• Support group-by and aggregate function Group by 1 #2488 Groupby2 #2491 Groupby3 #2493
• Support array type. [Feature Request]: Support array type #2455
• Improve HNSW performance. Lsg #2470
• Support Fixed Dimensional Encoding function(MUVERA Multi-vector Retrieval via FDE) for tensor data [Feature Request]: Implement MUVERA function for Tensor data #2799
• Supports table / database / system data backup and recovery

Backlog

Core

• Native supports MacOS(m1) and Windows
• Supports authentication with default roles.
• Support unnest array
• Support fused query on multiple tables [Feature Request]: Support fused query on multiple tables #2311
• Cluster fail over
• Supports DiskANN index. [Feature Request]: Implement DiskANN #1953
• Supports schemaless table
• Compacts meta data periodically.

Integration

• Supports NFS.
• Integrates with Langchain
• Integrates with llamdindex
• Embedding function.

Tools

• Monitoring tools.
• Data migration tool.
• GUI [Feature Request]: Added support for GUI #1841

Previous roadmap

ROADMAP 2024