Tags: OpenBMB/UltraRAG
Tags
feat: add export functionality for chat messages in DOCX format (#323) - Implemented a new feature to allow users to export chat messages as Word documents (.docx). - Added UI elements for selecting export format and improved modal design for better user experience. - Updated download functions to handle DOCX file generation and error handling. - Enhanced internationalization support for export-related messages in English and Chinese.
fix: resolve multiple security vulnerabilities in #268 (#272) * fix: jinja2 template injection * fix: milvus collection name injection * fix: restrict debug mode and host binding via env vars * refactor: replace SHA-1 with SHA-256 for better security * fix: path traversal vulnerability & pdf memory leak
Update UltraRAG 2.1 (#110) * update README files: add latest news section for UltraRAG 2.0 release * update README files: add release note for UltraRAG 1.0 * fix: add space before link in release note for UltraRAG 1.0 * update: change README language * update: add QR codes for WeChat, Feishu, and Discord groups in README * feat: add vllm_serve_vlm.sh script for serving model * update: add 'embedding/' to .gitignore to exclude embedding files * feat: enhance retriever functionality with multimodal support * feat: refactor multimodal corpus handling and image embedding in Retriever class * feat: update generation parameters for multimodal support * fix: update vllm_serve_vlm.sh * fix: add model_warmup parameter to infinity_kwargs in parameter.yaml * fix: update output parameters in visrag.yaml and generation.py for consistency * fix: clean up whitespace * support: add visrag.yaml for multimodal generation * fix bug: retriever_init_openai miss faiss_use_gpu parameter * Update README files to include star history chart * feat: support API models for rag pipeline * feat: add light deepresearch demo * fix: remove unused retrieval service initialization from light_deepresearch and webnote demos * fix: update demo title in light_deepresearch.yaml * fix: add hands-on tutorial entry to the latest news section in README files * feat: add retriever configuration and initialization updates * update: OpenAI API embedding for SentenceTransformers * feat: enhance retriever pipeline with embedding functionality and batch processing * fix: st multi gpu bug * feat: add progress logging for FAISS indexing process * update: rename retriever_search_maxsim to retriever_search_colbert_maxsim and add backend validation * refactor: replace _to_st_device_list method with a local function for device conversion * update: enhance query embedding process * fix: improve error handling and fallback for document and query encoding * update: add query and document task configuration for embedding * update: clear query_instruction in parameter configuration * delete: remove test_retriever.yaml configuration file * update: generation server * feat: add vllm_shutdown method and integrate into generation pipeline * update: refactor generation methods and enhance multimodal support * update: enhance async generation handling and fix multimodal path type * update: consolidate GPU device handling and improve parameter organization in retriever * update: refactor GPU ID handling and improve error handling in retriever methods * update: add VisRAG demo configuration and multimodal QA prompt template * update: change configuration key for model name retrieval in Generation class * update: chunking method * update: add mineru support * feat: add corpus mineru processing pipeline * feat: add build_image_corpus tool for PDF to image conversion * update: add text corpus build method * fix: remove param mineru_corpus_prefix * update: support build text corpus for file folder * update: support image corpus build for folder * update: support mineru for folder * update: add simple ui * update: add terminal log for ui * update: fix some problems in ui * feat: support hf backend * update: ui appearance * update: add ui exit * fix: auto calculate tensor_parallel_size * fix: infinity multi-gpu embedding bug * fix: remove nouse note * fix: add st prompt name param * update: use vllm deploy embedding model * code review: generation server * feat: support batch generation for hf backend * fix: replace index when overwrite is true * code review: generation server * update: support picture for case study * fix: add sperator for text case study * code review: corpus server * fix: normalize file path * fix: openai gen topk param * feat: add chat ui * code review: retriever server * fix: initital self.faiss_index * fix: update pipeline * fix: remove some default sampling_params * fix: add auto shut down for vllm backend * update: change some default param sets * feat: add process bar in loading corpus * fix: normalize logging messages * feat: support bm25 retriever * code review: retriever server * update: add rag full pipeline * update: pipeline in tutorial * feat: support st and openai for reranker backend * code review & code format * feat: add bm25 index & search usage * update pipeline v2.1 * fix: import errnos in retriever server * update: add loop pipeline demo * fix: merge psg tool return bug * update: add branch pipeline demo * update: add evaluate results pipeline * fix: load image corpus bug * update: add vsirag pipeline * fix: show image bug * update: default setting * update: add search pipeline * update: pipeline * feat: support trec evaluate * update: ir trec eval parameter name * update: pipeline align with v2.1 * update: cli description * update: readme * feat: update deps * update: readme * fix readme en --------- Co-authored-by: Haidong Xin <hdxin2002@gmail.com>
fix: acc calc error when pred is none (#107) * update: readme * fix: file path concatenation bug on DOS-like systems * fix: child processes did not terminate with the parent on Windows * fix: child processes did not terminate with the parent on Windows * fix: missing deps httpx[socksio] * fix: api limits due to excessive thread count * feat: support zhipuai websearch * refactor: remove redundant search code * update: README.md * fix: README_en.md * Update webnote_fill_page.jinja * Update webnote_gen_subq.jinja * Update webnote_init_page.jinja * fix: acc calc error when pred is none