b6c4722687
Refa: make RAGFlow more asynchronous ( #11601 )
...
### What problem does this PR solve?
Try to make this more asynchronous. Verified in chat and agent
scenarios, reducing blocking behavior. #11551 , #11579 .
However, the impact of these changes still requires further
investigation to ensure everything works as expected.
### Type of change
- [x] Refactoring
2025-12-01 14:24:06 +08:00
fa9b7b259c
Feat: create datasets from http api supports ingestion pipeline ( #11597 )
...
### What problem does this PR solve?
Feat: create datasets from http api supports ingestion pipeline
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-11-28 19:55:24 +08:00
9d8b96c1d0
Feat: add context for figure and table ( #11547 )
...
### What problem does this PR solve?
Add context for figure table.
`==================()` for demonstrating purpose.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-11-27 10:21:44 +08:00
40e84ca41a
Use Infinity single-field-multi-index ( #11444 )
...
### What problem does this PR solve?
Use Infinity single-field-multi-index
### Type of change
- [x] Refactoring
- [x] Performance Improvement
2025-11-26 11:06:37 +08:00
d1716d865a
Feat: Alter flask to Quart for async API serving. ( #11275 )
...
### What problem does this PR solve?
#11277
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-11-18 17:05:16 +08:00
bd4bc57009
Refactor: move mcp connection utilities to common ( #11304 )
...
### What problem does this PR solve?
As title
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-17 15:34:17 +08:00
61cf430dbb
Minor tweats ( #11271 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-16 19:29:20 +08:00
b5f2cf16bc
Fix: check task executor alive and display status ( #11270 )
...
### What problem does this PR solve?
Correctly check task executor alive and display status.
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-11-14 15:52:28 +08:00
bd5dda6b10
Feature/doc upload api add parent path 20251112 ( #11231 )
...
### What problem does this PR solve?
Add the specified parent_path to the document upload api interface
(#11230 )
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
Co-authored-by: virgilwong <hyhvirgil@gmail.com >
2025-11-13 09:59:39 +08:00
d207291217
Fix: add download stats to kb logs. ( #11112 )
...
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-11-10 13:28:07 +08:00
d016a06fd5
Feat/monitor task ( #11116 )
...
### What problem does this PR solve?
Show task executor.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-11-10 12:51:39 +08:00
b7aa6d6c4f
Fix: add avatar for UI ( #11080 )
...
### What problem does this PR solve?
Add avatar for admin UI.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-11-07 09:27:31 +08:00
f98b24c9bf
Move api.settings to common.settings ( #11036 )
...
### What problem does this PR solve?
As title
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-06 09:36:38 +08:00
24335485bf
Fix: get_allowed_llm_factories() return type ( #11031 )
...
### What problem does this PR solve?
Fix: get_allowed_llm_factories() return type #11003
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
<img width="2880" height="215" alt="截图 2025-11-05 17-02-01"
src="https://github.com/user-attachments/assets/ee892077-21f9-4b1e-a1d2-b921fa7f6121 "
/>
2025-11-05 17:32:12 +08:00
02d10f8eda
Move var from rag.settings to common.globals ( #11022 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-05 15:48:50 +08:00
1a9215bc6f
Move some vars to globals ( #11017 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-05 14:14:38 +08:00
89410d2381
fix:api /factories wrong return ( #11015 )
...
### What problem does this PR solve?
change:
api /factories wrong return
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-11-05 12:50:11 +08:00
3654ae61c1
feat: add allowed factories variable to allow admins to restrict llms users can add ( #11003 )
...
### What problem does this PR solve?
Currently, if we want to restrict the allowed factories users can use we
need to delete from the database table manually. The proposal of this PR
is to include a variable to that, if set, will restrict the LLM
factories the users can see and add. This allow us to not touch the
llm_factories.json or the database if the LLM factory is already
inserted.
Obs.: All the lint changes were from the pre-commit hook which I did not
change.
### Type of change
- [X] New Feature (non-breaking change which adds functionality)
2025-11-05 10:47:50 +08:00
bab3fce136
Move some constants to common ( #11004 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-05 08:01:39 +08:00
880a6a0428
Move some enumerate type to constants.py ( #10998 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-04 19:25:25 +08:00
03038c7d3d
Update RetCode to common.constants ( #10984 )
...
### What problem does this PR solve?
1. Update RetCode to common.constants
2. Decouple the admin and API modules
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-04 15:12:53 +08:00
19f71a961a
Fix: Create dataset performance unmatched between HTTP api and web ui ( #10960 )
...
### What problem does this PR solve?
Fix: Create dataset performance unmatched between HTTP api and web ui
#10925
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-11-04 13:45:14 +08:00
1e45137284
Move 'timeout' to common folder ( #10983 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-04 11:51:12 +08:00
d55344bc11
Remove unused code ( #10981 )
...
### What problem does this PR solve?
As title
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-04 11:10:29 +08:00
378bdfccfc
Refactor log utils ( #10973 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-03 20:25:02 +08:00
9a486e0f51
Move some funcs from api to rag module ( #10972 )
...
### What problem does this PR solve?
As title
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-03 19:26:09 +08:00
1284647694
Refactor file utils ( #10970 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-03 18:54:55 +08:00
076d811086
Introduce common/config_utils.py ( #10968 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-03 17:25:06 +08:00
121d3fd815
Introduce common/constants.py ( #10965 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-03 16:32:37 +08:00
d008a4df9f
Move base64_image related functions to common directory ( #10957 )
...
### What problem does this PR solve?
As title
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-03 15:20:46 +08:00
78631a3fd3
Move some functions out of 'api/utils/common.py' ( #10948 )
...
### What problem does this PR solve?
as title.
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-03 12:34:47 +08:00
fa210e7c58
Feat: parsing hyperlinks in docx and pdf & Fix: default parser config of toc extraction ( #10877 )
...
### What problem does this PR solve?
Feat: parsing hyperlinks in docx and pdf #10848
Fix: default parser config of toc extraction
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-11-03 09:34:12 +08:00
44f2d6f5da
Move 'get_project_base_directory' to common directory ( #10940 )
...
### What problem does this PR solve?
As title
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-02 21:05:28 +08:00
57a83eca8a
Remove unused code ( #10938 )
...
### What problem does this PR solve?
As title
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-11-02 16:25:16 +08:00
f52e56c2d6
Remove 'get_lan_ip' and add common misc_utils.py ( #10880 )
...
### What problem does this PR solve?
Add get_uuid, download_img and hash_str2int into misc_utils.py
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-10-31 16:42:01 +08:00
a3bb4aadcc
Fix: predictable token generation ( #10868 )
...
### What problem does this PR solve?
Fix predictable token generation.
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-10-30 09:31:36 +08:00
55eb525fdc
Feat: rename file to avoid package name conflict ( #10863 )
...
### What problem does this PR solve?
Feat: rename file to avoid package name conflict
### Type of change
- [x] Refactoring
2025-10-29 12:19:57 +08:00
5a200f7652
Add time utils ( #10849 )
...
### What problem does this PR solve?
- Add time utilities and unit tests
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-10-28 19:09:14 +08:00
73144e278b
Don't release full image ( #10654 )
...
### What problem does this PR solve?
Introduced gpu profile in .env
Added Dockerfile_tei
fix datrie
Removed LIGHTEN flag
### Type of change
- [x] Documentation Update
- [x] Refactoring
2025-10-23 23:02:27 +08:00
f24d464a53
Fix: video file suffix ( #10740 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-10-23 11:13:09 +08:00
d956a442ce
Fix: Remove pdf embed support, update based on #10635 ( #10663 )
...
### What problem does this PR solve?
Fix: Remove pdf embed support, update based on #10635
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-10-20 13:45:53 +08:00
8ee0b6ea54
File: Now parsing support all types of embedded documents, solved #10059 ( #10635 )
...
### What problem does this PR solve?
File: Now parsing support all types of embedded documents, solved #10059
Fix: Incomplete words in chat #10530
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-10-17 18:46:47 +08:00
447041d265
Feat: add forgot password reset, solve #8547 ( #10586 )
...
### What problem does this PR solve?
Feat: add forgot password reset, solve #8547
### Type of change
- [X] New Feature (non-breaking change which adds functionality)
2025-10-16 15:07:49 +08:00
8844826208
Refactor admin client for message prompts ( #10583 )
...
### What problem does this PR solve?
As title
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-10-15 16:22:07 +08:00
87659dcd3a
Fix: unexpected Auth return code ( #10539 )
...
### What problem does this PR solve?
Fix unexpected Auth return code.
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-10-14 14:13:10 +08:00
0d8791936e
Feat: TOC retrieval ( #10456 )
...
### What problem does this PR solve?
#10436
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-10-10 17:07:55 +08:00
9b06734ced
Feat: add total in List dataset API ( #10448 )
...
### What problem does this PR solve?
Feat: add total in List dataset API, solved #10360
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-10-10 11:20:55 +08:00
d931c33ced
Fix typos: retrievaler -> retriever ( #10372 )
...
### What problem does this PR solve?
Fix typos
### Type of change
- [x] Refactoring
---------
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2025-10-10 09:17:36 +08:00
cbf04ee470
Feat: Use data pipeline to visualize the parsing configuration of the knowledge base ( #10423 )
...
### What problem does this PR solve?
#9869
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
---------
Signed-off-by: dependabot[bot] <support@github.com >
Signed-off-by: jinhai <haijin.chn@gmail.com >
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
Co-authored-by: chanx <1243304602@qq.com >
Co-authored-by: balibabu <cike8899@users.noreply.github.com >
Co-authored-by: Lynn <lynn_inf@hotmail.com >
Co-authored-by: 纷繁下的无奈 <zhileihuang@126.com >
Co-authored-by: huangzl <huangzl@shinemo.com >
Co-authored-by: writinwaters <93570324+writinwaters@users.noreply.github.com >
Co-authored-by: Wilmer <33392318@qq.com >
Co-authored-by: Adrian Weidig <adrianweidig@gmx.net >
Co-authored-by: Zhichang Yu <yuzhichang@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
Co-authored-by: Yongteng Lei <yongtengrey@outlook.com >
Co-authored-by: Liu An <asiro@qq.com >
Co-authored-by: buua436 <66937541+buua436@users.noreply.github.com >
Co-authored-by: BadwomanCraZY <511528396@qq.com >
Co-authored-by: cucusenok <31804608+cucusenok@users.noreply.github.com >
Co-authored-by: Russell Valentine <russ@coldstonelabs.org >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Billy Bao <newyorkupperbay@gmail.com >
Co-authored-by: Zhedong Cen <cenzhedong2@126.com >
Co-authored-by: TensorNull <129579691+TensorNull@users.noreply.github.com >
Co-authored-by: TensorNull <tensor.null@gmail.com >
Co-authored-by: TeslaZY <TeslaZY@outlook.com >
Co-authored-by: Ajay <160579663+aybanda@users.noreply.github.com >
Co-authored-by: AB <aj@Ajays-MacBook-Air.local >
Co-authored-by: 天海蒼灆 <huangaoqin@tecpie.com >
Co-authored-by: He Wang <wanghechn@qq.com >
Co-authored-by: Atsushi Hatakeyama <atu729@icloud.com >
Co-authored-by: Jin Hai <haijin.chn@gmail.com >
Co-authored-by: Mohamed Mathari <155896313+melmathari@users.noreply.github.com >
Co-authored-by: Mohamed Mathari <nocodeventure@Mac-mini-van-Mohamed.fritz.box >
Co-authored-by: Stephen Hu <stephenhu@seismic.com >
Co-authored-by: Shaun Zhang <zhangwfjh@users.noreply.github.com >
Co-authored-by: zhimeng123 <60221886+zhimeng123@users.noreply.github.com >
Co-authored-by: mxc <mxc@example.com >
Co-authored-by: Dominik Novotný <50611433+SgtMarmite@users.noreply.github.com >
Co-authored-by: EVGENY M <168018528+rjohny55@users.noreply.github.com >
Co-authored-by: mcoder6425 <mcoder64@gmail.com >
Co-authored-by: lemsn <lemsn@msn.com >
Co-authored-by: lemsn <lemsn@126.com >
Co-authored-by: Adrian Gora <47756404+adagora@users.noreply.github.com >
Co-authored-by: Womsxd <45663319+Womsxd@users.noreply.github.com >
Co-authored-by: FatMii <39074672+FatMii@users.noreply.github.com >
2025-10-09 12:36:19 +08:00
fb950079ef
Feat/service manage ( #10381 )
...
### What problem does this PR solve?
- Admin service support SHOW SERVICE <id>.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
issue: #10241
2025-09-30 16:23:09 +08:00
