fc6d8ee77f
ignore when save image fail (#2178)
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
пре 1 година
5daed10136
make task resumable (#2132)
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
пре 1 година
e9202999cb
alter way of alerting info of empty task (#2094)
### What problem does this PR solve?
#2043
### Type of change
- [x] Refactoring
пре 1 година
a6d85c6c2f
Provide detailed error information. (#2093)
### What problem does this PR solve?
Most 'index failure' error is caused by ES.
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
пре 1 година
cc6a48b128
support monitoring task executor (#2069)
### What problem does this PR solve?
#1383
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
0f95086813
add taskexecutor status check (#2038)
### What problem does this PR solve?
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
5efb3476f2
turn down es bulk size (#2013)
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
пре 1 година
da8802d010
refine error log while chunking (#1937)
### What problem does this PR solve?
### Type of change
- [x] Refactoring
пре 1 година
ede733e130
add support for eml file parser (#1768)
### What problem does this PR solve?
add support for eml file parser
#1363
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
---------
Co-authored-by: Zhedong Cen <cenzhedong2@126.com>
Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
пре 1 година
152072f900
Add graphrag (#1793)
### What problem does this PR solve?
#1594
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
ac7a0d4fbf
Add ParsertType Audio (#1637)
### What problem does this PR solve?
#1514
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
6f99bbbb08
add raptor (#899)
### What problem does this PR solve?
#882
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
95f809187e
add stream chat (#811)
### What problem does this PR solve?
#709
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
4d47b2b459
fix a string format error (#781)
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
пре 1 година
aa1c915d6e
support gpt-4o (#773)
### What problem does this PR solve?
#771
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
77b1520b66
Refactor message output format (#772)
### What problem does this PR solve?
_Briefly describe what this PR aims to solve. Include background context
that will help reviewers understand the purpose of the PR._
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
пре 1 година
ffe5737f7d
let index be batchly. (#733)
### What problem does this PR solve?
let index be batchly.
### Type of change
- [x] Refactoring
пре 1 година
04a9e95161
let file in knowledgebases visible in file manager (#714)
### What problem does this PR solve?
Let file in knowledgebases visible in file manager.
#162
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
c28f7b5d38
make sure the error will be recorded. (#672)
### What problem does this PR solve?
### Type of change
- [x] Refactoring
пре 1 година
a6e4b74d94
remove unused dependency (#664)
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
пре 1 година
de839fc3f0
optimize srv broker and executor logic (#630)
### What problem does this PR solve?
Optimize task broker and executor for reduce memory usage and deployment
complexity.
### Type of change
- [x] Performance Improvement
- [x] Refactoring
### Change Log
- Enhance redis utils for message queue(use stream)
- Modify task broker logic via message queue (1.get parse event from
message queue 2.use ThreadPoolExecutor async executor )
- Modify the table column name of document and task (process_duation ->
process_duration maybe just a spelling mistake)
- Reformat some code style(just what i see)
- Add requirement_dev.txt for developer
- Add redis container on docker compose
---------
Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
пре 1 година
5f03a4de11
remove redis (#629)
### What problem does this PR solve?
### Type of change
- [x] Refactoring
пре 1 година
9d60a84958
refactor code (#583)
### What problem does this PR solve?
### Type of change
- [x] Refactoring
пре 1 година
944776f207
fix bug about fetching file from minio (#574)
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
пре 1 година
66f8d35632
Refactor (#537)
### What problem does this PR solve?
### Type of change
- [x] Refactoring
пре 1 година
0dfc8ddc0f
enlarge docker memory usage (#501)
### What problem does this PR solve?
### Type of change
- [x] Refactoring
пре 1 година
b8e58fe27a
add redis to accelerate access of minio (#482)
### What problem does this PR solve?
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
ed6081845a
Fit a lot of encodings for text file. (#458)
### What problem does this PR solve?
#384
### Type of change
- [x] Performance Improvement
пре 1 година
890561703b
Add bce-embedding and fastembed (#383)
### What problem does this PR solve?
Issue link:#326
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
91068edf16
Support Xinference (#320)
### What problem does this PR solve?
Issue link:#299
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
923cbe488e
fix #258 task_executor occupy cpu too much (#288)
### What problem does this PR solve?
Issue link:#285
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
пре 1 година
3708b97db9
Support Ollama (#261)
### What problem does this PR solve?
Issue link:#221
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
пре 1 година
38e5737067
add base url for OpenAI (#166)
пре 1 година
fd7fcb5baf
apply pep8 formalize (#155)
пре 1 година
979b3a5b4b
support snapshot download from local (#153)
* support snapshot download from local
* let snapshot download from local
пре 1 година
71fe314955
refine page ranges (#147)
пре 1 година
5875c8ba08
Add 'One' chunk method (#137)
пре 1 година
675a9f8d9a
add dockerfile for cuda envirement. Refine table search strategy, (#123)
пре 1 година
0feb085c88
refine table parser (#120)
пре 1 година
f1f09df901
add local llm implementation (#119)
пре 1 година
b89ac3c4be
chage tas execution logic (#103)
пре 1 година
602038ac49
fix task cancling bug (#98)
пре 1 година
8a57f2afd5
change callback strategy, add timezone to docker (#96)
пре 1 година
685b4d8a95
fix table desc bugs, add positions to chunks (#91)
пре 1 година
8a726fb04b
solve task execution issues (#90)
пре 1 година
0429107e80
fix user login issue (#85)
пре 1 година
320cbf545f
docker debugging modification (#82)
пре 1 година
7fd1eca582
init README of deepdoc, add picture processer. (#71)
* init README of deepdoc, add picture processer.
* add resume parsing
пре 1 година
a8294f2168
Refine resume parts and fix bugs in retrival using sql (#66)
пре 1 година
5e0a689c43
refactor retieval_test, add SQl retrieval methods (#61)
пре 1 година
Kevin Hu
Jin Hai
黄腾
H
Fakai Zhao