Przeglądaj źródła

Refactor: support config strong test (#9198)

### What problem does this PR solve?


https://github.com/infiniflow/ragflow/issues/9189#issuecomment-3148920950

### Type of change
- [x] Refactoring

Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
tags/v0.20.1
Stephen Hu 2 miesięcy temu
rodzic
commit
45bf294117
No account linked to committer's email address
2 zmienionych plików z 8 dodań i 1 usunięć
  1. 1
    0
      api/settings.py
  2. 7
    1
      api/utils/api_utils.py

+ 1
- 0
api/settings.py Wyświetl plik

@@ -70,6 +70,7 @@ REGISTER_ENABLED = 1
# sandbox-executor-manager
SANDBOX_ENABLED = 0
SANDBOX_HOST = None
STRONG_TEST_COUNT = int(os.environ.get("STRONG_TEST_COUNT", "32"))

BUILTIN_EMBEDDING_MODELS = ["BAAI/bge-large-zh-v1.5@BAAI", "maidalun1020/bce-embedding-base_v1@Youdao"]


+ 7
- 1
api/utils/api_utils.py Wyświetl plik

@@ -687,6 +687,12 @@ def timeout(seconds: float | int = None, attempts: int = 2, *, exception: Option


async def is_strong_enough(chat_model, embedding_model):
count = settings.STRONG_TEST_COUNT
if not chat_model or not embedding_model:
return
if isinstance(count, int) and count <= 0:
return

@timeout(60, 2)
async def _is_strong_enough():
nonlocal chat_model, embedding_model
@@ -701,5 +707,5 @@ async def is_strong_enough(chat_model, embedding_model):

# Pressure test for GraphRAG task
async with trio.open_nursery() as nursery:
for _ in range(32):
for _ in range(count):
nursery.start_soon(_is_strong_enough)

Ładowanie…
Anuluj
Zapisz