소스 검색

Fix: QWenCV issue. (#8106)

### What problem does this PR solve?

Close #8097

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
tags/v0.19.1
Kevin Hu 5 달 전
부모
커밋
7ed9efcd4e
No account linked to committer's email address
1개의 변경된 파일7개의 추가작업 그리고 2개의 파일을 삭제
  1. 7
    2
      rag/llm/cv_model.py

+ 7
- 2
rag/llm/cv_model.py 파일 보기

@@ -323,7 +323,9 @@ class QWenCV(Base):
ans = ""
tk_count = 0
if response.status_code == HTTPStatus.OK:
ans += response.output.choices[0]['message']['content']
ans = response.output.choices[0]['message']['content']
if isinstance(ans, list):
ans = ans[0]["text"] if ans else ""
tk_count += response.usage.total_tokens
if response.output.choices[0].get("finish_reason", "") == "length":
ans += "...\nFor the content length reason, it stopped, continue?" if is_english(
@@ -352,7 +354,10 @@ class QWenCV(Base):
stream=True)
for resp in response:
if resp.status_code == HTTPStatus.OK:
ans = resp.output.choices[0]['message']['content']
cnt = resp.output.choices[0]['message']['content']
if isinstance(cnt, list):
cnt = cnt[0]["text"] if ans else ""
ans += cnt
tk_count = resp.usage.total_tokens
if resp.output.choices[0].get("finish_reason", "") == "length":
ans += "...\nFor the content length reason, it stopped, continue?" if is_english(

Loading…
취소
저장