浏览代码

fix: wenxin error not raise when stream mode (#884)

tags/0.3.15
takatost 2 年前
父节点
当前提交
c4d759dfba
没有帐户链接到提交者的电子邮件
共有 1 个文件被更改,包括 21 次插入7 次删除
  1. 21
    7
      api/core/third_party/langchain/llms/wenxin.py

+ 21
- 7
api/core/third_party/langchain/llms/wenxin.py 查看文件

@@ -3,6 +3,7 @@ from __future__ import annotations

import json
import logging
from json import JSONDecodeError
from typing import (
Any,
Dict,
@@ -223,11 +224,24 @@ class Wenxin(LLM):
for token in self._client.post(request).iter_lines():
if token:
token = token.decode("utf-8")
completion = json.loads(token[5:])

yield GenerationChunk(text=completion['result'])
if run_manager:
run_manager.on_llm_new_token(completion['result'])

if completion['is_end']:
break
if token.startswith('data:'):
completion = json.loads(token[5:])

yield GenerationChunk(text=completion['result'])
if run_manager:
run_manager.on_llm_new_token(completion['result'])

if completion['is_end']:
break
else:
try:
json_response = json.loads(token)
except JSONDecodeError:
raise ValueError(f"Wenxin Response Error {token}")

raise ValueError(
f"Wenxin API {json_response['error_code']}"
f" error: {json_response['error_msg']}, "
f"please confirm if the model you have chosen is already paid for."
)

正在加载...
取消
保存