浏览代码

fix: anthropic completion error in blocking mode (#591)

tags/0.3.10
John Wang 2 年前
父节点
当前提交
eff115267f
没有帐户链接到提交者的电子邮件
共有 1 个文件被更改,包括 2 次插入3 次删除
  1. 2
    3
      api/core/callback_handler/llm_callback_handler.py

+ 2
- 3
api/core/callback_handler/llm_callback_handler.py 查看文件

if not self.conversation_message_task.streaming: if not self.conversation_message_task.streaming:
self.conversation_message_task.append_message_text(response.generations[0][0].text) self.conversation_message_task.append_message_text(response.generations[0][0].text)
self.llm_message.completion = response.generations[0][0].text self.llm_message.completion = response.generations[0][0].text
self.llm_message.completion_tokens = response.llm_output['token_usage']['completion_tokens']
else:
self.llm_message.completion_tokens = self.llm.get_num_tokens(self.llm_message.completion)

self.llm_message.completion_tokens = self.llm.get_num_tokens(self.llm_message.completion)


self.conversation_message_task.save_message(self.llm_message) self.conversation_message_task.save_message(self.llm_message)



正在加载...
取消
保存