瀏覽代碼

fix: token count includes base64 string of input images (#5868)

tags/0.6.13
Masashi Tomooka 1 年之前
父節點
當前提交
3b23d6764f
沒有連結到貢獻者的電子郵件帳戶。
共有 1 個檔案被更改,包括 4 行新增1 行删除
  1. 4
    1
      api/core/model_runtime/model_providers/bedrock/llm/llm.py

+ 4
- 1
api/core/model_runtime/model_providers/bedrock/llm/llm.py 查看文件

@@ -554,7 +554,10 @@ class BedrockLargeLanguageModel(LargeLanguageModel):
content = message.content

if isinstance(message, UserPromptMessage):
message_text = f"{human_prompt_prefix} {content} {human_prompt_postfix}"
body = content
if (isinstance(content, list)):
body = "".join([c.data for c in content if c.type == PromptMessageContentType.TEXT])
message_text = f"{human_prompt_prefix} {body} {human_prompt_postfix}"
elif isinstance(message, AssistantPromptMessage):
message_text = f"{ai_prompt} {content}"
elif isinstance(message, SystemPromptMessage):

Loading…
取消
儲存