浏览代码

Add query parts to lamp (#2736)

### What problem does this PR solve?


### Type of change

- [x] New Feature (non-breaking change which adds functionality)
tags/v0.13.0
Kevin Hu 1年前
父节点
当前提交
b3b54680e7
没有帐户链接到提交者的电子邮件
共有 1 个文件被更改,包括 1 次插入0 次删除
  1. 1
    0
      api/db/services/dialog_service.py

+ 1
- 0
api/db/services/dialog_service.py 查看文件

@@ -189,6 +189,7 @@ def chat(dialog, messages, stream=True, **kwargs):
used_token_count, msg = message_fit_in(msg, int(max_tokens * 0.97))
assert len(msg) >= 2, f"message_fit_in has bug: {msg}"
prompt = msg[0]["content"]
prompt += "\n\n### Query:\n%s" % " ".join(questions)

if "max_tokens" in gen_conf:
gen_conf["max_tokens"] = min(

正在加载...
取消
保存