Bläddra i källkod

Add query parts to lamp (#2736)

### What problem does this PR solve?


### Type of change

- [x] New Feature (non-breaking change which adds functionality)
tags/v0.13.0
Kevin Hu 1 år sedan
förälder
incheckning
b3b54680e7
Inget konto är kopplat till bidragsgivarens mejladress
1 ändrade filer med 1 tillägg och 0 borttagningar
  1. 1
    0
      api/db/services/dialog_service.py

+ 1
- 0
api/db/services/dialog_service.py Visa fil

@@ -189,6 +189,7 @@ def chat(dialog, messages, stream=True, **kwargs):
used_token_count, msg = message_fit_in(msg, int(max_tokens * 0.97))
assert len(msg) >= 2, f"message_fit_in has bug: {msg}"
prompt = msg[0]["content"]
prompt += "\n\n### Query:\n%s" % " ".join(questions)

if "max_tokens" in gen_conf:
gen_conf["max_tokens"] = min(

Laddar…
Avbryt
Spara