Bladeren bron

fix: claude-3-5-sonnet-20240620 max token error (#6843)

tags/0.6.16
Joe 1 jaar geleden
bovenliggende
commit
df9bd36cab
No account linked to committer's email address

+ 0
- 1
api/core/model_runtime/model_providers/anthropic/llm/claude-3-5-sonnet-20240620.yaml Bestand weergeven

required: false required: false
- name: max_tokens - name: max_tokens
use_template: max_tokens use_template: max_tokens
required: true
default: 8192 default: 8192
min: 1 min: 1
max: 8192 max: 8192

+ 2
- 1
api/core/model_runtime/model_providers/anthropic/llm/llm.py Bestand weergeven

# Add the new header for claude-3-5-sonnet-20240620 model # Add the new header for claude-3-5-sonnet-20240620 model
extra_headers = {} extra_headers = {}
if model == "claude-3-5-sonnet-20240620": if model == "claude-3-5-sonnet-20240620":
extra_headers["anthropic-beta"] = "max-tokens-3-5-sonnet-2024-07-15"
if model_parameters.get('max_tokens') > 4096:
extra_headers["anthropic-beta"] = "max-tokens-3-5-sonnet-2024-07-15"


if tools: if tools:
extra_model_kwargs['tools'] = [ extra_model_kwargs['tools'] = [

Laden…
Annuleren
Opslaan