Bläddra i källkod
fix(model_runtime): fix wrong max_tokens for Claude 3.5 Haiku on Amazon Bedrock (#10286)
tags/0.11.0
Matsuda
1 år sedan
1 ändrade filer med 2 tillägg och 2 borttagningar
+ 2
- 2
api/core/model_runtime/model_providers/bedrock/llm/anthropic.claude-3-5-haiku-v1.yaml
Visa fil
| use_template: max_tokens | use_template: max_tokens | ||||
| required: true | required: true | ||||
| type: int | type: int | ||||
| default: 4096 | |||||
| default: 8192 | |||||
| min: 1 | min: 1 | ||||
| max: 4096 | |||||
| max: 8192 | |||||
| help: | help: | ||||
| zh_Hans: 停止前生成的最大令牌数。请注意，Anthropic Claude 模型可能会在达到 max_tokens 的值之前停止生成令牌。不同的 Anthropic Claude 模型对此参数具有不同的最大值。 | zh_Hans: 停止前生成的最大令牌数。请注意，Anthropic Claude 模型可能会在达到 max_tokens 的值之前停止生成令牌。不同的 Anthropic Claude 模型对此参数具有不同的最大值。 | ||||
| en_US: The maximum number of tokens to generate before stopping. Note that Anthropic Claude models might stop generating tokens before reaching the value of max_tokens. Different Anthropic Claude models have different maximum values for this parameter. | en_US: The maximum number of tokens to generate before stopping. Note that Anthropic Claude models might stop generating tokens before reaching the value of max_tokens. Different Anthropic Claude models have different maximum values for this parameter. |
Laddar…