瀏覽代碼

Feat: Add deepseek to llm_factories (#6051)

### What problem does this PR solve?

AWS Bedrock has made deepseek-r1 available on its serverless inference.

This adds the R1 serverless model for use via the bedrock model
abilities.

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
tags/v0.18.0
crypticGøøse 7 月之前
父節點
當前提交
f16418ccf7
沒有連結到貢獻者的電子郵件帳戶。
共有 1 個檔案被更改,包括 6 行新增0 行删除
  1. 6
    0
      conf/llm_factories.json

+ 6
- 0
conf/llm_factories.json 查看文件

"tags": "LLM,TEXT EMBEDDING", "tags": "LLM,TEXT EMBEDDING",
"status": "1", "status": "1",
"llm": [ "llm": [
{
"llm_name": "deepseek.r1-v1:0",
"tags": "LLM,CHAT,128k",
"max_tokens": 128000,
"model_type": "chat"
},
{ {
"llm_name": "ai21.j2-ultra-v1", "llm_name": "ai21.j2-ultra-v1",
"tags": "LLM,CHAT,8k", "tags": "LLM,CHAT,8k",

Loading…
取消
儲存