Pārlūkot izejas kodu

chore: optimize nvidia nim credential schema and info (#4898)

tags/0.6.10
takatost pirms 1 gada
vecāks
revīzija
696c5308a9
Revīzijas autora e-pasta adrese nav piesaistīta nevienam kontam

+ 2
- 0
api/core/model_runtime/model_providers/nvidia_nim/llm/llm.py Parādīt failu



logger = logging.getLogger(__name__) logger = logging.getLogger(__name__)



class NVIDIANIMProvider(OAIAPICompatLargeLanguageModel): class NVIDIANIMProvider(OAIAPICompatLargeLanguageModel):
""" """
Model class for NVIDIA NIM large language model. Model class for NVIDIA NIM large language model.
""" """
pass

+ 1
- 0
api/core/model_runtime/model_providers/nvidia_nim/nvidia_nim.py Parādīt failu



logger = logging.getLogger(__name__) logger = logging.getLogger(__name__)



class NVIDIANIMProvider(ModelProvider): class NVIDIANIMProvider(ModelProvider):


def validate_provider_credentials(self, credentials: dict) -> None: def validate_provider_credentials(self, credentials: dict) -> None:

+ 10
- 32
api/core/model_runtime/model_providers/nvidia_nim/nvidia_nim.yaml Parādīt failu

label: label:
en_US: NVIDIA NIM en_US: NVIDIA NIM
description: description:
en_US: NVIDIA NIM
zh_Hans: NVIDIA NIM
en_US: NVIDIA NIM, a set of easy-to-use inference microservices.
zh_Hans: NVIDIA NIM,一组易于使用的模型推理微服务。
icon_small: icon_small:
en_US: icon_s_en.svg en_US: icon_s_en.svg
icon_large: icon_large:
en_US: icon_l_en.png en_US: icon_l_en.png
background: "#EFFDFD" background: "#EFFDFD"
help:
title:
en_US: Learn more about NVIDIA NIM
zh_Hans: 了解 NVIDIA NIM 更多信息
url:
en_US: https://www.nvidia.com/en-us/ai/
supported_model_types: supported_model_types:
- llm - llm
configurate_methods: configurate_methods:
type: text-input type: text-input
required: true required: true
placeholder: placeholder:
zh_Hans: Base URL, e.g. https://api.openai.com/v1
en_US: Base URL, e.g. https://api.openai.com/v1
zh_Hans: Base URL, e.g. http://192.168.1.100:8000/v1
en_US: Base URL, e.g. http://192.168.1.100:8000/v1
- variable: mode - variable: mode
show_on: show_on:
- variable: __model_type - variable: __model_type
value: llm value: llm
default: '4096' default: '4096'
type: text-input type: text-input
- variable: vision_support
show_on:
- variable: __model_type
value: llm
label:
zh_Hans: Vision 支持
en_US: Vision Support
type: select
required: false
default: no_support
options:
- value: support
label:
en_US: Support
zh_Hans: 支持
- value: no_support
label:
en_US: Not Support
zh_Hans: 不支持
- variable: stream_mode_delimiter
label:
zh_Hans: 流模式返回结果的分隔符
en_US: Delimiter for streaming results
show_on:
- variable: __model_type
value: llm
default: '\n\n'
type: text-input

Notiek ielāde…
Atcelt
Saglabāt