OpenSource/dify - dify - 浩瀚星图

История

QuantumGhost 349c3cf7b8 feat(api): Add image multimodal support for LLMNode (#17372) Enhance `LLMNode` with multimodal capability, introducing support for image outputs. This implementation extracts base64-encoded images from LLM responses, saves them to the storage service, and records the file metadata in the `ToolFile` table. In conversations, these images are rendered as markdown-based inline images. Additionally, the images are included in the LLMNode's output as file variables, enabling subsequent nodes in the workflow to utilize them. To integrate file outputs into workflows, adjustments to the frontend code are necessary. For multimodal output functionality, updates to related model configurations are required. Currently, this capability has been applied exclusively to Google's Gemini models. Close #15814. Signed-off-by: -LAN- <laipz8200@outlook.com> Co-authored-by: -LAN- <laipz8200@outlook.com>		6 месяцев назад
..
agent	fix: metadata filter not work (#19020)	6 месяцев назад
app	feat(api): Add image multimodal support for LLMNode (#17372)	6 месяцев назад
callback_handler	fix retrival resource miss in chatflow (#18307)	6 месяцев назад
entities	fix: #18744 The model order defined in position.yaml in the Model Plugin is not taking effect. (#18756)	6 месяцев назад
errors	fix(core/errors): change base class of custom exceptions to ValueError (#11955)	10 месяцев назад
extension	feat: mypy for all type check (#10921)	10 месяцев назад
external_data_tool	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 месяцев назад
file	feat(api): Add image multimodal support for LLMNode (#17372)	6 месяцев назад
helper	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 месяцев назад
llm_generator	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 месяцев назад
memory	fix: Update prompt message content types to use Literal and add union type for content (#17136)	6 месяцев назад
model_runtime	feat(api): Add image multimodal support for LLMNode (#17372)	6 месяцев назад
moderation	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 месяцев назад
ops	refactor: Refactors repository imports structure (#18901)	6 месяцев назад
plugin	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 месяцев назад
prompt	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 месяцев назад
rag	immediately return initialed tiktokenizer instance and remove dead code in usage of tiktokenizer (#17957)	6 месяцев назад
repositories	refactor: Refactors repository imports structure (#18901)	6 месяцев назад
tools	feat(api): Add image multimodal support for LLMNode (#17372)	6 месяцев назад
variables	fix Unicode Escape Characters (#15318)	7 месяцев назад
workflow	feat(api): Add image multimodal support for LLMNode (#17372)	6 месяцев назад
__init__.py	chore(api/core): apply ruff reformatting (#7624)	1 год назад
hosting_configuration.py	chore(provider_manager): Update hosted model's name (#14334)	8 месяцев назад
indexing_runner.py	fix full-doc mode document doesn't reindex after enable or un_archive (#16737)	7 месяцев назад
model_manager.py	feat(api): Add image multimodal support for LLMNode (#17372)	6 месяцев назад
provider_manager.py	fix: perferred model provider not match with provider. (#18282)	6 месяцев назад