OpenSource/dify - dify - 浩瀚星图

Cronologia

QuantumGhost 349c3cf7b8 feat(api): Add image multimodal support for LLMNode (#17372) Enhance `LLMNode` with multimodal capability, introducing support for image outputs. This implementation extracts base64-encoded images from LLM responses, saves them to the storage service, and records the file metadata in the `ToolFile` table. In conversations, these images are rendered as markdown-based inline images. Additionally, the images are included in the LLMNode's output as file variables, enabling subsequent nodes in the workflow to utilize them. To integrate file outputs into workflows, adjustments to the frontend code are necessary. For multimodal output functionality, updates to related model configurations are required. Currently, this capability has been applied exclusively to Google's Gemini models. Close #15814. Signed-off-by: -LAN- <laipz8200@outlook.com> Co-authored-by: -LAN- <laipz8200@outlook.com>		6 mesi fa
..
agent	fix: metadata filter not work (#19020)	6 mesi fa
app	feat(api): Add image multimodal support for LLMNode (#17372)	6 mesi fa
callback_handler	fix retrival resource miss in chatflow (#18307)	6 mesi fa
entities	fix: #18744 The model order defined in position.yaml in the Model Plugin is not taking effect. (#18756)	6 mesi fa
errors	fix(core/errors): change base class of custom exceptions to ValueError (#11955)	10 mesi fa
extension	feat: mypy for all type check (#10921)	10 mesi fa
external_data_tool	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 mesi fa
file	feat(api): Add image multimodal support for LLMNode (#17372)	6 mesi fa
helper	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 mesi fa
llm_generator	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 mesi fa
memory	fix: Update prompt message content types to use Literal and add union type for content (#17136)	6 mesi fa
model_runtime	feat(api): Add image multimodal support for LLMNode (#17372)	6 mesi fa
moderation	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 mesi fa
ops	refactor: Refactors repository imports structure (#18901)	6 mesi fa
plugin	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 mesi fa
prompt	Enhance Code Consistency Across Repository with `.editorconfig` (#19023)	6 mesi fa
rag	immediately return initialed tiktokenizer instance and remove dead code in usage of tiktokenizer (#17957)	6 mesi fa
repositories	refactor: Refactors repository imports structure (#18901)	6 mesi fa
tools	feat(api): Add image multimodal support for LLMNode (#17372)	6 mesi fa
variables	fix Unicode Escape Characters (#15318)	7 mesi fa
workflow	feat(api): Add image multimodal support for LLMNode (#17372)	6 mesi fa
__init__.py	chore(api/core): apply ruff reformatting (#7624)	1 anno fa
hosting_configuration.py	chore(provider_manager): Update hosted model's name (#14334)	8 mesi fa
indexing_runner.py	fix full-doc mode document doesn't reindex after enable or un_archive (#16737)	7 mesi fa
model_manager.py	feat(api): Add image multimodal support for LLMNode (#17372)	6 mesi fa
provider_manager.py	fix: perferred model provider not match with provider. (#18282)	6 mesi fa