QuantumGhost
							
						 
						
							
								349c3cf7b8
								
									
										
											 
										
									
								
							 
						 
						
							
									feat(api): Add image multimodal support for LLMNode (#17372) 
							 
							
							 
							
							
							
							
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.
This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.
To integrate file outputs into workflows, adjustments to the frontend code
are necessary.
For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.
Close #15814 .
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com> 
							
						 
						6 个月前  
					 
				
					
						
							
								   -LAN-
							
						 
						
							
								8e6f6d64a4
								
									
										
											 
										
									
								
							 
						 
						
							
									feat: re-add prompt messages to result and chunks in llm (#17883) 
							 
							
							 
							
							
							
							
Signed-off-by: -LAN- <laipz8200@outlook.com> 
							
						 
						6 个月前  
					 
				
					
						
							
								   Yeuoly
							
						 
						
							
								403e2d58b9
								
									
										
											 
										
									
								
							 
						 
						
							
									Introduce Plugins (#13836) 
							 
							
							 
							
							
							
							
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: -LAN- <laipz8200@outlook.com>
Signed-off-by: xhe <xw897002528@gmail.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: takatost <takatost@gmail.com>
Co-authored-by: kurokobo <kuro664@gmail.com>
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
Co-authored-by: AkaraChen <akarachen@outlook.com>
Co-authored-by: Yi <yxiaoisme@gmail.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: twwu <twwu@dify.ai>
Co-authored-by: Hiroshi Fujita <fujita-h@users.noreply.github.com>
Co-authored-by: AkaraChen <85140972+AkaraChen@users.noreply.github.com>
Co-authored-by: NFish <douxc512@gmail.com>
Co-authored-by: Wu Tianwei <30284043+WTW0313@users.noreply.github.com>
Co-authored-by: 非法操作 <hjlarry@163.com>
Co-authored-by: Novice <857526207@qq.com>
Co-authored-by: Hiroki Nagai <82458324+nagaihiroki-git@users.noreply.github.com>
Co-authored-by: Gen Sato <52241300+halogen22@users.noreply.github.com>
Co-authored-by: eux <euxuuu@gmail.com>
Co-authored-by: huangzhuo1949 <167434202+huangzhuo1949@users.noreply.github.com>
Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com>
Co-authored-by: lotsik <lotsik@mail.ru>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: nite-knite <nkCoding@gmail.com>
Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: gakkiyomi <gakkiyomi@aliyun.com>
Co-authored-by: CN-P5 <heibai2006@gmail.com>
Co-authored-by: CN-P5 <heibai2006@qq.com>
Co-authored-by: Chuehnone <1897025+chuehnone@users.noreply.github.com>
Co-authored-by: yihong <zouzou0208@gmail.com>
Co-authored-by: Kevin9703 <51311316+Kevin9703@users.noreply.github.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Boris Feld <lothiraldan@gmail.com>
Co-authored-by: mbo <himabo@gmail.com>
Co-authored-by: mabo <mabo@aeyes.ai>
Co-authored-by: Warren Chen <warren.chen830@gmail.com>
Co-authored-by: JzoNgKVO <27049666+JzoNgKVO@users.noreply.github.com>
Co-authored-by: jiandanfeng <chenjh3@wangsu.com>
Co-authored-by: zhu-an <70234959+xhdd123321@users.noreply.github.com>
Co-authored-by: zhaoqingyu.1075 <zhaoqingyu.1075@bytedance.com>
Co-authored-by: 海狸大師 <86974027+yenslife@users.noreply.github.com>
Co-authored-by: Xu Song <xusong.vip@gmail.com>
Co-authored-by: rayshaw001 <396301947@163.com>
Co-authored-by: Ding Jiatong <dingjiatong@gmail.com>
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
Co-authored-by: JasonVV <jasonwangiii@outlook.com>
Co-authored-by: le0zh <newlight@qq.com>
Co-authored-by: zhuxinliang <zhuxinliang@didiglobal.com>
Co-authored-by: k-zaku <zaku99@outlook.jp>
Co-authored-by: luckylhb90 <luckylhb90@gmail.com>
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: jiangbo721 <365065261@qq.com>
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: Shun Miyazawa <34241526+miya@users.noreply.github.com>
Co-authored-by: EricPan <30651140+Egfly@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: sino <sino2322@gmail.com>
Co-authored-by: Jhvcc <37662342+Jhvcc@users.noreply.github.com>
Co-authored-by: lowell <lowell.hu@zkteco.in>
Co-authored-by: Boris Polonsky <BorisPolonsky@users.noreply.github.com>
Co-authored-by: Ademílson Tonato <ademilsonft@outlook.com>
Co-authored-by: Ademílson Tonato <ademilson.tonato@refurbed.com>
Co-authored-by: IWAI, Masaharu <iwaim.sub@gmail.com>
Co-authored-by: Yueh-Po Peng (Yabi) <94939112+y10ab1@users.noreply.github.com>
Co-authored-by: Jason <ggbbddjm@gmail.com>
Co-authored-by: Xin Zhang <sjhpzx@gmail.com>
Co-authored-by: yjc980121 <3898524+yjc980121@users.noreply.github.com>
Co-authored-by: heyszt <36215648+hieheihei@users.noreply.github.com>
Co-authored-by: Abdullah AlOsaimi <osaimiacc@gmail.com>
Co-authored-by: Abdullah AlOsaimi <189027247+osaimi@users.noreply.github.com>
Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: Hash Brown <hi@xzd.me>
Co-authored-by: zuodongxu <192560071+zuodongxu@users.noreply.github.com>
Co-authored-by: Masashi Tomooka <tmokmss@users.noreply.github.com>
Co-authored-by: aplio <ryo.091219@gmail.com>
Co-authored-by: Obada Khalili <54270856+obadakhalili@users.noreply.github.com>
Co-authored-by: Nam Vu <zuzoovn@gmail.com>
Co-authored-by: Kei YAMAZAKI <1715090+kei-yamazaki@users.noreply.github.com>
Co-authored-by: TechnoHouse <13776377+deephbz@users.noreply.github.com>
Co-authored-by: Riddhimaan-Senapati <114703025+Riddhimaan-Senapati@users.noreply.github.com>
Co-authored-by: MaFee921 <31881301+2284730142@users.noreply.github.com>
Co-authored-by: te-chan <t-nakanome@sakura-is.co.jp>
Co-authored-by: HQidea <HQidea@users.noreply.github.com>
Co-authored-by: Joshbly <36315710+Joshbly@users.noreply.github.com>
Co-authored-by: xhe <xw897002528@gmail.com>
Co-authored-by: weiwenyan-dev <154779315+weiwenyan-dev@users.noreply.github.com>
Co-authored-by: ex_wenyan.wei <ex_wenyan.wei@tcl.com>
Co-authored-by: engchina <12236799+engchina@users.noreply.github.com>
Co-authored-by: engchina <atjapan2015@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: 呆萌闷油瓶 <253605712@qq.com>
Co-authored-by: Kemal <kemalmeler@outlook.com>
Co-authored-by: Lazy_Frog <4590648+lazyFrogLOL@users.noreply.github.com>
Co-authored-by: Yi Xiao <54782454+YIXIAO0@users.noreply.github.com>
Co-authored-by: Steven sun <98230804+Tuyohai@users.noreply.github.com>
Co-authored-by: steven <sunzwj@digitalchina.com>
Co-authored-by: Kalo Chin <91766386+fdb02983rhy@users.noreply.github.com>
Co-authored-by: Katy Tao <34019945+KatyTao@users.noreply.github.com>
Co-authored-by: depy <42985524+h4ckdepy@users.noreply.github.com>
Co-authored-by: 胡春东 <gycm520@gmail.com>
Co-authored-by: Junjie.M <118170653@qq.com>
Co-authored-by: MuYu <mr.muzea@gmail.com>
Co-authored-by: Naoki Takashima <39912547+takatea@users.noreply.github.com>
Co-authored-by: Summer-Gu <37869445+gubinjie@users.noreply.github.com>
Co-authored-by: Fei He <droxer.he@gmail.com>
Co-authored-by: ybalbert001 <120714773+ybalbert001@users.noreply.github.com>
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
Co-authored-by: douxc <7553076+douxc@users.noreply.github.com>
Co-authored-by: liuzhenghua <1090179900@qq.com>
Co-authored-by: Wu Jiayang <62842862+Wu-Jiayang@users.noreply.github.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: kimjion <45935338+kimjion@users.noreply.github.com>
Co-authored-by: AugNSo <song.tiankai@icloud.com>
Co-authored-by: llinvokerl <38915183+llinvokerl@users.noreply.github.com>
Co-authored-by: liusurong.lsr <liusurong.lsr@alibaba-inc.com>
Co-authored-by: Vasu Negi <vasu-negi@users.noreply.github.com>
Co-authored-by: Hundredwz <1808096180@qq.com>
Co-authored-by: Xiyuan Chen <52963600+GareArc@users.noreply.github.com> 
							
						 
						8 个月前  
					 
				
					
						
							
								   yihong
							
						 
						
							
								56e15d09a9
								
									
										
											 
										
									
								
							 
						 
						
							
									feat: mypy for all type check (#10921) 
							 
							
							
							
						 
						10 个月前  
					 
				
					
						
							
								   -LAN-
							
						 
						
							
								c5f7d650b5
								
									
										
											 
										
									
								
							 
						 
						
							
									feat: Allow using file variables directly in the LLM node and support more file types. (#10679) 
							 
							
							 
							
							
							
							
Co-authored-by: Joel <iamjoel007@gmail.com> 
							
						 
						11 个月前  
					 
				
					
						
							
								   Bowen Liang
							
						 
						
							
								0ebe198ff1
								
									
										
											 
										
									
								
							 
						 
						
							
									chore: use DEBUG in dify_config instead of parsing raw system environment variable in place (#10437) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   -LAN-
							
						 
						
							
								e61752bd3a
								
									
										
											 
										
									
								
							 
						 
						
							
									feat/enhance the multi-modal support (#8818) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   zhuhao
							
						 
						
							
								b90ad587c2
								
									
										
											 
										
									
								
							 
						 
						
							
									refactor: move the embedding to the rag module and abstract the rerank runner for extension (#9423) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   Jyong
							
						 
						
							
								4669eb24be
								
									
										
											 
										
									
								
							 
						 
						
							
									add embedding input type parameter (#8724) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   -LAN-
							
						 
						
							
								ed37439ef7
								
									
										
											 
										
									
								
							 
						 
						
							
									refactor(api/core): Improve type hints and apply ruff formatter in agent runner and model manager. (#8166) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   Shota Totsuka
							
						 
						
							
								430e100142
								
									
										
											 
										
									
								
							 
						 
						
							
									refactor: Add @staticmethod decorator in `api/core` (#7652) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   Xiyuan Chen
							
						 
						
							
								4e7b6aec3a
								
									
										
											 
										
									
								
							 
						 
						
							
									feat: support pinning, including, and excluding for model providers and tools (#7419) 
							 
							
							 
							
							
							
							
Co-authored-by: GareArc <chen4851@purude.edu> 
							
						 
						1年前  
					 
				
					
						
							
								   Nam Vu
							
						 
						
							
								dbc1ae45de
								
									
										
											 
										
									
								
							 
						 
						
							
									chore: update docstrings (#7343) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   -LAN-
							
						 
						
							
								cd7fa8027a
								
									
										
											 
										
									
								
							 
						 
						
							
									fix(api/core/model_manager.py): Avoid mutation during iteration. (#6536) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   -LAN-
							
						 
						
							
								5e6fc58db3
								
									
										
											 
										
									
								
							 
						 
						
							
									Feat/environment variables in workflow (#6515) 
							 
							
							 
							
							
							
							
Co-authored-by: JzoNg <jzongcode@gmail.com> 
							
						 
						1年前  
					 
				
					
						
							
								   chenxu9741
							
						 
						
							
								6ef401a9f0
								
									
										
											 
										
									
								
							 
						 
						
							
									feat:add tts-streaming config and future (#5492) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   -LAN-
							
						 
						
							
								23fa3dedc4
								
									
										
											 
										
									
								
							 
						 
						
							
									fix(core): Fix incorrect type hints. (#5427) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   takatost
							
						 
						
							
								5986841e27
								
									
										
											 
										
									
								
							 
						 
						
							
									fix: issue where an error occurs when invoking TTS without selecting a voice (#5046) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   takatost
							
						 
						
							
								d1dbbc1e33
								
									
										
											 
										
									
								
							 
						 
						
							
									feat: backend model load balancing support (#4927) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   takatost
							
						 
						
							
								7753ba2d37
								
									
										
											 
										
									
								
							 
						 
						
							
									FEAT: NEW WORKFLOW ENGINE (#3160) 
							 
							
							 
							
							
							
							
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: nite-knite <nkCoding@gmail.com>
Co-authored-by: jyong <718720800@qq.com> 
							
						 
						1年前  
					 
				
					
						
							
								   Charlie.Wei
							
						 
						
							
								300d9892a5
								
									
										
											 
										
									
								
							 
						 
						
							
									tts add voice choose (#2391) 
							 
							
							 
							
							
							
							
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com> 
							
						 
						1年前  
					 
				
					
						
							
								   Bowen Liang
							
						 
						
							
								063191889d
								
									
										
											 
										
									
								
							 
						 
						
							
									chore: apply ruff's pyupgrade linter rules to modernize Python code with targeted version (#2419) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   Bowen Liang
							
						 
						
							
								14a19a3da9
								
									
										
											 
										
									
								
							 
						 
						
							
									chore: apply ruff's pyflakes linter rules (#2420) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   takatost
							
						 
						
							
								9f637ead38
								
									
										
											 
										
									
								
							 
						 
						
							
									bump version to 0.5.3 (#2306) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   Charlie.Wei
							
						 
						
							
								6355e61eb8
								
									
										
											 
										
									
								
							 
						 
						
							
									tts models support (#2033) 
							 
							
							 
							
							
							
							
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Yeuoly <45712896+Yeuoly@users.noreply.github.com> 
							
						 
						1年前  
					 
				
					
						
							
								   Bowen Liang
							
						 
						
							
								cc9e74123c
								
									
										
											 
										
									
								
							 
						 
						
							
									improve: introduce isort for linting Python imports (#1983) 
							 
							
							
							
						 
						1年前  
					 
				
					
						
							
								   Jyong
							
						 
						
							
								24bdedf802
								
									
										
											 
										
									
								
							 
						 
						
							
									fix get embedding model provider in empty dataset (#1986) 
							 
							
							 
							
							
							
							
Co-authored-by: jyong <jyong@dify.ai> 
							
						 
						1年前  
					 
				
					
						
							
								   Charlie.Wei
							
						 
						
							
								5b24d7129e
								
									
										
											 
										
									
								
							 
						 
						
							
									Azure openai init (#1929) 
							 
							
							 
							
							
							
							
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com> 
							
						 
						1年前  
					 
				
					
						
							
								   takatost
							
						 
						
							
								d069c668f8
								
									
										
											 
										
									
								
							 
						 
						
							
									Model Runtime (#1858) 
							 
							
							 
							
							
							
							
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: Yeuoly <admin@srmxy.cn> 
							
						 
						1年前