You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
gcgj-dify-1.7.0/api/core/workflow/nodes
QuantumGhost 349c3cf7b8
feat(api): Add image multimodal support for LLMNode (#17372)
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.

This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.

To integrate file outputs into workflows, adjustments to the frontend code
are necessary.

For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.

Close #15814.

Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
11 months ago
..
agent refactor: rename plugin manager to plugin client and rename path from manager to impl (#18876) 11 months ago
answer fix(fail-branch): prevent streaming output in exception branches (#17153) 11 months ago
base chore(api): improve type hints for BaseNode and its subclasses (#15826) 1 year ago
code feat: remove file and file[] restriction in code node (#17382) 12 months ago
document_extractor remove unstructured api key check (#18989) 11 months ago
end Feature/newnew workflow loop node (#14863) 1 year ago
event feat: mypy for all type check (#10921) 1 year ago
http_request feat(api): Add image multimodal support for LLMNode (#17372) 11 months ago
if_else Chore: fix some wrong annotations (#17413) 12 months ago
iteration chore(api): improve type hints for BaseNode and its subclasses (#15826) 1 year ago
knowledge_retrieval fix: inconsistent case expression in _process_metadata_filter_func (#19146) 11 months ago
list_operator fix:the extraction function of the list operation node received 0 that should not be received (#18170) 11 months ago
llm feat(api): Add image multimodal support for LLMNode (#17372) 11 months ago
loop Feat/loop node (#17273) 12 months ago
parameter_extractor Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 11 months ago
question_classifier Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 11 months ago
start chore: cleanup unchanged overridden method in subclasses of BaseNode (#14281) 1 year ago
template_transform Chore: fix some wrong annotations (#17413) 12 months ago
tool refactor: rename plugin manager to plugin client and rename path from manager to impl (#18876) 11 months ago
variable_aggregator Chore: fix some wrong annotations (#17413) 12 months ago
variable_assigner feat: support remove first and remove last in variable assigner (#19144) 11 months ago
__init__.py feat/enhance the multi-modal support (#8818) 1 year ago
enums.py Feat/loop node (#17273) 12 months ago
node_mapping.py Feat/loop node (#17273) 12 months ago