Commit Graph

16 Commits (8b5c46b2dfa072bceff8f28fb9d4ba89edbd6252)

Author SHA1 Message Date
-LAN- 62b29b3d76
feat: update file manager and file factory implementations (#22704)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Claude <noreply@anthropic.com>
7 months ago
QuantumGhost 349c3cf7b8
feat(api): Add image multimodal support for LLMNode (#17372)
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.

This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.

To integrate file outputs into workflows, adjustments to the frontend code
are necessary.

For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.

Close #15814.

Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
9 months ago
ZalterCitty a1158cc946
fix: Update prompt message content types to use Literal and add union type for content (#17136)
Co-authored-by: 朱庆超 <zhuqingchao@xiaomi.com>
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
kenwoodjw 3306228840
fix: workflow file add related-id in iteration node (#16255)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
11 months ago
yihong 56e15d09a9
feat: mypy for all type check (#10921) 1 year ago
-LAN- 996a9135f6
feat(llm_node): support order in text and files (#11837)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
非法操作 c9b4029ce7
chore: the consistency of MultiModalPromptMessageContent (#11721) 1 year ago
非法操作 74fdc16bd1
feat: enhance gemini models (#11497) 1 year ago
非法操作 9e23c3d625
chore: LOCAL_FILE also try to use remote_url as Prompt message (#11443) 1 year ago
-LAN- c5f7d650b5
feat: Allow using file variables directly in the LLM node and support more file types. (#10679)
Co-authored-by: Joel <iamjoel007@gmail.com>
1 year ago
crazywoola 5656f81bde
Revert "fix the error of unable to retrieve url from file" (#10511) 1 year ago
Xiao Ley 5eb27afd63
fix the error of unable to retrieve url from file (#10498) 1 year ago
-LAN- 25ca0278dd
refactor(core): Remove extra_config from File. (#10203) 1 year ago
非法操作 033ab5490b
feat: support LLM understand video (#9828) 1 year ago
非法操作 ddb960ddfb
feat: support Vectorizer can be used in workflow (#9932) 1 year ago
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 1 year ago