Commit Graph

497 Commits (bb1d1dc263df7f9922b6b29cc2d604a9756541a5)

Author SHA1 Message Date
QuantumGhost 349c3cf7b8
feat(api): Add image multimodal support for LLMNode (#17372)
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.

This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.

To integrate file outputs into workflows, adjustments to the frontend code
are necessary.

For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.

Close #15814.

Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
9 months ago
sondin d70fa2847b
add Accept-Ranges header for audio/video files (#19119) 9 months ago
xiaotian 23f6914b9b
fix: image preview triggers binary download (#19070) 9 months ago
小马哥 e5bdc1438a
fix: annotation update need use http put method and annotation-reply api doc parms wrong (#18891) 9 months ago
Yeuoly abafa68647
refactor: rename plugin manager to plugin client and rename path from manager to impl (#18876) 9 months ago
devxing 136995d2a1
fix: change delete app status code from 204 to 200 (#18398)
Co-authored-by: devxing <devxing@gmail.com>
Co-authored-by: crazywoola <427733928@qq.com>
9 months ago
1betatsu 9a3ecc1ac8
fix: Allow advanced chat app to get workflow run detail (#18753) (#18758) 10 months ago
gsmini ec82534a1e
optimize account status field hard coded (#18771)
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
Alex Chim 12836f9db9
Resolves #18536 Retreive conversation variables (#18581) 10 months ago
王晓阳 0babdffe3e
feat: support vastbase vector database (#16308) 10 months ago
Will 205535c8e9
chore: fix reimported (#18610) 10 months ago
Yeuoly ba9357da96
fix: handle PluginPermissionDeniedError in EndpointCreateApi (#18597) 10 months ago
Dongyu Li 413271eaa6
feat[plugin]:The plugin upload file change to be stored as a toolfile… (#18277) 10 months ago
lauding eb1ce3dd6b
feat: support huawei cloud vector database (#16141) 10 months ago
Xiyuan Chen 4247a6b807
fix: reset_password security issue (#18363) 10 months ago
Novice da9269ca97
feat: structured output (#17877) 10 months ago
Jyong e90c532c3a
fix retrival resource miss in chatflow (#18307) 10 months ago
Yeuoly 8f547e6340
fix(typing): validate OAuth code before processing access token (#18288) 10 months ago
Yeuoly 358fd28c28
feat: fetch app info in plugins (#18202) 10 months ago
jiangbo721 18f98f4fe1
fix: ruff check isoparse (#18033)
Co-authored-by: 刘江波 <jiangbo721@163.com>
10 months ago
诗浓 4166f73d9d
fix: page/limit param not effective (#18196) 10 months ago
kenwoodjw b247ef85bf
fix dataset api retrieval model null handling (#18151)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
10 months ago
Yeuoly 2134a76517
feat: add minimum dify version requirement to plugins (#18022) 10 months ago
Jasonfish 1f722cde22
fix(api): Some params were ignored when creating empty Datasets through API (#17932) 10 months ago
Yongtao Huang 5d72003ebb
Remove dead code (#17899) 10 months ago
Good Wood cc08451eb8
fix: fix file number limit error (#17848) 10 months ago
crazywoola 63ba607738
fix: 17712-get-messages-api-encountered-internal-server-error (#17716) 10 months ago
Yeuoly 33324ee23d
refactor: add API endpoint to list latest plugin versions and query it in a asynchronous way (#17695) 10 months ago
crazywoola eb8584613b
fix: Account.query => db.session.query(Account) (#17667) 10 months ago
Amir Mohsen Asaran f54905e685
feat: Integrate WaterCrawl.dev as a new knowledge base provider (#16396)
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
Jasonfish 0afad94378
fix: Correct "The job is not exist" to "The job does not exist" (#17516) 10 months ago
Jasonfish fd443941a2
feat(improve-api-endpoints): Added Datasets and Annotation APIs (#12237) 10 months ago
quicksand b146aaaeb7
optimize: plugin permission (#17507) 10 months ago
wlleiiwang 42a42a7962
FEAT: support Tencent vectordb to full text search (#16865)
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
10 months ago
crazywoola 4902ddaf87
Feat/change workspace name (#17402) 10 months ago
crazywoola c92bc84316
Fix/15429 forgotpasswordresetapi session management (#17390) 10 months ago
Jyong 0bf816f2e8
fix duplicate documents returned by Get document list service API (#17351) 10 months ago
liguochuan 11e95d2a61
Fix (api): Fix the processing logic of the retriever_resources field. (#17304)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
10 months ago
1Ckpwee bda06df668
fix: add app quota check to import API (#17295)
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
Xiyuan Chen 9c4be5d098
Feat/education api (#17168) 10 months ago
Panpan 24b1a625b3
feat: allow the embedding in websites to customize sys.user_id (#16062) 10 months ago
非法操作 44f911a0a8
chore: docstring not match the function parameter (#17162) 10 months ago
jiangbo721 a1aa325ce3
Chore/code format and Repair commit_id 3254018d more deleted codes and Fix naming error ambiguity between workflow_run_id and workflow_id (#17075)
Co-authored-by: 刘江波 <jiangbo721@163.com>
10 months ago
過世秋風 377d11d13b
fix: WorkflowRunDetailApi created_at、finished_at types changed to timestamps (#16821) 10 months ago
wanttobeamaster 7f70cadacb
feat: support Tablestore vector database (#16601)
Co-authored-by: xiaozhiqing.xzq <xiaozhiqing.xzq@alibaba-inc.com>
10 months ago
hsiong 6157f57872
feat: Add OceanBase hybrid search features (#16652)
Co-authored-by: 李远军 <4842@9ji.com>
Co-authored-by: yourchanges <yourchanges@gmail.com>
11 months ago
GuanMu 360986f38d
Feat add childchunk api (#16094) 11 months ago
lenbo 5eb0ca9b9d
fix: fix inner API workspace Account.query error. (#16630) 11 months ago
L8ng 83cd14104d
feat: datasets openapi list segements support paged resp (#16603) 11 months ago
jiangbo721 f31e3313b0
feat: Make the logic of APP filtering and creation the same (#16079)
Co-authored-by: 刘江波 <jiangbo721@163.com>
11 months ago