Commit Graph

2402 Commits (1274aaed5d2812423928254dc36197f61ba201b4)

Author SHA1 Message Date
zhaobingshuang 303c6ecc1d
fix: The init_azure_openai() method in the core/hosting_configuration.py file doesn't work (#19704) (#19705)
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
satohk 1b4fea1794
fix: Referencing Metadata in the response of the External Knowledge A… (#19637) (#19644)
Co-authored-by: satou.kazuhiro <satou.kazuhiro@fanuc.co.jp>
11 months ago
jiangbo721 fabfc7d4d8
fix: remove error message $ symbol (#19587)
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
SSebo 57b3912227
fix: common prerequisite node workflow remove reachable node that failed to streaming llm… (#19552)
Co-authored-by: zhangshibo <zhangshibo@didiglobal.com>
11 months ago
Bowen Liang 0b22e8b544
chore: speed up api service startup time by defering the imports for trace services (#19504) 11 months ago
非法操作 085bd1aa93
chore: model.query change to db.session.query (#19551)
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
11 months ago
非法操作 14cd71ed0a
chore: all model.query replace to db.session.query (#19521) 11 months ago
非法操作 b00f94df64
fix: replace all dataset.Model.query to db.session.query(Model) (#19509) 11 months ago
LeanDeR c720e0dd04
refactor(workflow): revamp logging module for loop & iteration nodes (#19484) 11 months ago
湛露先生 1119790b02
clean rag word_extractor. (#19397)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
11 months ago
Bowen Liang cbc8ebd8f5
chore: bump pydantic to 2.11 and pydantic-settings to 2.9 (#15049) 11 months ago
Will 58d9d35515
fix: inconsistent metadata definitions (#19343) 11 months ago
Yeuoly 3258a91d5d
Feat/add repo to plugin manifest (#19337) 11 months ago
Will 0358859467
fix: llm_usage.total_tokens stat (#19177) 11 months ago
Will bfa652f2d0
fix: metadata filtering condition variable unassigned; fix External K… (#19208) 11 months ago
-LAN- f23cf98317
refactor: Remove RepositoryFactory (#19176)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Novice 0cfc82d731
fix(structured-output): reasoning model's json format parsing (#19261) 11 months ago
Bowen Liang 8537abfff8
chore: avoid repeated type ignore noqa by adding flask_restful and flask_login in mypy import exclusions (#19224) 11 months ago
kenwoodjw c5568f756f
fix basic auth if not base64 encode (#19242)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
11 months ago
Bowen Liang 22f5af9987
fix: support non-ascii charactors in filename of the tool files (#19228) 11 months ago
Hao Cheng 9bcf837f17
fix: use only supported operators in metadata filter system prompts (#19195) 12 months ago
Will a212a63e6a
fix: time type metadata filtering error (#19192) 12 months ago
非法操作 1ca6dbcdc8
fix: file name incorrect when download file (#19183) 12 months ago
QuantumGhost 349c3cf7b8
feat(api): Add image multimodal support for LLMNode (#17372)
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.

This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.

To integrate file outputs into workflows, adjustments to the frontend code
are necessary.

For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.

Close #15814.

Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
12 months ago
Bowen Liang 12c96b93d9
immediately return initialed tiktokenizer instance and remove dead code in usage of tiktokenizer (#17957) 12 months ago
-LAN- bcc95e520b
feat: support remove first and remove last in variable assigner (#19144)
Signed-off-by: -LAN- <laipz8200@outlook.com>
12 months ago
Will 69b43a955f
fix: inconsistent case expression in _process_metadata_filter_func (#19146) 12 months ago
kingpc 65b7a783fe
fix: metadata filter not work (#19020)
Co-authored-by: 金鹏程 <jinpengcheng01@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
12 months ago
QuantumGhost bd1bbfee4b
Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 12 months ago
feiyang_deepnova 226afd4550
Fix: the issue of getting empty environment variables. (#19085) 12 months ago
Ahmad Zidan 8266815cda
feat: add AWS Managed IAM auth for OpenSearch vector DB (#18963) 12 months ago
Ethan 8b4ea01810
feat: support access milvus with token (#19034) 12 months ago
Panpan 83187b30c0
fix: fix rerank model runner usage (#19008) 12 months ago
Ganondorf a147d2a200
feat(api): use `json_repair` to fix invalid json while generating structured output (#18977)
When generating JSON schema using an LLM in the structured output feature,
models may occasionally return invalid JSON, which prevents clients from correctly 
parsing the response and can lead to UI breakage.

This commit addresses the issue by introducing `json_repair` to automatically 
fix invalid JSON strings returned by the LLM, ensuring smoother functionality 
and better client-side handling of structured outputs.


Co-authored-by: lizb <lizb@sugon.com>
12 months ago
Kevin9703 94cc0b7a12
fix(workflow_cycle_manage): failed nodes were not updated in workflow_node_executions (#18994) 12 months ago
Jyong b8bb45b106
remove unstructured api key check (#18989) 12 months ago
quicksand 5de01c1444
feat (document_extractor): support .properties file (#18969) 12 months ago
-LAN- f86e2edc54
refactor(plugin/backwards_invocation/app): Remove unnecessary .value from StrEnum (#18896)
Signed-off-by: -LAN- <laipz8200@outlook.com>
12 months ago
crazywoola 2c2af1d117
feat: add VTT data transform to Document extractor (#18936) 12 months ago
cooper.wu 7a62202392
fix: when cot_agent call tool like searxng lost some response content (#16781) 12 months ago
-LAN- d9aa2b155a
refactor: Refactors repository imports structure (#18901)
Signed-off-by: -LAN- <laipz8200@outlook.com>
12 months ago
Yeuoly 0e0ec4691a
feat: add interfaces of OAuth handler methods for authorization (#18889) 12 months ago
Yeuoly abafa68647
refactor: rename plugin manager to plugin client and rename path from manager to impl (#18876) 12 months ago
非法操作 c1559a7c8e
fix: LLMResultChunk cause concatenate str and list exception (#18852) 12 months ago
Wesley b62eb61400
fix depth param issue for WaterCrawl (#18839) 12 months ago
Bharat Ramanathan 0a20210a59
feat: Add W&B Weave Tracing Integration (#14262)
Signed-off-by: Yuichiro Utsumi <utsumi.yuichiro@fujitsu.com>
Signed-off-by: -LAN- <laipz8200@outlook.com>
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
Signed-off-by: ChengZi <chen.zhang@zilliz.com>
Signed-off-by: cl <cailue@apache.org>
Co-authored-by: Yu Chun Chang <changyuchun159630@gmail.com>
Co-authored-by: Kyle Chang <kylechang@91app.com>
Co-authored-by: Lick-liu <51771897+Lick-liu@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Yuichiro Utsumi <81412151+utsumi-fj@users.noreply.github.com>
Co-authored-by: NFish <douxc512@gmail.com>
Co-authored-by: Yeuoly <45712896+Yeuoly@users.noreply.github.com>
Co-authored-by: Wu Tianwei <30284043+WTW0313@users.noreply.github.com>
Co-authored-by: DDDDD12138 <43703884+DDDDD12138@users.noreply.github.com>
Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Novice <857526207@qq.com>
Co-authored-by: yihong <zouzou0208@gmail.com>
Co-authored-by: Kalo Chin <91766386+fdb02983rhy@users.noreply.github.com>
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
Co-authored-by: jiangbo721 <365065261@qq.com>
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: Lam <scau_ljw@126.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Mars <524574386@qq.com>
Co-authored-by: mars <linjx2@by-health.com>
Co-authored-by: Joe <79627742+ZhouhaoJiang@users.noreply.github.com>
Co-authored-by: Rafael Carvalho <r.carvalho@me.com>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: 非法操作 <hjlarry@163.com>
Co-authored-by: kenwoodjw <blackxin55+@gmail.com>
Co-authored-by: codingjaguar <codingjaguar@gmail.com>
Co-authored-by: ChengZi <chen.zhang@zilliz.com>
Co-authored-by: Fei He <droxer.he@gmail.com>
Co-authored-by: Arcaner <52057416+lrhan321@users.noreply.github.com>
Co-authored-by: Xiyuan Chen <52963600+GareArc@users.noreply.github.com>
Co-authored-by: KVOJJJin <jzongcode@gmail.com>
Co-authored-by: XiaoBa <94062266+XiaoBa-Yu@users.noreply.github.com>
Co-authored-by: Xiaoba Yu <xb1823725853@gmail.com>
Co-authored-by: zhangyuhang <2827528315@qq.com>
Co-authored-by: yuhang2.zhang <yuhang2.zhang@ly.com>
Co-authored-by: 诗浓 <nyaashino@gmail.com>
Co-authored-by: RookieAgent <42060616+Sakura4036@users.noreply.github.com>
Co-authored-by: sho-takano-dev <shota.takano.dev@gmail.com>
Co-authored-by: 過世秋風 <1040926235@qq.com>
Co-authored-by: Yi Feng <66539215+bigyifeng@users.noreply.github.com>
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
Co-authored-by: Yongtao Huang <99629139+hyongtao-db@users.noreply.github.com>
Co-authored-by: ShadowJobs <794878115@qq.com>
Co-authored-by: LinYing <linying@momenta.ai>
Co-authored-by: Benjamin <benjaminx@gmail.com>
Co-authored-by: LiuBodong <liubodong2010@126.com>
Co-authored-by: huangzhuo1949 <167434202+huangzhuo1949@users.noreply.github.com>
Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com>
Co-authored-by: csurong <csurong1@gmail.com>
Co-authored-by: 傻笑zz <43721571+shaxiaozz@users.noreply.github.com>
Co-authored-by: L8ng <straydragonl@foxmail.com>
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
Co-authored-by: GuanMu <ballmanjq@gmail.com>
Co-authored-by: LittleFish-15 <58618983+LittleFish-15@users.noreply.github.com>
Co-authored-by: 诗浓 <844670992@qq.com>
Co-authored-by: luckylhb90 <luckylhb90@gmail.com>
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: Gen Sato <52241300+halogen22@users.noreply.github.com>
Co-authored-by: twwu <twwu@dify.ai>
Co-authored-by: StoneFancyX <53338920+StoneFancyX@users.noreply.github.com>
Co-authored-by: StoneFancyX <kindbin@qq.com>
Co-authored-by: Naoki KOBAYASHI <naotama@gmail.com>
Co-authored-by: kurokobo <kuro664@gmail.com>
Co-authored-by: cyflhn <cyflhn@163.com>
Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: jimmyfen <757343258@qq.com>
Co-authored-by: Xuetao Song <xuetaomagicsong@gmail.com>
Co-authored-by: Panpan <wurui.dev@gmail.com>
Co-authored-by: wyy-holding <59436937+wyy-holding@users.noreply.github.com>
Co-authored-by: リイノ Lin <sorphwer@gmail.com>
Co-authored-by: Ning <accelerator314@gmail.com>
Co-authored-by: Linh Nguyen <55907715+batman0911@users.noreply.github.com>
Co-authored-by: Junjie.M <118170653@qq.com>
Co-authored-by: Ron <svcvit@gmail.com>
Co-authored-by: Novice <novice12185727@gmail.com>
Co-authored-by: NanoNova <kid1412621@gmail.com>
Co-authored-by: JaydenZhou <380774082@qq.com>
Co-authored-by: dotdotdot <823150982@qq.com>
Co-authored-by: Good Wood <slm_1990@126.com>
Co-authored-by: Ryosei Karaki <38310693+karamaru-alpha@users.noreply.github.com>
Co-authored-by: chenhuan0728 <54611342+chenhuan0728@users.noreply.github.com>
Co-authored-by: chenhuan <huan.chen0728@foxmail>
Co-authored-by: lenbo <islenbo@qq.com>
Co-authored-by: Jiang <65766008+AlwaysBluer@users.noreply.github.com>
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
Co-authored-by: Yongtao Huang <yongtaoh2022@gmail.com>
Co-authored-by: zhangkun-21 <sephiroth0932@gmail.com>
Co-authored-by: hsiong <37357447+hsiong@users.noreply.github.com>
Co-authored-by: 李远军 <4842@9ji.com>
Co-authored-by: yourchanges <yourchanges@gmail.com>
Co-authored-by: David <guyuezhuying@126.com>
Co-authored-by: liuzhenghua <1090179900@qq.com>
Co-authored-by: taokuizu <taokuizu@qq.com>
Co-authored-by: Hanqing Zhao <sherry9277@gmail.com>
Co-authored-by: JimintheBox <gjwlals111@gmail.com>
Co-authored-by: wlleiiwang <1025164922@qq.com>
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
Co-authored-by: Alex <32982705+AlexYuan997@users.noreply.github.com>
Co-authored-by: yuanlong <yuanlong@boco.com.cn>
Co-authored-by: wanttobeamaster <45583625+wanttobeamaster@users.noreply.github.com>
Co-authored-by: xiaozhiqing.xzq <xiaozhiqing.xzq@alibaba-inc.com>
Co-authored-by: Chenhe Gu <guchenhe@gmail.com>
Co-authored-by: tyounami <vkbo@qq.com>
Co-authored-by: bo.zhao <bo.zhao@iglooinsure.com>
Co-authored-by: ClSlaid <cailue@apache.org>
Co-authored-by: adru <106513264+adpanru@users.noreply.github.com>
Co-authored-by: horochx <32632779+horochx@users.noreply.github.com>
12 months ago
-LAN- c104febf63
refactor: Apply DI to WorkflowNodeExecutionRepository. (#18794)
Signed-off-by: -LAN- <laipz8200@outlook.com>
12 months ago
bravomark 9bcc8041e9
fix: #18744 The model order defined in position.yaml in the Model Plugin is not taking effect. (#18756) 12 months ago
luckylhb90 2627e221f2
fix: buildin tool provider credentials_for_provider (#18725)
Co-authored-by: hobo.l <hobo.l@binance.com>
12 months ago
just2gooo 5e2b3b34e5
issue: #17056 : Add a reason field to the message_replace event (#17195)
Co-authored-by: 聂政 <niezheng@pjlab.org.cn>
12 months ago
Jiang 37e2f73909
[Lindorm VDB] Add the QUERY_TIMEOUT parameter to force the search query to fail. (#18613)
Co-authored-by: jiangzhijie <jiangzhijie.jzj@alibaba-inc.com>
12 months ago
王晓阳 0babdffe3e
feat: support vastbase vector database (#16308) 12 months ago
Ganondorf d242e4b95b
fix agentflow error if first variable is num (#18660)
Co-authored-by: lizb <lizb@sugon.com>
12 months ago
PyKen 2266001d19
Fix some prompt typos (#18645) 12 months ago
Jyong e2cb7006c4
check metadata_filtering_conditions could be None in auto mode (#18548) 12 months ago
ZalterCitty a1158cc946
fix: Update prompt message content types to use Literal and add union type for content (#17136)
Co-authored-by: 朱庆超 <zhuqingchao@xiaomi.com>
Co-authored-by: crazywoola <427733928@qq.com>
12 months ago
lauding eb1ce3dd6b
feat: support huawei cloud vector database (#16141) 12 months ago
tmuife 7b6523e54d
Update Oracle db connection library and change connection pool to single connection (#18466) 12 months ago
Novice f191d372f0
fix(promptMessage): correct field_serializer implementation for content serialization (#18458) 12 months ago
Will cb69cb2d64
fix weird syntax error (#18454) 12 months ago
-LAN- 44a2eca449
refactor: Refactors workflow node execution handling (#18382)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Novice da9269ca97
feat: structured output (#17877) 1 year ago
Rain Wang d2e3744ca3
Switching from CONSOLE_API_URL to FILES_URL in word_extractor.py (#18249) 1 year ago
Ganondorf dc9c5a4bc7
make repository type be private (#18304)
Co-authored-by: lizb <lizb@sugon.com>
1 year ago
Jyong e90c532c3a
fix retrival resource miss in chatflow (#18307) 1 year ago
Vitor defd5520ea
fix: invalid new tool call creation logic during response handling in OAI-Compat model (#17781) 1 year ago
-LAN- 22a1bc337f
fix: perferred model provider not match with provider. (#18282)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Rain Wang 83f1aeec1d
Fix ORDER BY (score, id) error in api/core/rag/datasource/vdb/analyticdb/analyticdb_vector_sql.py line 249 (#18252) 1 year ago
-LAN- 6d9dd3109e
feat: add a abstract layer for WorkflowNodeExcetion (#18026) 1 year ago
Novice 6d66e3f680
fix(follow_ups): handle empty LLM responses in context (#18237) 1 year ago
Rain Wang e8d98e3d89
Add analyzer_params config for milvus vectordb (#18180) 1 year ago
Novice c91045a9d0
fix(fail-branch): prevent streaming output in exception branches (#17153) 1 year ago
Yeuoly 358fd28c28
feat: fetch app info in plugins (#18202) 1 year ago
Arcaner cac0d3c33e
fix: implement robust file type checks to align with existing logic (#17557)
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
1 year ago
Junjie.M b7e8517b31
feat: agent strategy parameter add help information (#18192) 1 year ago
呆萌闷油瓶 8cc37f3115
fix:the extraction function of the list operation node received 0 that should not be received (#18170) 1 year ago
Ganondorf b006b9ac0c
Http requests node add ssl verify (#18125)
Co-authored-by: lizb <lizb@sugon.com>
1 year ago
Jyong 95283b4dd3
Feat/change split length method (#18097)
Co-authored-by: JzoNg <jzongcode@gmail.com>
1 year ago
Yeuoly d619fa1767
feat: implement blob chunk handling in plugin manager (#18101) 1 year ago
YANG d119c7d629
ignore errors when creating duplicate indexes (#18069)
Co-authored-by: 璟义 <yangshangpo.ysp@alibaba-inc.com>
1 year ago
huangzhuo1949 5dd9acbe44
fix: cot agent chinese json bug (#18073)
Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com>
1 year ago
Junjie.M 05b8b2a30c
fix: plugin parameter type TOOLS_SELECTOR parameter not validation required (#18060) 1 year ago
kenwoodjw dfc123819e
fix basic auth encoding (#18047)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
1 year ago
Yeuoly 2134a76517
feat: add minimum dify version requirement to plugins (#18022) 1 year ago
Novice 85004f8510
fix(typo): workflow ops triggered from (#18019) 1 year ago
kenwoodjw 53efb2bad5
fix chat message type error (#17997)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
1 year ago
Novice cd7fd100a7
fix(langfuse): qusetion classify node can't see cost in langfuse (#17982) 1 year ago
Jasonfish 1f722cde22
fix(api): Some params were ignored when creating empty Datasets through API (#17932) 1 year ago
Yongtao Huang 5d72003ebb
Remove dead code (#17899) 1 year ago
QuantumGhost 4ef297bf38
refactor(api): Enhance error handling in BasePluginManager (#17887) 1 year ago
-LAN- 8e6f6d64a4
feat: re-add prompt messages to result and chunks in llm (#17883)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
briqt 91cfa90503
Fix external knowledge Issues: (#17685) (#17843) 1 year ago
Good Wood cc08451eb8
fix: fix file number limit error (#17848) 1 year ago
yihong f04d52c044
fix: autocorrect everything in api (#17859)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
Yeuoly b2f5ca356a
enhance(plugin): replace json.loads with Pydantic model_validate_json (#17867) 1 year ago
Xu Song 1e1d457548
fix: make prompt consistent with few-show examples (#11538) 1 year ago
zxfishhack 5541a1f80e
robust for json parser (#17687) 1 year ago
wlleiiwang 9d20561af4
create db if not exists (#17796)
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
1 year ago
Qun 0e136b42a2
enhance guessing mimetype of tool file (#17640) 1 year ago
-LAN- d3157b46ee
feat(large_language_model): Adds plugin-based token counting configuration option (#17706)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
1 year ago