Commit Graph

2523 Commits (2fed55ae6bf07957504d7da26ee3d8f8bc1bd5fb)

Author SHA1 Message Date
Charlie.Wei f6fecb957e
fix azure chatgpt o1 parameter error (#10067) 1 year ago
crazywoola 0a3d51e9cf
Revert "chore: improve validation and handler of logging timezone with TimezoneName" (#10077) 1 year ago
JasonVV 219f5d9845
Fixed the issue where recall the knowledge base in the iteration of the workflow and report errors when executing (#10060) 1 year ago
-LAN- 3b53e06e0d
fix(workflow): refine variable type checks in LLMNode (#10051) 1 year ago
zhuhao 92a3898540
fix: resolve the incorrect model name of hunyuan-standard-256k (#10052) 1 year ago
zhuhao 7433095240
chore: use dify_config.TIDB_SPEND_LIMIT instead of constant value (#10038) 1 year ago
郭伟伟 190b6a2aa6
feat: /conversations api response add 'update_at' field,and update api docs add sort_by parameter (#10043) 1 year ago
zhuhao 0095896051
feat: add YAML type in document extractor node (#9997) 1 year ago
Bowen Liang bab5c54219
chore: improve validation and handler of logging timezone with TimezoneName (#9595) 1 year ago
Jyong e74479717a
fix update_by_api batch field issue (#10001) 1 year ago
Jyong 9ebd453b87
add rerank check when doing mutil-retrieval (#9998) 1 year ago
ice yao 5ad5d0cff4
chore: Add aliyun oss tests (#10031) 1 year ago
非法操作 c7fb8a4f20
fix: conversation variable may not change in the answer node (#10034) 1 year ago
-LAN- eb87e690ed
fix(llm-node): handle NoneSegment variables properly (#9978) 1 year ago
Hiroshi Fujita 539fc8b760
Fix content-type header case sensitivity (#9961) 1 year ago
zhuhao c6e54c83c8
chore: add tidb-on-qdrant configuration in env and docker-compose file (#10015) 1 year ago
powerfool 878d13ef42
Added OceanBase as an option for the vector store in Dify (#10010) 1 year ago
Jyong 5580bcf870
add tidb spend limit config (#9999) 1 year ago
非法操作 12adcf8925
fix: gemini model use some tools raise error (#9993) 1 year ago
roadgoat19 c8ef9223e5
feat: couchbase integration (#6165)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Elliot Scribner <elliot.scribner@couchbase.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Bowen Liang <bowenliang@apache.org>
1 year ago
非法操作 eb69896355
fix: allow external knowledge api use simple host (#9966) 1 year ago
ice yao 61ff2fd0f3
chore: Enable tencent cos test to run (#9971) 1 year ago
Jyong f47177ecb4
add top_k for es full text search (#9963) 1 year ago
-LAN- de57af46c0
chore: update version to 0.10.2 in packaging and docker configurations (#9924) 1 year ago
Jyong badf9baf9b
Fix/external api update (#9955) 1 year ago
-LAN- 4da0b70694
feat(http-request-executor): enhance file handling in HTTP requests (#9944) 1 year ago
Xiao Ley 7056009b6a
feat(tools): add Baidu translation tool (#9943) 1 year ago
非法操作 ddb960ddfb
feat: support Vectorizer can be used in workflow (#9932) 1 year ago
方程 0ebd985672
feat: add models for gitee.ai (#9490) 1 year ago
Jyong af68084895
add document lock for multi-thread (#9873) 1 year ago
Joe 9633c5dab6
fix: enterprise create workspace (#9921) 1 year ago
zhuhao aa11141660
feat: add stable-diffusion-3-5-large for the text-to-image tool with siliconflow (#9909) 1 year ago
zhuhao 8bb5b943d7
fix(tools): remove the undefined variable parameter_type (#9908) 1 year ago
ice yao 22776f24ab
chore: Extract common functions of the base model in Azure OpenAI Provider (#9907) 1 year ago
Zixuan Cheng 216442ddc1
feat(workflow): Support JSON type in document extractor node (#9899)
Co-authored-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- dd3ac7a2c9
fix(api): add signature generation for image previews (#9893) 1 year ago
G81192 a17f169e01
fix users had already joined a workspace, but the system still first … (#9834)
Co-authored-by: yong.zhang <yong.zhang@yesno.com.cn>
1 year ago
-LAN- 72ea3d6b98
fix(workflow): Take back LLM streaming output after IF-ELSE (#9875) 1 year ago
virgosoy 17cacf258e
fix: wrong element object (#9868) 1 year ago
非法操作 ace7ffab5f
feat: support comfyui workflow tool image generate image (#9871) 1 year ago
zhuhao eec63b112f
chore: add default value for redis configuration (#9864) 1 year ago
Jyong caf7bc8569
upgrade nltk, unstructured and starlette (#9860) 1 year ago
yuanboao 4693080ce0
Marking the last piece of data on each page is a duplicate issue, which can be solved by adding the id field to the order by rig and using a unique field (#9799)
Signed-off-by: root <root@localhost.localdomain>
Co-authored-by: root <root@localhost.localdomain>
1 year ago
非法操作 1b5adf40da
fix: moonshot response_format raise error (#9847) 1 year ago
Jyong 18106a4fc6
add tidb on qdrant type (#9831)
Co-authored-by: Zhaofeng Miao <522856232@qq.com>
1 year ago
ice yao fc2297a2ca
chore: add local storage test (#9827) 1 year ago
crazywoola 5b7b765090
fix: yuque book id should be string (#9819) 1 year ago
郭伟伟 90769ac709
feat: create_empty_dataset api add the description parameter and update api docs (#9824) 1 year ago
非法操作 ac9f1e9de5
fix: duckduckgo image search not work (#9821) 1 year ago
zhuhao 5bf31e7a86
refactor: update load_stream method to directly yield file chunks (#9806) 1 year ago
-LAN- dd17506078
feat(api): add generic file size limit parameter (#9812) 1 year ago
非法操作 2346b0ab99
chore: make doc extractor node also can extract text by file extension (#9543) 1 year ago
Zixuan Cheng 88dec6ef2b
Added description for .ppt, specify the reason for unstructured.io (#9452)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
ice yao e71f494839
chore: abstract common function with local storage (#9811) 1 year ago
-LAN- 22bb0414a1
feat(parameters): standardize system parameter field types and values (#9797) 1 year ago
guogeer 70ddc0ce43
openai compatiable api usage and id (#9800)
Co-authored-by: jinqi.guo <jinqi.guo@ubtrobot.com>
1 year ago
-LAN- 9986e4c6d0
chore(docker): correct package version for expat and perl in Dockerfile (#9801) 1 year ago
非法操作 e2710161f6
fix: chart tool can't display chinese (#9686) 1 year ago
Jyong 5f11fe521d
remove unstructured pdf extract (#9794) 1 year ago
-LAN- d018b32d0b
fix(workflow): enhance prompt handling with vision support (#9790) 1 year ago
-LAN- e54b7cda3d
refactor(file_factory): improve filename and mime type determination (#9784) 1 year ago
Hash Brown 57ec12eb6b
feat: regenerate history switch navigation (#8749) 1 year ago
-LAN- 2c26f77a25
fix(api): handle missing upload_file_id for tool_file messages (#9756) 1 year ago
luckylhb90 400392230b
fixed: variable reference error (#9722)
Co-authored-by: hobo.l <hobo.l@binance.com>
1 year ago
Jyong 121bb99cc2
downgrade unstructured nltk version (#9726) 1 year ago
Jyong cac1ef7ade
remove ppt import (#9721) 1 year ago
-LAN- c6b28bc193
chore: update version to 0.10.1 (#9689) 1 year ago
zhuhao c9dfe1ad92
feat: support user-defined configuration of log file size and retention count (#9610) 1 year ago
-LAN- e11d5ac708
feat(model_runtime): add new model 'claude-3-5-sonnet-20241022' (#9708) 1 year ago
Jyong 3e9d271b52
nltk security issue and upgrade unstructured (#9558) 1 year ago
Pan, Wen-Ming ecc8beef3f
feat: added claude 3.5 sonnet v2 model to Google Cloud Vertex AI (#9688) 1 year ago
-LAN- 1b9bf9c62d
feat(api): add video and audio file size limits to upload config (#9703) 1 year ago
Joe ed96a6b6c0
fix: remove email code login redirect (#9698) 1 year ago
ybalbert001 4989d0c904
add bedrock claude 3.5 v2 support (#9685)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
1 year ago
-LAN- 9a5bdae07f
feat(condition): add support for 'exists' and 'not exists' operators (#9687) 1 year ago
-LAN- 67016feb96
feat(api): enhance file preview handling (#9674) 1 year ago
Joe 22bdfb7e56
Feat/optimize login (#9642) 1 year ago
ice yao ceb2c4f3ef
chore: reuse existing test functions with upstash vdb (#9679) 1 year ago
-LAN- d5a93a6400
fix(variable_pool): handle invalid attributes in variable lookup (#9646) 1 year ago
Zven 8e7a752b2a
feat: add upstash as a new vector database provider (#9644) 1 year ago
feiyang_deepnova 999d3f1539
fix: add downstream nodes of this branch (#9640) 1 year ago
Kota-Yamaguchi a7ee51e5d8
feat: add code generator (#9051)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
1 year ago
-LAN- 0e965b6529
chore(models): convert created_by_role to its value for consistency (#9612) 1 year ago
走在修行的大街上 a9db06f5e7
feat(Tools): Refactor the base table plugin (#9182)
Co-authored-by: 黎斌 <libin.23@bytedance.com>
1 year ago
-LAN- 5267f34e76
fix(segments): return empty string instead of "null" for text, log, and markdown properties (#9651) 1 year ago
-LAN- d6e8290a1c
fix(files): update Content-Length handling for tool and remote files (#9649) 1 year ago
-LAN- 36f66d40e5
refactor(api): simplify limit retrieval and return types (#9641) 1 year ago
非法操作 5f12616cb9
fix: file type document is not supported (#9618) 1 year ago
Joe bc43efba75
fix: remove url join (#9635) 1 year ago
-LAN- ef5f476cd6
fix(api): enhance file factory URL handling (#9631) 1 year ago
crazywoola 98bf7710e4
fix: fields.Nested(message_file_fields) (#9632) 1 year ago
-LAN- 7263af13ed
fix(http_request): simplify JSON handling in requests (#9616) 1 year ago
zhuhao d992a809f5
fix: update the default model to gpt-4o-mini for duckduckgo ai chat (#9614) 1 year ago
-LAN- e8abbe0623
fix(storage): ensure `storage_runner` initialization within app context (#9627) 1 year ago
-LAN- b14d59e977
fix(storage): use centralized config management (#9620) 1 year ago
-LAN- 5f12c17355
fix(core): use CreatedByRole enum for role consistency (#9607) 1 year ago
Bowen Liang d170d78530
chore: (#9089 followup) fix storage factory constructor (#9609) 1 year ago
Bowen Liang 4d9160ca9f
refactor: use dify_config to replace legacy usage of flask app's config (#9089) 1 year ago
-LAN- 8f670f31b8
refactor(variables): replace deprecated 'get_any' with 'get' method (#9584) 1 year ago
-LAN- 5838345f48
fix(entities): add validator for `VisionConfig` to handle None values (#9598) 1 year ago
Bowen Liang 3f1c84f65a
chore: cleanup ineffective linter rules exclusions (#9580) 1 year ago
zhuhao 83b2b8fe60
refactor: add logging extension module for log initialization (#9524) 1 year ago
-LAN- ac24300274
refactor(template_transform): use keyword-only arguments (#9575) 1 year ago
-LAN- 2e657b7b12
fix(workflow): handle NoneSegments in variable extraction (#9585) 1 year ago
-LAN- c063617553
fix(workflow): improve database session handling and variable management (#9581) 1 year ago
-LAN- 38a4f0234d
fix(http_request): handle empty and string data inputs (#9579) 1 year ago
-LAN- 740a723072
fix(validation): improve variable handling and validation (#9578) 1 year ago
Bowen Liang 495cf58014
dep: bump pydantic to 2.9 (#9077) 1 year ago
-LAN- 4ae0bb83f1
fix(file upload): correct upload method key for image config (#9568) 1 year ago
-LAN- 5459d812e7
fix(iteration): handle empty iterator gracefully (#9565) 1 year ago
-LAN- faad247d85
fix(upload): correct incorrect dictionary key usage (#9563) 1 year ago
ice yao 1e829ceaf3
chore: format get_customizable_model_schema return value (#9335) 1 year ago
AAEE86 9b32bfb3db
feat: Updata tongyi models (#9552) 1 year ago
Byron.wang 37fea072bc
enhance: use urllib join instead of fstring (#9549) 1 year ago
-LAN- ca21c285b0
chore: update version to 0.10.0 in packaging and docker configurations (#9534) 1 year ago
非法操作 a5777683f3
fix: when upload file response 3** will raise error (#9555) 1 year ago
Joe 90dd91c6cd
fix: TOKEN_EXPIRY_MINUTES (#9557) 1 year ago
-LAN- 8d8a8fe295
feat(file-upload): add support for optional file source parameter (#9554) 1 year ago
非法操作 f83ed19dfe
fix: list filter node some operator raise error (#9539) 1 year ago
非法操作 53b14bde4d
fix: list filter node url not work (#9540) 1 year ago
-LAN- b411a89703
fix(dockerfile): update libsqlite3 package version (#9530) 1 year ago
-LAN- e61752bd3a
feat/enhance the multi-modal support (#8818) 1 year ago
Joe 4fd2743efa
Feat/new login (#8120)
Co-authored-by: douxc <douxc512@gmail.com>
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
1 year ago
非法操作 853b0e84cc
fix: draft run workflow node with image will raise error (#9406) 1 year ago
chzphoenix 42fe208eda
refactor wenxin rerank (#9486)
Co-authored-by: cuihz <cuihz@knowbox.cn>
1 year ago
ice yao 95ce10f23b
feat: Add custom username and avatar define in discord tool (#9514) 1 year ago
Ziyu Huang 660fc3bb34
Resolve 9508 openai compatible rerank (#9511) 1 year ago
Zven a9fc85027d
chore: update the description for storage_type (#9492) 1 year ago
ice yao b2aa385942
feat: Add volcengine tos storage test (#9495) 1 year ago
Oliver Lee 424a7da470
add yuqye(https://www.yuque.com)tools (#8960)
Co-authored-by: 佐井 <chengwu.lcw@alibaba-inc.com>
1 year ago
Tao Wang b92504bebc
Added Llama 3.2 Vision Models Speech2Text Models for Groq (#9479) 1 year ago
zhuhao e0846792d2
feat: add yi custom llm intergration (#9482) 1 year ago
zhuhao b9bf60ea23
fix: resolve the error with the db-pool-stat endpoint (#9478) 1 year ago
Sergio Sacristán 28de676956
controller test (#9469) 1 year ago
zhuhao b3cde9900c
feat: add parameter top-k for the llm model provided by openrouter and siliconflow (#9455) 1 year ago
ice yao 2155bba5b0
fix: update mismatch vector type (#9462) 1 year ago
ice yao a53fdc7126
fix: add missing vector type to migrate command (#9470) 1 year ago
zhuhao 3fc0ebdd51
feat: add yi-lightning llm model for yi (#9458) 1 year ago
chzphoenix 211f416806
feat:add wenxin rerank (#9431)
Co-authored-by: cuihz <cuihz@knowbox.cn>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
zhuhao b90ad587c2
refactor: move the embedding to the rag module and abstract the rerank runner for extension (#9423) 1 year ago
zhuhao a45f8969a0
fix: remove the undefined variable line (#9446) 1 year ago
非法操作 d3c06a3f76
feat: add the workflow tool of comfyUI (#9447) 1 year ago
ybalbert001 fdcf87c70c
fix https://github.com/langgenius/dify/issues/9409 (#9433)
Co-authored-by: Yuanbo Li <ybalbert@amazon.com>
1 year ago
Jyong 5aabb83f5a
update dataset clean rule (#9426) 1 year ago
Jyong bd678f9ca1
add clean 7 days datasets (#9424) 1 year ago
zhuhao 86594851cb
refactor: update the default values of top-k parameter in vdb to be consistent (#9367) 1 year ago
Jyong 50635e9c15
Fix/economical knowledge retrieval (#9396) 1 year ago
zhuhao 7d3dad3d1d
feat: add timezone conversion for time tool (#9393) 1 year ago
ice yao dd22e78515
fix: Deprecated gemma2-9b model in Fireworks AI Provider (#9373) 1 year ago
crazywoola 423df67042
fix: use gpt-4o-mini for validating credentials (#9387) 1 year ago
ice yao 568d5c46ed
feat: Enable baiduvector intergration test (#9369) 1 year ago
非法操作 da25b91980
fix: remove the stream option of zhipu and gemini (#9319) 1 year ago
Jason Tan 9b8aa9b75d
feat: add minimax abab6.5t support (#9365) 1 year ago
非法操作 4ffaabcc04
feat: add glm-4-flashx, deprecated chatglm_turbo (#9357) 1 year ago
Warren Wong b597a0d31c
fix: Azure OpenAI o1 max_completion_token and get_num_token_from_messages error (#9326)
Co-authored-by: wwwc <wwwc@outlook.com>
1 year ago
Wei-shun Bao fb32e5ca9a
fix: In the output, the order of 'ta' is sometimes reversed as 'at'. #8015 (#8791) 1 year ago
zhuhao cd7ab6231f
refactor: Add an enumeration type and use the factory pattern to obtain the corresponding class (#9356) 1 year ago
ice yao 5908fd6552
Adapt input type parameter with MiniMax embedding model (#9342) 1 year ago
omr 6d2c6caa23
refactor: remove unnecessary 'closing' usage for boto3 client (#9343) 1 year ago
Bowen Liang 5eb00502ec
chore: clean-up unnecessary annotation on configs with non-null default value (#9323) 1 year ago
ice yao 3f9d6759d4
feat: Add qwen2.5 72B Instruct model in Fireworks AI (#9340) 1 year ago
ice yao aba70207ab
feat: Add fireworks custom llm intergration (#9333) 1 year ago
Bowen Liang a8134a49c4
fix: poetry installation in CI jobs (#9336) 1 year ago
Hash Brown fa47f0c707
chore: disable chat service API passing `parent_message_id` (#8984) 1 year ago
Summer-Gu 8501af298f
feat: added dataset recall testing API (#9300) 1 year ago
-LAN- 5c7b1358d4
chore(release): bump version to 0.9.2 (#9314) 1 year ago
-LAN- 7838f9f3a3
fix: Add new Milvus Lite wheel for manylinux2014_aarch64 (#9316) 1 year ago
zhuhao 7a405b86c9
refactor: Refactor the service of retrieval the recommend app (#9302) 1 year ago
非法操作 ffc3f33670
chore: remove the copied zhipu_ai sdk (#9270) 1 year ago
kurokobo 857055b797
fix: remove the latest message from the user that does not have any answer yet (#9297) 1 year ago
ice yao d15ba3939d
Add Volcengine VikingDB as new vector provider (#9287) 1 year ago
zhuhao d97d3ff5fc
chore: add abstract decorator and output log when query embedding fails (#9264) 1 year ago
-LAN- f73751843f
Feat/implement-refresh-tokens (#9233) 1 year ago
Shili Cao 2ec6ffe478
feat:support baidu vector db (#9185) 1 year ago
Garfield Dai c6b74daa0a
Fix/s3 iam add region name (#7819) 1 year ago
takatost 23ce1fb1ba
chore: optimize the trace ops slow queries on node executions. (#9282) 1 year ago
takatost 29188e0562
chore: use cache instead of re-querying node record during workflow execution (#9280) 1 year ago
zhuhao d9773c963f
chore: fix the misclassification of the opensearch-py package (#9266) 1 year ago
crazywoola 93af87a9e0
fix: move exception to debug mode (#9258) 1 year ago
zhuhao 7a6970e570
feat: add supabase object storage (#9229) 1 year ago
Jyong 42b02b3a5f
Fix/agent external knowledge retrieval (#9241) 1 year ago
AkisAya d7b8e071dd
fix:#9222 create or update custum tools error (#9228) 1 year ago
Bowen Liang 7c6ae96a09
chore: check all dependencies groups in pyproject.toml (#9224) 1 year ago
Jyong 80b62d50f5
Fix/add es num_candidates (#9225) 1 year ago
zxhlyh d498f4e55e
Chore/model icon url (#9218)
Co-authored-by: takatost <takatost@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
1 year ago
AAEE86 fe41e8bc18
feat: add siliconflow custom add model interface (#8745) 1 year ago
Joe 1e7ef46e9c
fix: update inner api proxies (#9174) 1 year ago
crazywoola e0c8189f1a
feat: add NotFound error for dataset service (#9215) 1 year ago
Fei He 5c76131d3d
feat: add gte rerank for tongyi (#9153) 1 year ago
Jyong cabdb4ef17
fix retrieval resource positon missed (#9155)
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
1 year ago
zhuhao 05c1ef75c4
feat: add allow_llm_to_see_data flag for vanna (#9156) 1 year ago
Xiaoguang Sun be2f1e59f2
improve: Refresh updated_at field of DataSourceOauthBinding model (#9173)
Signed-off-by: Xiaoguang Sun <sunxiaoguang@gmail.com>
1 year ago
Sa Zhang 75f0a5e36a
fix: Typo Correction in jina.yaml (#9161) 1 year ago
Jyong 68107fe355
downgrade elastic to 8.14 (#9171) 1 year ago
takatost 477beae3bb
fix: missing usage of metadata in the chatflow app (#9167) 1 year ago
Charlie.Wei 6b6e94da08
Fix code indentation errors (#9164) 1 year ago
Ziyu Huang fc60b554a1
Fixes #9159: Modify to make it works to llama.cpp rerank API (#9160) 1 year ago
Joe e947103b6d
Feat/add workflow sys params (#9108)
Co-authored-by: Joel <iamjoel007@gmail.com>
1 year ago
ronaksingh27 62051d5171
Corrected type annotation to "Any" from "any" all files in "model_providers" folder (#9135) 1 year ago
luckylhb90 2024a6c941
fix: vertex ai remote url error(Error: not enough values to unpack) (#9134)
Co-authored-by: hobo.l <hobo.l@binance.com>
1 year ago