Commit Graph

4130 Commits (deploy/rag-dev)

Author SHA1 Message Date
jyong 384073f025 r2 transform 7 months ago
jyong 2012ea3213 r2 transform 7 months ago
NeatGuyCoding 7bf3d2c8bf
fix(api): Fix potential thread leak in MCP `BaseSession` (#22169)
The `BaseSession` class in the `core/mcp/session` package uses `ThreadPoolExecutor` 
to run the receive loop but fails to properly clean up the executor and receiver 
future, leading to potential thread leaks.

This PR addresses this issue by:
- Initializing `_executor` and `_receiver_future` attributes to `None` for proper cleanup checks
- Adding graceful shutdown with a 5-second timeout in the `__exit__` method
- Ensuring the ThreadPoolExecutor is properly shut down to prevent resource leaks

This fix prevents memory leaks and hanging threads in long-running scenarios where 
multiple MCP sessions are created and destroyed.

Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
7 months ago
Jacky Wu da53bf511f
chore: add SQLALCHEMY_POOL_USE_LIFO option and missing SQLALCHEMY_POOL_PRE_PING env default value. (#22371) 7 months ago
jyong 1ad73ccdc8 r2 7 months ago
jyong 96484731a2 r2 7 months ago
quicksand 14f79ee652
fix: create api workflow run repository error (#22422) 7 months ago
-LAN- df89629e04
fix: conversatino statistic including data from debugger (#22412)
Signed-off-by: -LAN- <laipz8200@outlook.com>
7 months ago
jyong 537e535d9a r2 7 months ago
jyong 3a3b60bab5 r2 7 months ago
Hao Cheng 32c541a9ed
fix: generate deterministic operationId for root endpoints without one (#19888) 7 months ago
quicksand 5247c19498
fix: code result included "error" field (#22392) 7 months ago
湛露先生 9823edd3a2
fix workflow node iterator . (#21008)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
7 months ago
homejim 8e910d8c59
fix(plugin): introduce response_type parameter in plugin list API to enable paginated response support (#22251) 7 months ago
wanttobeamaster bf7b2c339b
tablestore vector support more method (#22225)
Co-authored-by: xiaozhiqing.xzq <xiaozhiqing.xzq@alibaba-inc.com>
7 months ago
quicksand ebb88bbe0b
improve opik workflow_trace span name to node name (#22356) 7 months ago
jyong 63111e8050 r2 7 months ago
jyong a919e3e135 r2 7 months ago
jyong 4b9a5a66c1 r2 7 months ago
Jacky Wu 3e96c0c468
fix: close session before doing long latency operation (#22306) 7 months ago
-LAN- 6eb155ae69
feat(api/repo): Allow to config repository implementation (#21458)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
7 months ago
jyong 928751a856 r2 7 months ago
twwu 682b65034c Merge branch 'main' into feat/rag-2 7 months ago
Novice 1d54ffcf89
fix: error parsing object type parameters for code node (#22230) 7 months ago
Jason Young 27e5e2745b
test: add comprehensive unit tests for login decorator (#22294) 7 months ago
znn 1b26f9a4c6
fixing Enum part in backend and making it same as front end (#22296) 7 months ago
Bowen Liang e7388779a1
chore: bump ruff to 0.12.x (#22259) 7 months ago
NeatGuyCoding 6c233e05a9
minor fix: wrong and (#22242) 7 months ago
NeatGuyCoding 9f013f7644
Add unit test for account service (#22278) 7 months ago
Jason Young 253d8e5a5f
test: add comprehensive unit tests for PassportService with exception handling optimization (#22268) 7 months ago
jyong 9c4356e9a1 r2 7 months ago
jyong 3b70f8ac08 r2 7 months ago
Garden12138 2a85f28963
fix:Fixed the problem of plugin installation failure caused by incons… (#22156) 7 months ago
K d5624ba671
fix: resolve Docker file URL networking issue for plugins (#21334) (#21382)
Co-authored-by: crazywoola <427733928@qq.com>
7 months ago
诗浓 e576b989b8
feat(tool): add support for API key authentication via query parameter (#21656) 7 months ago
NeatGuyCoding f929bfb94c
minor fix: remove duplicates, fix typo, and add restriction for get mcp server (#22170)
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
7 months ago
诗浓 f4df80e093
fix(custom_tool): omit optional parameters instead of setting them to None (#22171) 7 months ago
Maries 390e4cc0bf
chore(version): bump to 1.6.0 (#22136) 7 months ago
Novice 0e793a660d
fix: add the default value to the dark icon (#22149) 7 months ago
非法操作 7b2cab5767
feat: support ping method for MCP server (#22144) 7 months ago
Yeuoly 94a13d7d62
feat: add support for dark icons in provider and tool entities (#22081) 7 months ago
湛露先生 edf5fd28c9
update worklow events logs. (#19871)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
7 months ago
Novice 535fff62f3
feat: add MCP support (#20716)
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
7 months ago
baonudesifeizhai 18b58424ec
Fix: Resolve issue with json_output (#22053) 7 months ago
Yongtao Huang 10858ea1dc
Chore: rm useless import and vars (#22108) 7 months ago
NeatGuyCoding 6f8c7a66c8
feat: add redis fallback mechanism #21043 (#21044)
Co-authored-by: tech <cto@sb>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
7 months ago
luckylhb90 a371390d6c
optimize: batch embedding and qdrant write_consistency_factor parameter (#21776)
Co-authored-by: hobo.l <hobo.l@binance.com>
7 months ago
twwu e2a141b3bb Merge branch 'main' into feat/rag-2 7 months ago
Jason Young 881a151d30
test: add comprehensive unit tests for encrypter module (#22102) 7 months ago
wangsen3 b237113311
Update clean_document_task.py (#22090) 7 months ago
jyong 8b97551f1a r2 7 months ago
-LAN- 4cb50f1809
feat(libs): Introduce `extract_tenant_id` (#22086)
Signed-off-by: -LAN- <laipz8200@outlook.com>
7 months ago
jyong bd33b9ffec r2 7 months ago
jyong b538eee5dd r2 7 months ago
twwu 258c965bd0 Merge branch 'feat/rag-2' of https://github.com/langgenius/dify into feat/rag-2 7 months ago
twwu 9e44f2b805 Merge branch 'main' into feat/rag-2 7 months ago
wlleiiwang 89b52471fb
Optimize the memory usage of Tencent Vector Database (#22079)
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
7 months ago
jyong 9dcba51225 r2 7 months ago
Minamiyama 3643ed1014
Feat: description field for env variables (#21556) 7 months ago
jyong b5e4ce6c68 r2 7 months ago
Yongtao Huang 521488f926
Remove tow unused files (#22022) 7 months ago
Jason Young d61ea5a2de
test: add comprehensive unit tests for UrlSigner (#22030) 7 months ago
Davide Delbianco 816210d744
Expose LLM usage in workflows (#21766)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
7 months ago
jyong bc1a517a97 r2 7 months ago
jyong db886ae3fb r2 7 months ago
Jason Young 5c0cb7f912
test: add unit tests for password validation and hashing (#22003) 7 months ago
NeatGuyCoding 2ffbf5435d
minro fix: fix duplicate local import of ToolProviderType (#22013)
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
7 months ago
NeatGuyCoding 53c4912cbb
feat: add unit tests and validation for aliyun tracing (#22012)
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
7 months ago
NeatGuyCoding 1760179093
minro fix: fix a typo for aliyun (#22001)
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
7 months ago
Yongtao Huang de54f8d0ef
Chore: remove unreachable code (#21986) 7 months ago
quicksand 5b0b64c7e5
fix: document delete image files check file exist (#21991) 7 months ago
-LAN- 8f723697ef
refactor(graph_engine): Take GraphRuntimeState out of GraphEngine (#21882) 7 months ago
baonudesifeizhai b9f56852dc
fix: resolve JSON.parse precision issue causing 'list index out of ra… (#21253) 7 months ago
baonudesifeizhai 108cc3486f
fix(agent): show agent run steps, fixes #21718 (#21945)
Co-authored-by: crazywoola <427733928@qq.com>
7 months ago
NeatGuyCoding ac69b8b191
refactor: extract common url validator for config_entity.py (#21934)
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
7 months ago
heyszt a201e9faee
feat: Add Aliyun LLM Observability Integration (#21471) 7 months ago
jyong 1fb59adba9 r2 7 months ago
jyong 9c6eb95700 r2 7 months ago
jyong a8b676ade0 r2 7 months ago
NeatGuyCoding 2639f950cc
minor fix: removes the duplicated handling logic for TracingProviderEnum.ARIZE and TracingProviderEnum.PHOENIX from the OpsTraceProviderConfigMap (#21927)
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
7 months ago
Bowen Liang 6663187eca
test:add unit test for api version config (#21919) 7 months ago
Ganondorf c9c49200e0
use repair_json fix json parse error of HTTPRequestNode (#21909)
Co-authored-by: lizb <lizb@sugon.com>
7 months ago
jyong 44c2efcfe4 r2 7 months ago
非法操作 a79f37b686
fix: tts tool must choose a voice (#21877) 7 months ago
baonudesifeizhai 1c7404099d
fix: prevent timeout in file encoding detection for large files (#21453)
Co-authored-by: crazywoola <427733928@qq.com>
7 months ago
jyong 798d0880d6 r2 7 months ago
cutiechi 47954aa284
feat(api): validate and reject external datasets in document update (#21783) 7 months ago
Novice f3c8625fe2
fix: The statistics page cannot display the tokens consumed by agent node (#21861) 7 months ago
jyong 76c418c0b7 r2 7 months ago
NeatGuyCoding ebc4fdc4b2
moving the `MessageStatus` class from the `models.model` module to `models.enums` module (#21867)
Signed-off-by: neatguycoding <15627489+NeatGuyCoding@users.noreply.github.com>
7 months ago
Ali Saleh 1af3d40c1a
feat: Improve Observability with Arize & Phoenix Integration (#19840)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: Gu <guchenhe@gmail.com>
7 months ago
jiangbo721 31eb8548ef
fix: Before publish the app, preview the voice of tts, it raise an er… (#21821)
Co-authored-by: 刘江波 <jiangbo721@163.com>
7 months ago
Yeuoly 980b0188d2
feat(tests): add structured output parser tests for LLM responses (#21838) 7 months ago
jiangbo721 e17b33e004
chore: add message status enum (#21825)
Co-authored-by: 刘江波 <jiangbo721@163.com>
7 months ago
Yeuoly 5487463385
fix: add list contents handling in structured LLM output (#21837) 7 months ago
jyong 38d895ab5f r2 7 months ago
jyong a6ff9b224b r2 7 months ago
jyong 832bef053f Merge branch 'main' into feat/r2
# Conflicts:
#	docker/docker-compose.middleware.yaml
#	web/app/components/workflow-app/components/workflow-main.tsx
#	web/app/components/workflow-app/hooks/index.ts
#	web/app/components/workflow/hooks-store/store.ts
#	web/app/components/workflow/hooks/index.ts
#	web/app/components/workflow/nodes/_base/components/variable/var-reference-picker.tsx
7 months ago
jyong 81b07dc3be r2 7 months ago
Bowen Liang cc89d7b1a5
remove unused config CURRENT_VERSION (#21832)
as API module's version code refactored into pyproject.toml file in refactor: define the Dify project version in pyproject.toml #20910, the deprecated CURRENT_VERSION is no longger used and should be removed.
7 months ago
-LAN- bb955806e0
chore(version): bump to 1.5.1 (#21808)
Signed-off-by: -LAN- <laipz8200@outlook.com>
7 months ago
efrey kong 826bf25abf
Fix: prevent SQL errors when metadata filter Constant value is None or blank (#21803) 7 months ago
jyong e23d7e39ec Merge branch 'feat/datasource' into feat/r2
# Conflicts:
#	api/services/rag_pipeline/rag_pipeline.py
#	web/app/components/workflow/constants.ts
#	web/app/components/workflow/header/run-and-history.tsx
#	web/app/components/workflow/hooks/use-nodes-interactions.ts
#	web/app/components/workflow/hooks/use-workflow-interactions.ts
#	web/app/components/workflow/hooks/use-workflow.ts
#	web/app/components/workflow/index.tsx
#	web/app/components/workflow/nodes/_base/components/panel-operator/panel-operator-popup.tsx
#	web/app/components/workflow/nodes/_base/panel.tsx
#	web/app/components/workflow/nodes/code/use-config.ts
#	web/app/components/workflow/nodes/llm/default.ts
#	web/app/components/workflow/panel/index.tsx
#	web/app/components/workflow/panel/version-history-panel/index.tsx
#	web/app/components/workflow/store/workflow/index.ts
#	web/app/components/workflow/types.ts
#	web/config/index.ts
#	web/types/workflow.ts
7 months ago
QuantumGhost 89250a36b7
fix(api): files not returned in the answer node (#21807) 7 months ago
QuantumGhost c2e599cd85
fix(api): Fix resetting sys var causing internal server error (#21604)
and sorts draft variables by their creation time, ensures a consist order.
7 months ago
jiangbo721 71d6cf1b1d
fix: Make the latency and logs of web applications consistent. (#21578)
Co-authored-by: 刘江波 <jiangbo721@163.com>
7 months ago
jyong 9f14b5db9a r2 7 months ago
jyong 39d3f58082 r2 7 months ago
Davide Delbianco c4b960cc1a
Improve Langfuse trace readability (#21777) 7 months ago
NeatGuyCoding a82943a83d
minor fix: add parameters in error msg of Plugin service returned no options (#21662) 7 months ago
jiangbo721 9a4c1fe834
fix: if parameter is not required, continue (#21761)
Co-authored-by: 刘江波 <jiangbo721@163.com>
7 months ago
Bowen Liang b9ff716c18
fix: incorrect api module version in pyproject.toml (#21755)
Co-authored-by: crazywoola <427733928@qq.com>
7 months ago
baonudesifeizhai 8516d15a4e
fix: handle configure button for notion internal integration (#21412) 7 months ago
quicksand 4198a533ad
fix: code Interpreter error handling not work (#21736) 7 months ago
jyong f33b6c0c73 add online drive 7 months ago
jyong a4eddd7dc2 r2 7 months ago
jyong c993a05da7 Merge remote-tracking branch 'origin/feat/r2' into feat/r2 7 months ago
jyong f44f0fa34c r2 7 months ago
Dongyu Li bfcf09b684 feat(datasource): fix datasource icon 7 months ago
Bowen Liang 1a7ad195f0
refactor: define the Dify project version in pyproject.toml (#20910) 7 months ago
Qiang Lee cf2173644e
Release db.session connection before workflow new thread long time operation (#21726)
Co-authored-by: 李强04 <liqiang04@gaotu.cn>
7 months ago
Dongyu Li cdbba1400c feat(datasource): update fetch_datasource_provider 7 months ago
YoungLH b8b9c3a783
fix: set the func.coalesce() second paramter default value #21239 (#21240)
Signed-off-by: YoungLH <974840768@qq.com>
7 months ago
Han 69b6f6f5d2
Fixes issue 21157/20661 extra quote in agent node (#21674)
Co-authored-by: Wang Han <wanghan@zhejianglab.org>
7 months ago
Qiang Lee 9ded6f6a40
[fix] #21678 User input of remote file link on the run page form causes conversation/message interface error (#21683)
Co-authored-by: 李强04 <liqiang04@gaotu.cn>
7 months ago
Ganondorf 55a6b330ec
Add get document detail service api (#21700)
Co-authored-by: lizb <lizb@sugon.com>
7 months ago
jyong 618ad4c291 r2 7 months ago
Harry 1449ed86c4 feat: rename online driver to online drive and update related classes and methods :) 7 months ago
Xin Zhang 37e19de7ab
feat(inner-api/workspace): include tenant details in CreateWorkspace response (#21636) 7 months ago
湛露先生 28f5c37211
Add Env 'CELERY_SENTINEL_PASSWORD' for celery connect redis sentinel. (#21198) 7 months ago
Harry eee72101f4 feat(online_driver): add online driver plugin, support browsing and downloading 7 months ago
Yeuoly 87efe45240
feat(plugin): Add API endpoint for invoking LLM with structured output (#21624) 7 months ago
Yeuoly 0cb00d5fd2
refactor: move structured output support outside LLM Node (#21565)
Co-authored-by: Novice <novice12185727@gmail.com>
7 months ago
wanttobeamaster cdb9eecbaf
fix: Resolving conflicts caused by tablestore dependency on enum34 (#21605)
Co-authored-by: xiaozhiqing.xzq <xiaozhiqing.xzq@alibaba-inc.com>
7 months ago
Khoa a06af88b26
Feat/api validate model provider (#21582)
Co-authored-by: crazywoola <427733928@qq.com>
7 months ago
NeatGuyCoding 33f0457a23
fix: wrong token number when using qa_model and answer is updated. (#21574) 7 months ago
Yeuoly cea6522122
feat: add DYNAMIC_SELECT parameter type for dynamic options in parameter entities (#21425) 7 months ago
jiangbo721 cefb8e4218
chore: Simplify code logic (#21496)
Co-authored-by: 刘江波 <jiangbo721@163.com>
7 months ago
jiangbo721 90aba77471
chore: remove unused code (#21497)
Co-authored-by: 刘江波 <jiangbo721@163.com>
7 months ago
NeatGuyCoding 785d4b3de7
feat: refactor: test_dataset unit tests #21499 (#21502) 7 months ago
NeatGuyCoding 6bb82f8ee0
Fix minor comment missing (#21517) 7 months ago
Xiyuan Chen d454f09e13
feat: add a magic field in the cancel invite api response (#21505) 7 months ago
Dongyu Li 00f0b569cc
Feat/kb index (#20868)
Co-authored-by: twwu <twwu@dify.ai>
7 months ago
jyong efccbe4039 r2 7 months ago
-LAN- 3acaa59885
fix(update_provider_when_message_created): Fix db transaction (#21503)
Signed-off-by: -LAN- <laipz8200@outlook.com>
7 months ago
-LAN- 2d5cdbe79c
chore(version): Bump to 1.5.0 (#21415)
Signed-off-by: -LAN- <laipz8200@outlook.com>
7 months ago
-LAN- 8f15341f1e
fix(event_handlers): DB dead lock (#21468)
Signed-off-by: -LAN- <laipz8200@outlook.com>
7 months ago
Maries 1dd2607dfd
feat(oauth): refactor proxy context (#21483) 7 months ago
jyong 540096a8d8 Merge branch 'main' into feat/r2
# Conflicts:
#	api/core/plugin/impl/oauth.py
#	api/core/workflow/entities/variable_pool.py
#	api/models/workflow.py
#	api/services/dataset_service.py
7 months ago
Maries 164e5481c5
feat(oauth): plugin oauth service (#21480) 7 months ago