Commit Graph

4130 Commits (deploy/rag-dev)

Author SHA1 Message Date
Ganondorf e99861d4fe
Add Filter of Get Workflow Logs (#21172)
Co-authored-by: lizb <lizb@sugon.com>
10 months ago
NeatGuyCoding 9835730278
Translation fix (#21194) 10 months ago
湛露先生 8331b63baa
add func args missing in apps chat. (#21085)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
10 months ago
NeatGuyCoding 2eae7503e1
Minor Improvements for File Validation and Configuration Handling #21179 (#21171)
Co-authored-by: tech <cto@sb>
10 months ago
jyong 643efc5d85 Merge branch 'feat/r2' into deploy/rag-dev 10 months ago
Dongyu Li 43e5798e13 feat(datasource): change datasource result type to event-stream 10 months ago
Xin Zhang 30cfc9c172
Feat/plugin install scope management (#19963) 10 months ago
NeatGuyCoding 918bb9a2f7
bug: fix sequence number may be duplicated when multi-threads running the same workflow #21047 (#21153) 10 months ago
Dongyu Li 2cf980026e feat(datasource): change datasource result type to event-stream 10 months ago
Dongyu Li 224111081b feat(datasource): change datasource result type to event-stream 10 months ago
jyong 6f67a34349 r2 qa index 10 months ago
Ademílson Tonato 9e73e8b9e8
feat: add search endpoint for Firecrawl Integration (#20521)
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
HyaCinth d4be356ffb
fix(api): add support for "image" icon when duplicate app (#20744) (#20761) 10 months ago
Rain Wang 47e0f92c0f
Fixes #20748 KnowledgeRetrievalNode return all external documents when reranker disabled even top-k configed (#20762) 10 months ago
湛露先生 6d033d4064
clean duplicate validate for dataset_configs (#20775)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
10 months ago
湛露先生 ab290ed968
unreachable-code for lb model fetch. (#20797)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
10 months ago
-LAN- 879f839d75
refactor(graph_engine): Merge duplicated if block (#20784)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Jyong 787a556bd7
add service api ratelimit check (#20878) 10 months ago
He Wang 37f26c412f
add healthcheck to oceanbase container (#20989) 10 months ago
zxhlyh e51d308312 Merge branch 'feat/rag-pipeline' into deploy/rag-dev 10 months ago
kazuya-awano 45c89bd6de
feat: add pagenation to notion extractor (#20919) 10 months ago
jyong ac917bb56d r2 10 months ago
jyong f7a4e5d1a6 Merge branch 'main' into feat/r2 10 months ago
NeatGuyCoding 61526c027d
[Bug] fix misusing ACCESS_TOKEN_EXPIRE_MINUTES in jwt on exp (#21030)
Co-authored-by: tech <cto@sb>
10 months ago
kurokobo 4689e8953e
fix: shorten connection timeout to pypi.org for deprecation check for weaviate client (#21131) 10 months ago
jyong 66de2e1f0a Merge remote-tracking branch 'origin/feat/r2' into feat/r2
# Conflicts:
#	api/core/workflow/graph_engine/entities/event.py
#	api/services/rag_pipeline/rag_pipeline.py
10 months ago
jyong 7f7ea92a45 r2 10 months ago
Dongyu Li cf66d111ba feat(datasource): change datasource result type to event-stream 10 months ago
Dongyu Li 739ebf2117 feat(datasource): change datasource result type to event-stream 10 months ago
jyong 7c41f71248 r2 10 months ago
W_OOD 0476937f55
fix(agent_node):Fix spelling errors. (#21094) 10 months ago
-LAN- 0dcacdf83d
feat: add a flask_context_manager. (#21061)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 1d2ee9020c r2 10 months ago
Dongyu Li f37e28a368 feat(datasource): Comment out the datasource_file_manager. 10 months ago
Dongyu Li c5976f5a09 feat(datasource): change datasource result type to event-stream 10 months ago
-LAN- 2440ac43b1
fix: Replace GenericProviderID with ToolProviderID (#21064)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 809a0ab6bf
chore: bump version to 1.4.3 (#21045)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong b277acc298 Merge branch 'main' into feat/r2 10 months ago
jyong 8d47d8ce4f Merge remote-tracking branch 'origin/feat/r2' into feat/r2
# Conflicts:
#	api/core/datasource/website_crawl/website_crawl_plugin.py
#	api/services/rag_pipeline/rag_pipeline.py
10 months ago
jyong 41fef8a21f r2 10 months ago
yihong 909259da37
fix: delete some dead code using vulture (#20999)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
10 months ago
Bowen Liang 366ddb05ae
test: run vdb test of oceanbase with docker compose in CI tests (#20945) 10 months ago
徐海兴 f6aa2498a3
document indexing not bound to a Session (#21015)
Co-authored-by: xuhaixing <xuhaixing@itiger.com>
10 months ago
Harry 5ccb8d9736 feat: online document 10 months ago
Harry 0908f310fc feat: webcrawl 10 months ago
quicksand 3a628bc671
chore: app info add author_name (#20973) 10 months ago
sayThQ199 175571e740
fix(auth): Clear login rate limit after password reset (#20948) 10 months ago
jyong b2b95412b9 r2 10 months ago
-LAN- c05e47ebc0
refactor(sqlalchemy_workflow_execution_repository): Use the max funtion for getting next_sequence_number. (#20966) 10 months ago
Takuya Ono af83120832
🐛 Fix(Gemini LLM): Support Gemini 0.2.x plugin on agent app (#20794)
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
10 months ago
-LAN- 1e03c97663
fix(llm_node): missing parameters for structure outputs (#20915)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong da3a3ce165 r2 10 months ago
jyong 14dc3e8642 r2 10 months ago
jyong 9eb8597957 r2 10 months ago
jyong 1d8b390584 Merge branch 'main' into feat/r2
# Conflicts:
#	docker/docker-compose.middleware.yaml
10 months ago
jyong 5f08a9314c r2 10 months ago
湛露先生 41e3ecc837
fix remote ip header CF-Connecting-IP (#20846) 10 months ago
jyong 66fa68fa18 r2 10 months ago
-LAN- acb2488fc8
chore(package): Bump version to 1.4.2 (#20897)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Yeuoly d6d8cca053
refactor: replace compact response generation with length-prefixed response for backwards invocation api (#20903) 10 months ago
jyong a6f7560d2f r2 10 months ago
jyong 874e1bc41d r2 10 months ago
jyong 2972a06f16 r2 10 months ago
Bowen Liang 0f3d4d0b6e
chore: bump mypy to 1.16 (#20608) 10 months ago
jyong 127a77d807 r2 10 months ago
jyong 95a24156de r2 10 months ago
jyong e934503fa0 r2 10 months ago
jyong 80b219707e r2 10 months ago
Jyong 21a50e22d2
fix auto metadata filter (#20845) 10 months ago
jyong 58b5daeef3 r2 10 months ago
jyong a7ff2ab470 r2 10 months ago
jyong 4d967544f3 r2 10 months ago
QuantumGhost c439e82038
refactor(api): Decouple `ParameterExtractorNode` from `LLMNode` (#20843)
- Extract methods used by `ParameterExtractorNode` from `LLMNode` into a separate file.
- Convert `ParameterExtractorNode` into a subclass of `BaseNode`.
- Refactor code referencing the extracted methods to ensure functionality and clarity.
- Fixes the issue that `ParameterExtractorNode` returns error when executed.
- Fix relevant test cases.

Closes #20840.
10 months ago
jyong 65873aa411 r2 10 months ago
jyong c0d3452494 r2 10 months ago
jyong ad3d9cf782 r2 10 months ago
QuantumGhost a97ff587d2
fix(api): Resolve error encountered when executing `QuestionClassifieNode` (#20829)
The `QuestionClassifierNode` class extends `LLMNode`, meaning that, per the Liskov Substitution Principle, `QuestionClassifierNodeData` **SHOULD** be compatible in contexts where `LLMNodeData` is expected.

However, the absence of the `structured_output_enabled` attribute violates this principle, causing `QuestionClassifierNode` to fail during execution.

This commit implements a quick and temporary workaround. A proper resolution would involve refactoring to decouple `QuestionClassifierNode` from `LLMNode` to address the underlying design issue.

Fixes #20725.
10 months ago
Xiyuan Chen 0720bc7408
Feat/webapp verified sso main (#20494) 10 months ago
jyong 47664f8fd3 r2 10 months ago
yihong 65c7c01d90
fix: clean up two unreachable code (#20773)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
10 months ago
Bharat Ramanathan e6e76852d5
Add support for W&B dedicated cloud instances in Weave tracing integration (#20765)
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
QuantumGhost 930c4cb609
feat(api): Adjust `WorkflowDraftVariable` and `WorkflowNodeExecutionModel` (#20746)
- Add `node_execution_id` column to `WorkflowDraftVariable`, allowing efficient implementation of 
  the "Reset to last run value" feature.
- Add additional index for `WorkflowNodeExecutionModel` to improve the performance of last run lookup.

Closes #20745.
10 months ago
jyong fcbd5febeb r2 10 months ago
jyong 21a3509bef r2 10 months ago
jefferyvvv 37c3283450
fix: opensearch vector search falls back to keyword search (#20723)
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
10 months ago
jyong 1aa13bd20d r2 10 months ago
jyong d2d5fc62ae r2 10 months ago
jyong 0ca38d8215 r2 10 months ago
jyong d2750f1a02 r2 10 months ago
Bowen Liang c1a13fa553
chore: replace pseudo-random generators with secrets module (#20616) 10 months ago
jyong 70432952fd r2 10 months ago
jefferyvvv 4271602cfc
fix: opensearch metadata filtering returns empty (#20701)
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
Bowen Liang 4f14d7c0ca
chore: bump uv to 0.7.x (#20692) 10 months ago
Yeuoly 38554c5f3e
fix(inner_api/plugin/wraps): refresh user model after creation in get user function (#20704) 10 months ago
jefferyvvv 138ad6e8b3
fix: opensearch fulltext search with metadata filtering dsl error (#20702)
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
10 months ago
湛露先生 f76f70f0b6
Fix builtin_providers for tools. (#20697)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
10 months ago
jyong b8ef1d9585 r2 10 months ago
jyong c084b57933 r2 10 months ago
HaiyangP 3fb9b41fe5
A more concise and effective extractor for excel and csv files (#20625)
Co-authored-by: haiyangpengai <xxxx>
10 months ago
jyong 9e84a5321d r2 10 months ago
jyong 8a86a2c817 r2 10 months ago
jyong 3e0a10b7ed r2 10 months ago
jyong 5fe5da7c1d r2 10 months ago
Eric Guo 822298f69d
Fix 500 error (#20614) 10 months ago
Arcaner ad2f25875e
fix(llm_node): update file variable mapping to use vision configs (#20417) 10 months ago
Abdullah AlOsaimi ad8e79c440
assign dataset indexing_technique to args if not explicitly provided (#20597) 10 months ago
-LAN- 5ccfb1f4ba
refactor: Improve model status handling and structured output (#20586)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Dongyu Li 92614765ff
Feat/queue monitor (#20647) 10 months ago
jyong fbca9010f3 r2 10 months ago
jyong 8a147a00e8 r2 10 months ago
jyong a82ab1d152 r2 10 months ago
jyong 133193e7d0 r2 10 months ago
jyong c09c8c6e5b r2 10 months ago
Abdullah AlOsaimi 006496f24e
raise error when process_rule is required but missing (#20599) 10 months ago
kenwoodjw 01d500db14
fix: autocorrect everything in web (#20605)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
10 months ago
Novice 4ac3600f81
fix: update app tag error (#20618) 10 months ago
jyong abcca11479 r2 10 months ago
jyong 9cdd2cbb27 r2 10 months ago
jyong 309fffd1e4 Merge branch 'main' into feat/r2
# Conflicts:
#	api/core/repositories/sqlalchemy_workflow_node_execution_repository.py
#	api/core/workflow/entities/node_entities.py
#	api/core/workflow/enums.py
10 months ago
-LAN- 275e86a26c
refactor: Removes tenant ID check from rate limit logic (#20585)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 4130c50643 r2 10 months ago
非法操作 ca0b268ae5
fix: variable aggregator with group and file raise exception (#20581) 10 months ago
jyong 7b7f8ef51d r2 10 months ago
Bowen Liang 888cd86afd
chore: prepare the plugin daemon base url to yarl URL ahead intstead of in every invocation (#20541) 10 months ago
jyong 573cd15e77 r2 10 months ago
jyong ab1730bbaa r2 10 months ago
Anshuman Saini e40e9db39a
fixes #19634 (#20545) 10 months ago
-LAN- 36f1b4b222
fix: Ensure model config integrity in retrieval processes (#20576)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 257bf13fef
refactor: Removes unused LLMMode value_of method (#20575)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 957f5b212e
fix: Upgrade Flask-Cors (#20577)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 72fdafc180
refactor: Replaces direct DB session usage with context managers (#20569)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 270edd43ab r2 10 months ago
jyong b8f3b23b1a r2 10 months ago
jyong 0486aa3445 r2 10 months ago
zhaobingshuang 3f7aa38d77
fix: #20560 When elasticsearch is used as the vector database, the Retrieval Test fails to filter the data after setting the Score Threshold, and the score of the recalled results is empty (#20561) 10 months ago
Contrail a145c2a8fe
fix: ensure proper conversation role alternation for vLLM (#18837) 10 months ago
不如归去 c29cb503be
Fix #20536: Force header in custom tool be string (#20537)
Co-authored-by: Peter Xin <iami@Artemis.local>
10 months ago
不如归去 8025ad0661
Fixes #20534: Allow $ref in parameter for custom tools (#20535)
Co-authored-by: Peter Xin <iami@Artemis.local>
10 months ago
Cheney Zhang b4b59148dc
check zilliz cloud of full-text search (#20519) 10 months ago
湛露先生 b33f8b47ca
nacos config init , and force add ts parms. (#20526)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
10 months ago
kurokobo c26e1929d6
fix(housekeeping): exclude files that are used as app icons or avatar images from being removed (#20532) 10 months ago
jyong 3fb02a7933 r2 10 months ago
-LAN- 92528360f9
fix: fetch tenant_id in other trace providers besides langfuse (#20495)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 631768ea1d r2 10 months ago
Ganondorf 51f64797cd
Add APIs for Knowledge Base Tag Management and Dataset Binding (#20023)
Co-authored-by: lizb <lizb@sugon.com>
10 months ago
Dongyu Li 1ea4459d9f
update knowledge base api (#20426) 10 months ago
Yasuhiro Ohno 55371e5abf
Improve CONVERSATION_TITLE_PROMPT to correctly handle Japanese and input (#20351) 10 months ago
Jyong fb12a3033d
fix celery job not closed issue (#19268) 10 months ago
-LAN- a6ea15e63c
Refactor/message cycle manage and knowledge retrieval (#20460)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
yihong 5a991295e0
fix: drop some type fixme (#20344) 10 months ago
-LAN- db488bef51
refactor(api/core/workflow/enums): Rename WORKFLOW_RUN_ID to WORKFLOW_EXECUTION_ID (#20459)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- f2e0d161a1
fix(ops_trace_manager): Adds app_id to TraceTask initialization (#20461)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 2ebf4e767b
fix(models): WorkflowRun's total_steps and exceptions_count mismatch with database (#20452)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- f7fb10635f
refactor(workflow): Rename workflow node execution models (#20458)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 32e779eef3
refactor(workflow): Rename NodeRunMetadataKey to WorkflowNodeExecutionMetadataKey (#20457)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 482e50aae9
Refactor/remove db from cycle manager (#20455)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- cd0a05f114
tests: Removes outdated marketplace download test (#20454)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 976b465e76 r2 10 months ago
jyong 804e55824d r2 10 months ago
jyong 69529fb16d r2 10 months ago
jyong cb5cfb2dae r2 10 months ago
jyong a826879cf7 Merge branch 'main' into feat/r2 10 months ago
jyong e7c48c0b69 r2 10 months ago
Yeuoly d4408e0f54
fix: handle values in output arrays for CodeNode transformation (#20437) 10 months ago
Bowen Liang eee88a8012
chore: improve error logging for requests to plugin daemon (#20328) 10 months ago
quicksand 2d4f8f1377
fix: apps/annotation missing 1 required positional argument: 'end_user' (#20428) 10 months ago
jyong a025db137d Merge branch 'main' into feat/r2 10 months ago
jyong 797d044714 r2 10 months ago
Novice b2ab401279
chore: remove agent turn limits (#19930) 10 months ago
Novice 9bbd646f40
fix: inner invoke llm token too long (#20391) 10 months ago
-LAN- c3c67d9608
fix: register user model to current_user in backward invoke. (#20374)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- f59fb94dae
feat(agent_node): ensure that the enum-checking syntax is compatible with Python 3.11. (#20373)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 7f59ffe7af r2 10 months ago
teawoong Kim 400ae664bb
fix(http): force multipart/form-data even without files(#20322) (#20323) 10 months ago
-LAN- eaaf551497
fix: Instance <Account> is not bound to a Session (#20347)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- f233a64eb5
fix(workflow): fetch user failed when workflow run in parallel mode (#20321)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
AichiB7A 2b81b6673f
[Observability] Add type check and try-except in otel (#20319) 10 months ago
-LAN- 4c46f04d77
fix: Enhances tenant ID handling in telemetry (#20304)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- fe01de5667
chore(*): Bump version to 1.4.1 (#20275)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 275b042998
chore(remove_app_and_related_data_task): Revert `_delete_app_workflow_node_executions` (#20278)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
rouxiaomin 4c4887c5fc
feat(qdrant):add replication_factor when create collection in qdrant (#20133)
Co-authored-by: 刘敏 <min.liu@tongdun.net>
10 months ago
Mio Inamijima 0ebaba98f0
fix: dataset permission check for partial team members (#19249) (#20242)
Co-authored-by: MioINAMIJIMA <m.inamijima@optimaize-consulting.com>
10 months ago
-LAN- d3bfcd498b
fix: Refactor web reader to use readabilipy (#19789)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 9c9d3d7bd0
feat: document extractor chardet encoding (#20269)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Good Wood 756f35f480
feat: add pagination for plugin page (#20151) 10 months ago
-LAN- 55503ce771
fix: persist workflow execution status on partial success and failure (#20264)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Dongyu Li c57726a587
fix[cve]: update qdrant-client from 1.7.3 to 1.9.0 (#20231) 10 months ago
-LAN- b357eca307
fix: Copy request context and current user in app generators. (#20240)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
非法操作 acd4b9a8ac
fix: not save workflow_run_id of chatflow message (#20257) 10 months ago
jyong 5fc2bc58a9 r2 10 months ago
-LAN- f21e6e03a3
refactor: Consolidate Flask-Login Authentication Logic (#20235)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Good Wood 6f982eb7e4
feat: add author_name for app list card (#16900)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
10 months ago
cooper.wu 2cad98f01f
fix: #18132 when deepseek llm model, auto_generate name can't work (#18646)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
10 months ago
Yeuoly 83ca7f8deb feat: add datasource support to PluginDeclaration and PluginCategory 10 months ago
jyong 678d6ffe2b r2 10 months ago
Heyang Wang b9b5d43dc6
fix: add 'floatfmt' when extract number from excel ( #20153 ) (#20193)
Co-authored-by: wangheyang <wangheyang@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
jyong ef0e41de07 r2 10 months ago
jyong 1b07e612d2 r2 10 months ago
jyong 38cce3f62a r2 10 months ago
jyong 35be8721b9 Merge branch 'main' into feat/r2 10 months ago
jyong 665ffbdc10 r2 10 months ago
jyong ec1c4efca9 r2 10 months ago
jyong 0f10852b6b Merge remote-tracking branch 'origin/feat/r2' into feat/r2 10 months ago
jyong 6d547447d3 r2 10 months ago
Yeuoly 6123f1ab21 refactor: reorganize imports and fix datasource endpoint URL 10 months ago
Yeuoly a15bf8e8fe remove output schema 10 months ago
jyong 70d2c78176 r2 10 months ago
jyong 42fcda3dc8 r2 10 months ago
jyong 64d997fdb0 r2 10 months ago
Yeuoly a49942b949 fix: rename first_step_parameters 10 months ago
Yeuoly 4460d96e58 feat: add oauth schema 10 months ago
Yeuoly a7d5f2f53b apply ruff 10 months ago
Yeuoly 4300ebc8aa fix: remove provide type 10 months ago
jyong b93d26ee9f Merge remote-tracking branch 'origin/feat/r2' into feat/r2
# Conflicts:
#	api/core/datasource/entities/datasource_entities.py
10 months ago
jyong b82b26bba5 r2 10 months ago
非法操作 9b1dc1de7a
fix: system file upload can't export custom file types (#20122) 10 months ago
Boris Feld c939f04b1a
Add support for tracking conversation with Opik Tracer (#20063) 11 months ago
Boris Feld 9afd7f6c87
chore: Update S3StorageConfig to match boto3 type hints (#20072) 11 months ago
jameshui1997 648393cc7b
fix: improve tracing provider validation logic in OpsTraceManager (#20042) 11 months ago
He Huang 6f48af2610
Refactor OpenSearch config to separate use_ssl and verify_certs flags (#20075)
Co-authored-by: he.huang <he.huang1@outlook.com>
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
zhudongwork adca981eee
fix: uninitialized variable error on empty knowledge retrieval(agent) (#20025)
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
GonzaHM 38b1e46241
fix: correct indentation in dataset retrieval model assignment (#20040) 11 months ago
-LAN- 6b3666f826
feat: Split WorkflowCycleManager (#20071)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
heyszt 02929b2cce
Fix/fix trace provider delete err (#20070) 11 months ago
-LAN- d31235ca13
feat: Introduce WorkflowExecution Domain Entity and Repository, Replace WorkflowRun Direct Usage, and Unify Stream Response Logic (#20067)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Yeuoly 3bfc602561 refactor: update datasource entity structure and parameter handling
- Renamed and split parameters in DatasourceEntity into first_step_parameters and second_step_parameters.
- Updated validation methods for new parameter structure.
- Adjusted datasource_node to reference first_step_parameters.
- Cleaned up unused imports and improved type hints in workflow.py.
11 months ago
Yeuoly 5fa2aca2c8 feat: add oauth schema to datasource 11 months ago
wlleiiwang 7d230acf40
tencent vectordb compatible with version 1.1.3 and below (#20056)
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
11 months ago
QuantumGhost 13dc1c8795
Simplify `execution_metadata` Handling for `WorkflowNodeExecution` (#20062)
Currently, `WorkflowNodeExecution.execution_metadata_dict` returns `None` when metadata is absent in the database. This requires all callers to perform `None` checks when processing metadata, leading to more complex caller-side logic.

This pull request updates the `execution_metadata_dict` method to return an empty dictionary instead of `None` when metadata is absent. This change would simplify the caller logic, as it removes the need for explicit `None` checks and provides a more consistent data structure to work with.
11 months ago
-LAN- 57bcb616bc
fix(sqlalchemy_workflow_node_execution_repository): Missing `triggered_from` while querying WorkflowNodeExecution (#20044)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
-LAN- 3196dc2d61
refactor: Use typed SQLAlchemy base model and fix type errors (#19980)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Panpan ef3569e667
feat: support chatflow start node custom input field hidden (#19678) 11 months ago
俊晨 36b321735e
fix create_tracing_app_config error (#19884) (#20004)
Co-authored-by: codly <codly.fun@gmail.com>
11 months ago
crazywoola d35d854259
Revert "fix: fix duplicate app lose custom image" (#19995) 11 months ago
luckylhb90 c58678d84d
chore: Reduce the invocation of the plugin interface (#19629)
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
CorrectRoad 618981f1ae
fix: fix duplicate app lose custom image (#19775) 11 months ago
jyong 9bafd3a226 r2 11 months ago
Zihe JI 87f9d11d65
fix: ensure Decimal values in metadata are JSON serializable (fixes #19936) (#19955)
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
Darlewo 8cb3b4aef2
fix: multiple retrieve reranking_enabled switch (#19958) 11 months ago
jyong 82be119fec Merge branch 'main' into feat/r2 11 months ago
jyong a64df507f6 r2 11 months ago
jyong ba52bf27c1 r2 11 months ago
NFish d186daa131
E-300 (#19726)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Hash Brown <hi@xzd.me>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: GareArc <chen4851@purdue.edu>
Co-authored-by: Byron.wang <byron@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
Co-authored-by: KVOJJJin <jzongcode@gmail.com>
Co-authored-by: Alexi.F <654973939@qq.com>
Co-authored-by: Xiyuan Chen <52963600+GareArc@users.noreply.github.com>
Co-authored-by: kautsar_masuara <61046989+izon-masuara@users.noreply.github.com>
Co-authored-by: achmad-kautsar <achmad.kautsar@insignia.co.id>
Co-authored-by: Xin Zhang <sjhpzx@gmail.com>
Co-authored-by: kelvintsim <83445753+kelvintsim@users.noreply.github.com>
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
Co-authored-by: Zixuan Cheng <61724187+Theysua@users.noreply.github.com>
11 months ago
Raina Otoni 6a8ca8296b
chore: update redis dependency to version 6.1.0 in api/pyproject.toml (#19885) 11 months ago
crazywoola 7ae529c3b0
Revert "chore: upgrade Redis from v6 to v7 in middlewares" (#19960) 11 months ago
湛露先生 911f9eadd0
fix model workflow_draft_variables duplicate app_id set. (#19949)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
11 months ago
Amir Mohsen Asaran c9ee60e197
Feat(WaterCrawl error handling): add custom exceptions and error handling (#19948) 11 months ago
Bowen Liang a18a6f50ab
chore: upgrade Redis from v6 to v7 in middlewares (#19935) 11 months ago
QuantumGhost 6a9e0b1005
feat(api): Introduce `WorkflowDraftVariable` Model (#19737)
- Introduce `WorkflowDraftVariable` model and the corresponding migration.
- Implement `EnumText`,  a custom column type for SQLAlchemy designed
  to work seamlessly with enumeration classes based on `StrEnum`.
11 months ago
非法操作 bbebf9ad3e
fix: db_model save to _node_execution_cache (#19911) 11 months ago
heyszt 11146b6bae
fix create_tracing_app_config error (#19884) 11 months ago
Hashcon 6a74c97a0a
feat: add debug log for request and response (#19781) (#19783)
Co-authored-by: hashjang <hash@geek.com>
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
11 months ago
-LAN- e0e8cd6ca3
feat(DraftWorkflowApi): Requires environment_variables in DraftWorkflowApi (#19849)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
-LAN- 7d0106b220
fix: correct type mismatch in WorkflowService node execution handling (#19846)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
-LAN- 4977bb21ec
feat(workflow): domain model for workflow node execution (#19430)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
11 months ago
Yeuoly c5a2f43ceb refactor: replace BuiltinToolManageService with RagPipelineManageService for datasource management and remove unused datasource engine and related code 11 months ago
jyong 8bea88c8cc r2 11 months ago
Emmanuel Ferdman 582b721160
Resolve Python Logger library warnings (#19791)
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
11 months ago
jyong 9e72afee3c r2 11 months ago
jyong 613b94a6e6 r2 11 months ago
jyong 7b0d38f7d3 r2 11 months ago
jyong 4ff971c8a3 r2 11 months ago
jyong 93ac6d37e9 r2 11 months ago
jyong e710a8402c r2 11 months ago
-LAN- 937d151187
chore: Updates version numbers to 1.4.0 and related services (#19731)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
jyong 360f8a3375 Merge branch 'main' into feat/r2 11 months ago
jyong 818eb46a8b r2 11 months ago
Nite Knite 6d7f43b901
feat: update email templates (#19739) 11 months ago
Yeuoly ff0feaf34e
fix: handle EndpointSetupFailedError in BasePluginClient (#19613) 11 months ago
k-kayashima b292990075
Fix: Ensure unique index names for pgvector knowledge tables (#19672)
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
zhaobingshuang 303c6ecc1d
fix: The init_azure_openai() method in the core/hosting_configuration.py file doesn't work (#19704) (#19705)
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
XlKsyt 85eb55de37
feat(extension): support otel grpc exporter (#19686) 11 months ago
GuanMu 17b929124f
refactor: simplify success response in dataset API endpoints by returning status code 204 directly (#19685) 11 months ago
satohk 1b4fea1794
fix: Referencing Metadata in the response of the External Knowledge A… (#19637) (#19644)
Co-authored-by: satou.kazuhiro <satou.kazuhiro@fanuc.co.jp>
11 months ago
-LAN- 5360180a2a
feat: add index for workflow_conversation_variables.conversation_id (#19657)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
rouxiaomin 9dce0e40b5
fix:fix log formatting field not found in record: 'req_id' (#19575)
Co-authored-by: 刘敏 <min.liu@tongdun.net>
11 months ago
lexmin0412 ff20b56074
Add `/site` API (#19631) 11 months ago
jiangbo721 fabfc7d4d8
fix: remove error message $ symbol (#19587)
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
-LAN- 10a724cc62
chore: Update dependencies in pyproject.toml (#19598)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Xiyuan Chen 934f724130
fix: invitations get suspended when an existing member appears (#19584) 11 months ago
SSebo 57b3912227
fix: common prerequisite node workflow remove reachable node that failed to streaming llm… (#19552)
Co-authored-by: zhangshibo <zhangshibo@didiglobal.com>
11 months ago
-LAN- f0137be719
fix(vector_service): Fixes type hinting and removes unnecessary ignores (#19574)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Ganondorf c76d763639
add endpoint of get feedbacks (#18697)
Co-authored-by: lizb <lizb@sugon.com>
11 months ago
-LAN- 0fed5c1193
fix(config): Allow DB_EXTRAS to set search_path via options (#19560)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Bowen Liang 0b22e8b544
chore: speed up api service startup time by defering the imports for trace services (#19504) 11 months ago
非法操作 085bd1aa93
chore: model.query change to db.session.query (#19551)
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
11 months ago
-LAN- f1e7099541
chore(pyproject.toml): Upgrade transformers and resend (#19562)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Bowen Liang 31d143de11
chore: disable redis client-side caching by default (#19524) 11 months ago
非法操作 14cd71ed0a
chore: all model.query replace to db.session.query (#19521) 11 months ago
非法操作 b00f94df64
fix: replace all dataset.Model.query to db.session.query(Model) (#19509) 11 months ago
Bowen Liang 855e850ef3
feat: enable Redis client-side caching (#19493) 11 months ago
LeanDeR c720e0dd04
refactor(workflow): revamp logging module for loop & iteration nodes (#19484) 11 months ago
湛露先生 505d4cce78
Revert "sort extensions for review," (#19496) 11 months ago
湛露先生 c431da9571
sort extensions for review, (#19470)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
11 months ago
crazywoola b29087b680
fix: db.session.query(TenantAccountJoin) (#19482) 11 months ago
湛露先生 1119790b02
clean rag word_extractor. (#19397)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
11 months ago
-LAN- 56cff485d0
test(vdb/huaweicloudvectordb): Fix the wrong import path (#19413)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Yuichiro Utsumi c7a8885d9d
fix: fix pypdfium2 version to 4.30.0 (#19443)
Signed-off-by: Yuichiro Utsumi <utsumi.yuichiro@fujitsu.com>
11 months ago
非法操作 220db55e71
fix: TenantAccountJoin has no attribute 'query' (#19445) 11 months ago
-LAN- 792b321a81
refactor(models): Use the SQLAlchemy base model. (#19435)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
-LAN- 2ad7305349
Revert "perf: optimizing db WorkflowAppLog index" (#19432) 11 months ago
-LAN- b4064fa092
test(test_dify_config): Update test to use example environment file (#19427)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Bowen Liang cbc8ebd8f5
chore: bump pydantic to 2.11 and pydantic-settings to 2.9 (#15049) 11 months ago
Will 58d9d35515
fix: inconsistent metadata definitions (#19343) 11 months ago
Yeuoly 3258a91d5d
Feat/add repo to plugin manifest (#19337) 11 months ago
Will 0358859467
fix: llm_usage.total_tokens stat (#19177) 11 months ago
jyong 3f1363503b r2 11 months ago
Will bfa652f2d0
fix: metadata filtering condition variable unassigned; fix External K… (#19208) 11 months ago
AichiB7A c4c20f6ed5
[Observability] Update counter to include http method and target (#19297)
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
11 months ago
-LAN- f23cf98317
refactor: Remove RepositoryFactory (#19176)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
QuantumGhost 9565fe9b1b
fix(api): fix alembic offline mode (#19285)
Alembic's offline mode generates SQL from SQLAlchemy migration operations,
providing developers with a clear view of database schema changes without
requiring an active database connection.

However, some migration versions (specifically bbadea11becb and d7999dfa4aae)
were performing database schema introspection, which fails in offline mode
since it requires an actual database connection.

This commit:
- Adds offline mode support by detecting context.is_offline_mode()
- Skips introspection steps when in offline mode
- Adds warning messages in SQL output to inform users that assumptions were made
- Prompts users to review the generated SQL for accuracy

These changes ensure migrations work consistently in both online and offline modes.

Close #19284.
11 months ago
jyong a998022c12 r2 11 months ago
jyong a25cc4e8af r2 11 months ago
Good Wood 0b44791eae
feat: add mode for /info api (#19264) 11 months ago
Novice 0cfc82d731
fix(structured-output): reasoning model's json format parsing (#19261) 11 months ago
Bowen Liang 8537abfff8
chore: avoid repeated type ignore noqa by adding flask_restful and flask_login in mypy import exclusions (#19224) 11 months ago
Yeuoly 8ac3a223a8
fix(api): add missing INNER_API_KEY to InnerAPIConfig (#19166) 11 months ago
kenwoodjw c5568f756f
fix basic auth if not base64 encode (#19242)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
11 months ago
Bowen Liang 22f5af9987
fix: support non-ascii charactors in filename of the tool files (#19228) 11 months ago
Bowen Liang e352ab2bdd
chore: required pip and performance improvment in mypy checks (#19225) 11 months ago
Hao Cheng 9bcf837f17
fix: use only supported operators in metadata filter system prompts (#19195) 11 months ago
Will a212a63e6a
fix: time type metadata filtering error (#19192) 11 months ago
Bowen Liang e2cae42115
chore: bump celery from 5.4 to 5.5 (#19190) 11 months ago
Hao Cheng bb1d1dc263
fix: fix API tool integration test (#19187) 11 months ago
非法操作 1ca6dbcdc8
fix: file name incorrect when download file (#19183) 11 months ago
QuantumGhost 349c3cf7b8
feat(api): Add image multimodal support for LLMNode (#17372)
Enhance `LLMNode` with multimodal capability, introducing support for
image outputs.

This implementation extracts base64-encoded images from LLM responses,
saves them to the storage service, and records the file metadata in the
`ToolFile` table. In conversations, these images are rendered as
markdown-based inline images.
Additionally, the images are included in the LLMNode's output as
file variables, enabling subsequent nodes in the workflow to utilize them.

To integrate file outputs into workflows, adjustments to the frontend code
are necessary.

For multimodal output functionality, updates to related model configurations
are required. Currently, this capability has been applied exclusively to
Google's Gemini models.

Close #15814.

Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
11 months ago
Bowen Liang 12c96b93d9
immediately return initialed tiktokenizer instance and remove dead code in usage of tiktokenizer (#17957) 11 months ago
-LAN- bcc95e520b
feat: support remove first and remove last in variable assigner (#19144)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Will 69b43a955f
fix: inconsistent case expression in _process_metadata_filter_func (#19146) 11 months ago
kingpc 65b7a783fe
fix: metadata filter not work (#19020)
Co-authored-by: 金鹏程 <jinpengcheng01@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
11 months ago
sondin d70fa2847b
add Accept-Ranges header for audio/video files (#19119) 11 months ago
kenwoodjw 8bf3f5ea78
fix(api): resolve external knowledge API error due to excessive URL validation (#19003)
The `validators.url` method from the `validators==0.21.0` library enforces a
URL length limit of less than 90 characters, which led to failures in external
knowledge API requests for long URLs.

This PR addresses the issue by replacing `validators.url` with 
`urllib.parse.urlparse`, effectively removing the restrictive URL length check.

Additionally, the unused `validators` dependency has been removed.

Fixes #18981.

Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
11 months ago
QuantumGhost bd1bbfee4b
Enhance Code Consistency Across Repository with `.editorconfig` (#19023) 11 months ago
feiyang_deepnova 226afd4550
Fix: the issue of getting empty environment variables. (#19085) 11 months ago
xiaotian 23f6914b9b
fix: image preview triggers binary download (#19070) 11 months ago
Ahmad Zidan 8266815cda
feat: add AWS Managed IAM auth for OpenSearch vector DB (#18963) 11 months ago
Ethan 8b4ea01810
feat: support access milvus with token (#19034) 11 months ago
Panpan 83187b30c0
fix: fix rerank model runner usage (#19008) 11 months ago
Ganondorf a147d2a200
feat(api): use `json_repair` to fix invalid json while generating structured output (#18977)
When generating JSON schema using an LLM in the structured output feature,
models may occasionally return invalid JSON, which prevents clients from correctly 
parsing the response and can lead to UI breakage.

This commit addresses the issue by introducing `json_repair` to automatically 
fix invalid JSON strings returned by the LLM, ensuring smoother functionality 
and better client-side handling of structured outputs.


Co-authored-by: lizb <lizb@sugon.com>
11 months ago
Kevin9703 94cc0b7a12
fix(workflow_cycle_manage): failed nodes were not updated in workflow_node_executions (#18994) 11 months ago
Novice e36b1a7016
test(graph-engine-test): modify the assert condition (#19041) 11 months ago
kurokobo a93a09e0f7
feat: clean up message_files table first before proceeding to find orphaned files (#19035) 11 months ago
-LAN- a54773fbff
refactor: switch to dynamic versioning in package configuration (#19019)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
Jyong b8bb45b106
remove unstructured api key check (#18989) 11 months ago
Jyong ecade13455
add MAX_TASK_PRE_CHILD for celery (#18985) 11 months ago
-LAN- 49678e4b48
chore: Bump version to 1.3.1 (#18962)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
jyong 3c386c63a6 Merge remote-tracking branch 'origin/feat/r2' into feat/r2 11 months ago
jyong 49d1846e63 r2 11 months ago
quicksand 5de01c1444
feat (document_extractor): support .properties file (#18969) 11 months ago
-LAN- f86e2edc54
refactor(plugin/backwards_invocation/app): Remove unnecessary .value from StrEnum (#18896)
Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago