Commit Graph

2599 Commits (cb4f13014e01823404fd3fa06db88d0dba0c881e)

Author SHA1 Message Date
Maries 164e5481c5
feat(oauth): plugin oauth service (#21480) 12 months ago
Novice f783ad68e4 chore(refactor): queries in service and auth components 12 months ago
QuantumGhost 268da31332
fix(api): adding variable to variable pool recursively while loading draft variables. (#21478)
This PR fix the issue that `ObjectSegment` are not recursively added to the draft variable pool while loading draft variables from database. It also fixes an issue about loading variables with more than two elements in the its selector.

Enhances #19735.
Closes #21477.
12 months ago
Novice 01922f2d02 feat: add unique id in mcp tool dsl 12 months ago
Harry 7979e05ade Merge branch 'main' into feat/tool-plugin-oauth
# Conflicts:
#	README.md
#	api/services/tools/builtin_tools_manage_service.py
12 months ago
Harry 5e7c5863ef refactor(tool oauth): update api implementation 12 months ago
QuantumGhost 501d3b6203
feat(api): Explicitly define version method for all BaseNode subclasses (#21443)
This PR addresses issue #21441 by implementing explicit `version` method definitions for all `BaseNode` subclasses to improve code maintainability.

### Changes

Added explicit `version` method definitions for all `BaseNode` subclasses:

- `QuestionClassifierNode`
- `KnowledgeRetrievalNode` 
- `AgentNode`

Added comprehensive test suite to validate:

1. All subclasses of `BaseNode` have explicitly defined `version` method
2. All subclasses have required `_node_type` property
3. The `(node_type, node_version)` combination is unique across all subclasses
12 months ago
quicksand 45146edb31
fix(document_extractor): xlsx file column int type error (#21408) 12 months ago
QuantumGhost 10b738a296
feat: Persist Variables for Enhanced Debugging Workflow (#20699)
This pull request introduces a feature aimed at improving the debugging experience during workflow editing. With the addition of variable persistence, the system will automatically retain the output variables from previously executed nodes. These persisted variables can then be reused when debugging subsequent nodes, eliminating the need for repetitive manual input.

By streamlining this aspect of the workflow, the feature minimizes user errors and significantly reduces debugging effort, offering a smoother and more efficient experience.

Key highlights of this change:

- Automatic persistence of output variables for executed nodes.
- Reuse of persisted variables to simplify input steps for nodes requiring them (e.g., `code`, `template`, `variable_assigner`).
- Enhanced debugging experience with reduced friction.

Closes #19735.
12 months ago
Novice c7e72f7365 chore: remove the unused changes 12 months ago
Novice 1fc3f88f82 Merge branch 'main' into feat/mcp 12 months ago
Novice b5b5d7493d chore: change the oauth process 12 months ago
Harry 12c20ec7f6 feat: plugin OAuth with stateful 12 months ago
Jin 3e7f8bad56
fix: markdown_extractor lost chunks if it starts without a header(#21308) (#21309) 12 months ago
QuantumGhost 3f9ced5374
Revert "feat:conversation variable support file array" (#21273) 12 months ago
Novice a467612b2b Merge branch 'main' into feat/mcp 12 months ago
Novice db001e1511 feat: handle none value in mcp tool node 12 months ago
Novice c1884c2e40 fix: handle none value in tool node 12 months ago
-LAN- 6b1ad634f1
fix(workflow_run): sequence_number race. (#21228)
Signed-off-by: -LAN- <laipz8200@outlook.com>
12 months ago
Novice 58faef8b5b Merge branch 'main' into feat/mcp 12 months ago
Novice 986e2794bd fix: handle mcp array and object type 12 months ago
QuantumGhost 2c04a16eaa
Revert "bug: fix sequence number may be duplicated when multi-threads running the same workflow #21047" (#21207) 12 months ago
ZalterCitty 6325129761
fix wrongly remove reset nodes (#20880)
Co-authored-by: zhuqingchao <zhuqingchao@xiaomi.com>
12 months ago
kinoooolu 2bb19f85c6
feat:conversation variable support file array (#21174)
Co-authored-by: kino.lu <kino.lu@vipshop.com>
12 months ago
LiuBo 17fe62cf91
feat: add support for Matrixone database (#20714) 12 months ago
NeatGuyCoding 9835730278
Translation fix (#21194) 12 months ago
湛露先生 8331b63baa
add func args missing in apps chat. (#21085)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
1 year ago
NeatGuyCoding 2eae7503e1
Minor Improvements for File Validation and Configuration Handling #21179 (#21171)
Co-authored-by: tech <cto@sb>
1 year ago
Novice 9dd1cd9df8 fix: update mcp tool auth 1 year ago
Xin Zhang 30cfc9c172
Feat/plugin install scope management (#19963) 1 year ago
NeatGuyCoding 918bb9a2f7
bug: fix sequence number may be duplicated when multi-threads running the same workflow #21047 (#21153) 1 year ago
Ademílson Tonato 9e73e8b9e8
feat: add search endpoint for Firecrawl Integration (#20521)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Rain Wang 47e0f92c0f
Fixes #20748 KnowledgeRetrievalNode return all external documents when reranker disabled even top-k configed (#20762) 1 year ago
湛露先生 6d033d4064
clean duplicate validate for dataset_configs (#20775)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
1 year ago
湛露先生 ab290ed968
unreachable-code for lb model fetch. (#20797)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
1 year ago
-LAN- 879f839d75
refactor(graph_engine): Merge duplicated if block (#20784)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
kazuya-awano 45c89bd6de
feat: add pagenation to notion extractor (#20919) 1 year ago
kurokobo 4689e8953e
fix: shorten connection timeout to pypi.org for deprecation check for weaviate client (#21131) 1 year ago
W_OOD 0476937f55
fix(agent_node):Fix spelling errors. (#21094) 1 year ago
Novice 094727a16a feat: add unit test cases 1 year ago
-LAN- 0dcacdf83d
feat: add a flask_context_manager. (#21061)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Novice ff729a931d fix: auth error not raise 1 year ago
yihong 909259da37
fix: delete some dead code using vulture (#20999)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
Bowen Liang 366ddb05ae
test: run vdb test of oceanbase with docker compose in CI tests (#20945) 1 year ago
Novice b4317cd0dc feat: implement serveless streamable server 1 year ago
-LAN- c05e47ebc0
refactor(sqlalchemy_workflow_execution_repository): Use the max funtion for getting next_sequence_number. (#20966) 1 year ago
Novice ac3438e187 chore: add log 1 year ago
Novice 0f668be415 feat: add multi app mode's server support 1 year ago
Novice 6f1cc457a4 feat: handle none value 1 year ago
Takuya Ono af83120832
🐛 Fix(Gemini LLM): Support Gemini 0.2.x plugin on agent app (#20794)
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
1 year ago
-LAN- 1e03c97663
fix(llm_node): missing parameters for structure outputs (#20915)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Novice 671136f5e6 Merge branch 'main' into feat/mcp 1 year ago
Novice c0684a40e4 feat: add variable to tool node config 1 year ago
Yeuoly d6d8cca053
refactor: replace compact response generation with length-prefixed response for backwards invocation api (#20903) 1 year ago
Bowen Liang 0f3d4d0b6e
chore: bump mypy to 1.16 (#20608) 1 year ago
Jyong 21a50e22d2
fix auto metadata filter (#20845) 1 year ago
QuantumGhost c439e82038
refactor(api): Decouple `ParameterExtractorNode` from `LLMNode` (#20843)
- Extract methods used by `ParameterExtractorNode` from `LLMNode` into a separate file.
- Convert `ParameterExtractorNode` into a subclass of `BaseNode`.
- Refactor code referencing the extracted methods to ensure functionality and clarity.
- Fixes the issue that `ParameterExtractorNode` returns error when executed.
- Fix relevant test cases.

Closes #20840.
1 year ago
QuantumGhost a97ff587d2
fix(api): Resolve error encountered when executing `QuestionClassifieNode` (#20829)
The `QuestionClassifierNode` class extends `LLMNode`, meaning that, per the Liskov Substitution Principle, `QuestionClassifierNodeData` **SHOULD** be compatible in contexts where `LLMNodeData` is expected.

However, the absence of the `structured_output_enabled` attribute violates this principle, causing `QuestionClassifierNode` to fail during execution.

This commit implements a quick and temporary workaround. A proper resolution would involve refactoring to decouple `QuestionClassifierNode` from `LLMNode` to address the underlying design issue.

Fixes #20725.
1 year ago
yihong 65c7c01d90
fix: clean up two unreachable code (#20773)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
Bharat Ramanathan e6e76852d5
Add support for W&B dedicated cloud instances in Weave tracing integration (#20765)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
jefferyvvv 37c3283450
fix: opensearch vector search falls back to keyword search (#20723)
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
1 year ago
Novice 08024fe6de fix: superlint trailing whitespace 1 year ago
Bowen Liang c1a13fa553
chore: replace pseudo-random generators with secrets module (#20616) 1 year ago
jefferyvvv 4271602cfc
fix: opensearch metadata filtering returns empty (#20701)
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
jefferyvvv 138ad6e8b3
fix: opensearch fulltext search with metadata filtering dsl error (#20702)
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
1 year ago
湛露先生 f76f70f0b6
Fix builtin_providers for tools. (#20697)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
1 year ago
Novice ecd18b70a1 fix: mypy error 1 year ago
Novice a9e73653a8 Merge branch 'main' into feat/mcp 1 year ago
Novice 13809c883d feat: filter the low version mcp tool 1 year ago
HaiyangP 3fb9b41fe5
A more concise and effective extractor for excel and csv files (#20625)
Co-authored-by: haiyangpengai <xxxx>
1 year ago
Arcaner ad2f25875e
fix(llm_node): update file variable mapping to use vision configs (#20417) 1 year ago
Novice 5d090a01af feat: agent plugin add meta version 1 year ago
-LAN- 5ccfb1f4ba
refactor: Improve model status handling and structured output (#20586)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
kenwoodjw 01d500db14
fix: autocorrect everything in web (#20605)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
1 year ago
-LAN- 275e86a26c
refactor: Removes tenant ID check from rate limit logic (#20585)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
非法操作 ca0b268ae5
fix: variable aggregator with group and file raise exception (#20581) 1 year ago
Bowen Liang 888cd86afd
chore: prepare the plugin daemon base url to yarl URL ahead intstead of in every invocation (#20541) 1 year ago
-LAN- 36f1b4b222
fix: Ensure model config integrity in retrieval processes (#20576)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 257bf13fef
refactor: Removes unused LLMMode value_of method (#20575)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 72fdafc180
refactor: Replaces direct DB session usage with context managers (#20569)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
zhaobingshuang 3f7aa38d77
fix: #20560 When elasticsearch is used as the vector database, the Retrieval Test fails to filter the data after setting the Score Threshold, and the score of the recalled results is empty (#20561) 1 year ago
Contrail a145c2a8fe
fix: ensure proper conversation role alternation for vLLM (#18837) 1 year ago
不如归去 c29cb503be
Fix #20536: Force header in custom tool be string (#20537)
Co-authored-by: Peter Xin <iami@Artemis.local>
1 year ago
不如归去 8025ad0661
Fixes #20534: Allow $ref in parameter for custom tools (#20535)
Co-authored-by: Peter Xin <iami@Artemis.local>
1 year ago
Cheney Zhang b4b59148dc
check zilliz cloud of full-text search (#20519) 1 year ago
Novice beef679798 feat: change the mcp server url 1 year ago
-LAN- 92528360f9
fix: fetch tenant_id in other trace providers besides langfuse (#20495)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Dongyu Li 1ea4459d9f
update knowledge base api (#20426) 1 year ago
Yasuhiro Ohno 55371e5abf
Improve CONVERSATION_TITLE_PROMPT to correctly handle Japanese and input (#20351) 1 year ago
-LAN- a6ea15e63c
Refactor/message cycle manage and knowledge retrieval (#20460)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
yihong 5a991295e0
fix: drop some type fixme (#20344) 1 year ago
-LAN- db488bef51
refactor(api/core/workflow/enums): Rename WORKFLOW_RUN_ID to WORKFLOW_EXECUTION_ID (#20459)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Novice f6f9fb1f6b fix: change the agent runtime server url to original 1 year ago
Novice 14aecc147b feat: add encrypted 1 year ago
-LAN- f2e0d161a1
fix(ops_trace_manager): Adds app_id to TraceTask initialization (#20461)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- f7fb10635f
refactor(workflow): Rename workflow node execution models (#20458)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 32e779eef3
refactor(workflow): Rename NodeRunMetadataKey to WorkflowNodeExecutionMetadataKey (#20457)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 482e50aae9
Refactor/remove db from cycle manager (#20455)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Yeuoly d4408e0f54
fix: handle values in output arrays for CodeNode transformation (#20437) 1 year ago
Bowen Liang eee88a8012
chore: improve error logging for requests to plugin daemon (#20328) 1 year ago
Novice 1c84a27e7e feat: mcp tool add input schema 1 year ago
Novice b2ab401279
chore: remove agent turn limits (#19930) 1 year ago
Novice 9bbd646f40
fix: inner invoke llm token too long (#20391) 1 year ago
-LAN- f59fb94dae
feat(agent_node): ensure that the enum-checking syntax is compatible with Python 3.11. (#20373)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
teawoong Kim 400ae664bb
fix(http): force multipart/form-data even without files(#20322) (#20323) 1 year ago
-LAN- eaaf551497
fix: Instance <Account> is not bound to a Session (#20347)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Novice 2e4dfbd60f fix: redirect url change 1 year ago
Novice 1a7242abd4 Merge branch 'main' into feat/mcp 1 year ago
Novice c7cb3770a4 feat: agent node add mcp tools 1 year ago
-LAN- f233a64eb5
fix(workflow): fetch user failed when workflow run in parallel mode (#20321)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
rouxiaomin 4c4887c5fc
feat(qdrant):add replication_factor when create collection in qdrant (#20133)
Co-authored-by: 刘敏 <min.liu@tongdun.net>
1 year ago
-LAN- d3bfcd498b
fix: Refactor web reader to use readabilipy (#19789)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 9c9d3d7bd0
feat: document extractor chardet encoding (#20269)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Novice 41bbcb9540 feat: upgrade streamable http client 1 year ago
Good Wood 756f35f480
feat: add pagination for plugin page (#20151) 1 year ago
-LAN- 55503ce771
fix: persist workflow execution status on partial success and failure (#20264)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- b357eca307
fix: Copy request context and current user in app generators. (#20240)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
非法操作 acd4b9a8ac
fix: not save workflow_run_id of chatflow message (#20257) 1 year ago
cooper.wu 2cad98f01f
fix: #18132 when deepseek llm model, auto_generate name can't work (#18646)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
1 year ago
Heyang Wang b9b5d43dc6
fix: add 'floatfmt' when extract number from excel ( #20153 ) (#20193)
Co-authored-by: wangheyang <wangheyang@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Novice 1fd4839eca temp 1 year ago
Novice bdb4395319 feat: add mcp server 1 year ago
Boris Feld c939f04b1a
Add support for tracking conversation with Opik Tracer (#20063) 1 year ago
jameshui1997 648393cc7b
fix: improve tracing provider validation logic in OpsTraceManager (#20042) 1 year ago
He Huang 6f48af2610
Refactor OpenSearch config to separate use_ssl and verify_certs flags (#20075)
Co-authored-by: he.huang <he.huang1@outlook.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
zhudongwork adca981eee
fix: uninitialized variable error on empty knowledge retrieval(agent) (#20025)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
-LAN- 6b3666f826
feat: Split WorkflowCycleManager (#20071)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
heyszt 02929b2cce
Fix/fix trace provider delete err (#20070) 1 year ago
-LAN- d31235ca13
feat: Introduce WorkflowExecution Domain Entity and Repository, Replace WorkflowRun Direct Usage, and Unify Stream Response Logic (#20067)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
wlleiiwang 7d230acf40
tencent vectordb compatible with version 1.1.3 and below (#20056)
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
1 year ago
QuantumGhost 13dc1c8795
Simplify `execution_metadata` Handling for `WorkflowNodeExecution` (#20062)
Currently, `WorkflowNodeExecution.execution_metadata_dict` returns `None` when metadata is absent in the database. This requires all callers to perform `None` checks when processing metadata, leading to more complex caller-side logic.

This pull request updates the `execution_metadata_dict` method to return an empty dictionary instead of `None` when metadata is absent. This change would simplify the caller logic, as it removes the need for explicit `None` checks and provides a more consistent data structure to work with.
1 year ago
-LAN- 57bcb616bc
fix(sqlalchemy_workflow_node_execution_repository): Missing `triggered_from` while querying WorkflowNodeExecution (#20044)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 3196dc2d61
refactor: Use typed SQLAlchemy base model and fix type errors (#19980)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Panpan ef3569e667
feat: support chatflow start node custom input field hidden (#19678) 1 year ago
俊晨 36b321735e
fix create_tracing_app_config error (#19884) (#20004)
Co-authored-by: codly <codly.fun@gmail.com>
1 year ago
luckylhb90 c58678d84d
chore: Reduce the invocation of the plugin interface (#19629)
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Zihe JI 87f9d11d65
fix: ensure Decimal values in metadata are JSON serializable (fixes #19936) (#19955)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Darlewo 8cb3b4aef2
fix: multiple retrieve reranking_enabled switch (#19958) 1 year ago
Amir Mohsen Asaran c9ee60e197
Feat(WaterCrawl error handling): add custom exceptions and error handling (#19948) 1 year ago
QuantumGhost 6a9e0b1005
feat(api): Introduce `WorkflowDraftVariable` Model (#19737)
- Introduce `WorkflowDraftVariable` model and the corresponding migration.
- Implement `EnumText`,  a custom column type for SQLAlchemy designed
  to work seamlessly with enumeration classes based on `StrEnum`.
1 year ago
Novice c1a58ac160 feat: mcp client init 1 year ago
非法操作 bbebf9ad3e
fix: db_model save to _node_execution_cache (#19911) 1 year ago
heyszt 11146b6bae
fix create_tracing_app_config error (#19884) 1 year ago
-LAN- 7d0106b220
fix: correct type mismatch in WorkflowService node execution handling (#19846)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 4977bb21ec
feat(workflow): domain model for workflow node execution (#19430)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
1 year ago
Yeuoly ff0feaf34e
fix: handle EndpointSetupFailedError in BasePluginClient (#19613) 1 year ago
k-kayashima b292990075
Fix: Ensure unique index names for pgvector knowledge tables (#19672)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
zhaobingshuang 303c6ecc1d
fix: The init_azure_openai() method in the core/hosting_configuration.py file doesn't work (#19704) (#19705)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
satohk 1b4fea1794
fix: Referencing Metadata in the response of the External Knowledge A… (#19637) (#19644)
Co-authored-by: satou.kazuhiro <satou.kazuhiro@fanuc.co.jp>
1 year ago
jiangbo721 fabfc7d4d8
fix: remove error message $ symbol (#19587)
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago