Commit Graph

3984 Commits (9dbb06fccc51cc1417589dca5fda3574403b7708)

Author SHA1 Message Date
jyong 09e0a54070 r2 10 months ago
André de Matteo 7b9e01aa07
Feat/support sendgrid (#21011)
Co-authored-by: André de Matteo <andre.matteo@accenture.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
10 months ago
kinoooolu 2bb19f85c6
feat:conversation variable support file array (#21174)
Co-authored-by: kino.lu <kino.lu@vipshop.com>
10 months ago
LiuBo 17fe62cf91
feat: add support for Matrixone database (#20714) 10 months ago
Ganondorf e99861d4fe
Add Filter of Get Workflow Logs (#21172)
Co-authored-by: lizb <lizb@sugon.com>
10 months ago
NeatGuyCoding 9835730278
Translation fix (#21194) 10 months ago
湛露先生 8331b63baa
add func args missing in apps chat. (#21085)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
10 months ago
NeatGuyCoding 2eae7503e1
Minor Improvements for File Validation and Configuration Handling #21179 (#21171)
Co-authored-by: tech <cto@sb>
10 months ago
jyong 643efc5d85 Merge branch 'feat/r2' into deploy/rag-dev 10 months ago
Dongyu Li 43e5798e13 feat(datasource): change datasource result type to event-stream 10 months ago
Xin Zhang 30cfc9c172
Feat/plugin install scope management (#19963) 10 months ago
NeatGuyCoding 918bb9a2f7
bug: fix sequence number may be duplicated when multi-threads running the same workflow #21047 (#21153) 10 months ago
Dongyu Li 2cf980026e feat(datasource): change datasource result type to event-stream 10 months ago
Dongyu Li 224111081b feat(datasource): change datasource result type to event-stream 10 months ago
jyong 6f67a34349 r2 qa index 10 months ago
Ademílson Tonato 9e73e8b9e8
feat: add search endpoint for Firecrawl Integration (#20521)
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
HyaCinth d4be356ffb
fix(api): add support for "image" icon when duplicate app (#20744) (#20761) 10 months ago
Rain Wang 47e0f92c0f
Fixes #20748 KnowledgeRetrievalNode return all external documents when reranker disabled even top-k configed (#20762) 10 months ago
湛露先生 6d033d4064
clean duplicate validate for dataset_configs (#20775)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
10 months ago
湛露先生 ab290ed968
unreachable-code for lb model fetch. (#20797)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
10 months ago
-LAN- 879f839d75
refactor(graph_engine): Merge duplicated if block (#20784)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Jyong 787a556bd7
add service api ratelimit check (#20878) 10 months ago
He Wang 37f26c412f
add healthcheck to oceanbase container (#20989) 10 months ago
zxhlyh e51d308312 Merge branch 'feat/rag-pipeline' into deploy/rag-dev 10 months ago
kazuya-awano 45c89bd6de
feat: add pagenation to notion extractor (#20919) 10 months ago
jyong ac917bb56d r2 10 months ago
jyong f7a4e5d1a6 Merge branch 'main' into feat/r2 10 months ago
NeatGuyCoding 61526c027d
[Bug] fix misusing ACCESS_TOKEN_EXPIRE_MINUTES in jwt on exp (#21030)
Co-authored-by: tech <cto@sb>
10 months ago
kurokobo 4689e8953e
fix: shorten connection timeout to pypi.org for deprecation check for weaviate client (#21131) 10 months ago
jyong 66de2e1f0a Merge remote-tracking branch 'origin/feat/r2' into feat/r2
# Conflicts:
#	api/core/workflow/graph_engine/entities/event.py
#	api/services/rag_pipeline/rag_pipeline.py
10 months ago
jyong 7f7ea92a45 r2 10 months ago
Dongyu Li cf66d111ba feat(datasource): change datasource result type to event-stream 10 months ago
Dongyu Li 739ebf2117 feat(datasource): change datasource result type to event-stream 10 months ago
jyong 7c41f71248 r2 10 months ago
W_OOD 0476937f55
fix(agent_node):Fix spelling errors. (#21094) 10 months ago
-LAN- 0dcacdf83d
feat: add a flask_context_manager. (#21061)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 1d2ee9020c r2 10 months ago
Dongyu Li f37e28a368 feat(datasource): Comment out the datasource_file_manager. 10 months ago
Dongyu Li c5976f5a09 feat(datasource): change datasource result type to event-stream 10 months ago
-LAN- 2440ac43b1
fix: Replace GenericProviderID with ToolProviderID (#21064)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 809a0ab6bf
chore: bump version to 1.4.3 (#21045)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong b277acc298 Merge branch 'main' into feat/r2 10 months ago
jyong 8d47d8ce4f Merge remote-tracking branch 'origin/feat/r2' into feat/r2
# Conflicts:
#	api/core/datasource/website_crawl/website_crawl_plugin.py
#	api/services/rag_pipeline/rag_pipeline.py
10 months ago
jyong 41fef8a21f r2 10 months ago
yihong 909259da37
fix: delete some dead code using vulture (#20999)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
10 months ago
Bowen Liang 366ddb05ae
test: run vdb test of oceanbase with docker compose in CI tests (#20945) 10 months ago
徐海兴 f6aa2498a3
document indexing not bound to a Session (#21015)
Co-authored-by: xuhaixing <xuhaixing@itiger.com>
10 months ago
Harry 5ccb8d9736 feat: online document 10 months ago
Harry 0908f310fc feat: webcrawl 10 months ago
quicksand 3a628bc671
chore: app info add author_name (#20973) 10 months ago
sayThQ199 175571e740
fix(auth): Clear login rate limit after password reset (#20948) 10 months ago
jyong b2b95412b9 r2 10 months ago
-LAN- c05e47ebc0
refactor(sqlalchemy_workflow_execution_repository): Use the max funtion for getting next_sequence_number. (#20966) 10 months ago
Takuya Ono af83120832
🐛 Fix(Gemini LLM): Support Gemini 0.2.x plugin on agent app (#20794)
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
10 months ago
-LAN- 1e03c97663
fix(llm_node): missing parameters for structure outputs (#20915)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong da3a3ce165 r2 10 months ago
jyong 14dc3e8642 r2 10 months ago
jyong 9eb8597957 r2 10 months ago
jyong 1d8b390584 Merge branch 'main' into feat/r2
# Conflicts:
#	docker/docker-compose.middleware.yaml
10 months ago
jyong 5f08a9314c r2 10 months ago
湛露先生 41e3ecc837
fix remote ip header CF-Connecting-IP (#20846) 10 months ago
jyong 66fa68fa18 r2 10 months ago
-LAN- acb2488fc8
chore(package): Bump version to 1.4.2 (#20897)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Yeuoly d6d8cca053
refactor: replace compact response generation with length-prefixed response for backwards invocation api (#20903) 10 months ago
jyong a6f7560d2f r2 10 months ago
jyong 874e1bc41d r2 10 months ago
jyong 2972a06f16 r2 10 months ago
Bowen Liang 0f3d4d0b6e
chore: bump mypy to 1.16 (#20608) 10 months ago
jyong 127a77d807 r2 10 months ago
jyong 95a24156de r2 10 months ago
jyong e934503fa0 r2 10 months ago
jyong 80b219707e r2 10 months ago
Jyong 21a50e22d2
fix auto metadata filter (#20845) 10 months ago
jyong 58b5daeef3 r2 10 months ago
jyong a7ff2ab470 r2 10 months ago
jyong 4d967544f3 r2 10 months ago
QuantumGhost c439e82038
refactor(api): Decouple `ParameterExtractorNode` from `LLMNode` (#20843)
- Extract methods used by `ParameterExtractorNode` from `LLMNode` into a separate file.
- Convert `ParameterExtractorNode` into a subclass of `BaseNode`.
- Refactor code referencing the extracted methods to ensure functionality and clarity.
- Fixes the issue that `ParameterExtractorNode` returns error when executed.
- Fix relevant test cases.

Closes #20840.
10 months ago
jyong 65873aa411 r2 10 months ago
jyong c0d3452494 r2 10 months ago
jyong ad3d9cf782 r2 10 months ago
QuantumGhost a97ff587d2
fix(api): Resolve error encountered when executing `QuestionClassifieNode` (#20829)
The `QuestionClassifierNode` class extends `LLMNode`, meaning that, per the Liskov Substitution Principle, `QuestionClassifierNodeData` **SHOULD** be compatible in contexts where `LLMNodeData` is expected.

However, the absence of the `structured_output_enabled` attribute violates this principle, causing `QuestionClassifierNode` to fail during execution.

This commit implements a quick and temporary workaround. A proper resolution would involve refactoring to decouple `QuestionClassifierNode` from `LLMNode` to address the underlying design issue.

Fixes #20725.
10 months ago
Xiyuan Chen 0720bc7408
Feat/webapp verified sso main (#20494) 10 months ago
jyong 47664f8fd3 r2 10 months ago
yihong 65c7c01d90
fix: clean up two unreachable code (#20773)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
10 months ago
Bharat Ramanathan e6e76852d5
Add support for W&B dedicated cloud instances in Weave tracing integration (#20765)
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
QuantumGhost 930c4cb609
feat(api): Adjust `WorkflowDraftVariable` and `WorkflowNodeExecutionModel` (#20746)
- Add `node_execution_id` column to `WorkflowDraftVariable`, allowing efficient implementation of 
  the "Reset to last run value" feature.
- Add additional index for `WorkflowNodeExecutionModel` to improve the performance of last run lookup.

Closes #20745.
10 months ago
jyong fcbd5febeb r2 10 months ago
jyong 21a3509bef r2 10 months ago
jefferyvvv 37c3283450
fix: opensearch vector search falls back to keyword search (#20723)
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
10 months ago
jyong 1aa13bd20d r2 10 months ago
jyong d2d5fc62ae r2 10 months ago
jyong 0ca38d8215 r2 10 months ago
jyong d2750f1a02 r2 10 months ago
Bowen Liang c1a13fa553
chore: replace pseudo-random generators with secrets module (#20616) 10 months ago
jyong 70432952fd r2 10 months ago
jefferyvvv 4271602cfc
fix: opensearch metadata filtering returns empty (#20701)
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago
Bowen Liang 4f14d7c0ca
chore: bump uv to 0.7.x (#20692) 10 months ago
Yeuoly 38554c5f3e
fix(inner_api/plugin/wraps): refresh user model after creation in get user function (#20704) 10 months ago
jefferyvvv 138ad6e8b3
fix: opensearch fulltext search with metadata filtering dsl error (#20702)
Co-authored-by: wenjun.gu <wenjun.gu@envision-energy.com>
10 months ago
湛露先生 f76f70f0b6
Fix builtin_providers for tools. (#20697)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
10 months ago
jyong b8ef1d9585 r2 10 months ago
jyong c084b57933 r2 10 months ago
HaiyangP 3fb9b41fe5
A more concise and effective extractor for excel and csv files (#20625)
Co-authored-by: haiyangpengai <xxxx>
10 months ago
jyong 9e84a5321d r2 10 months ago
jyong 8a86a2c817 r2 10 months ago
jyong 3e0a10b7ed r2 10 months ago
jyong 5fe5da7c1d r2 10 months ago
Eric Guo 822298f69d
Fix 500 error (#20614) 10 months ago
Arcaner ad2f25875e
fix(llm_node): update file variable mapping to use vision configs (#20417) 10 months ago
Abdullah AlOsaimi ad8e79c440
assign dataset indexing_technique to args if not explicitly provided (#20597) 10 months ago
-LAN- 5ccfb1f4ba
refactor: Improve model status handling and structured output (#20586)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Dongyu Li 92614765ff
Feat/queue monitor (#20647) 10 months ago
jyong fbca9010f3 r2 10 months ago
jyong 8a147a00e8 r2 10 months ago
jyong a82ab1d152 r2 10 months ago
jyong 133193e7d0 r2 10 months ago
jyong c09c8c6e5b r2 10 months ago
Abdullah AlOsaimi 006496f24e
raise error when process_rule is required but missing (#20599) 10 months ago
kenwoodjw 01d500db14
fix: autocorrect everything in web (#20605)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
10 months ago
Novice 4ac3600f81
fix: update app tag error (#20618) 10 months ago
jyong abcca11479 r2 10 months ago
jyong 9cdd2cbb27 r2 10 months ago
jyong 309fffd1e4 Merge branch 'main' into feat/r2
# Conflicts:
#	api/core/repositories/sqlalchemy_workflow_node_execution_repository.py
#	api/core/workflow/entities/node_entities.py
#	api/core/workflow/enums.py
10 months ago
-LAN- 275e86a26c
refactor: Removes tenant ID check from rate limit logic (#20585)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 4130c50643 r2 10 months ago
非法操作 ca0b268ae5
fix: variable aggregator with group and file raise exception (#20581) 10 months ago
jyong 7b7f8ef51d r2 10 months ago
Bowen Liang 888cd86afd
chore: prepare the plugin daemon base url to yarl URL ahead intstead of in every invocation (#20541) 10 months ago
jyong 573cd15e77 r2 10 months ago
jyong ab1730bbaa r2 10 months ago
Anshuman Saini e40e9db39a
fixes #19634 (#20545) 10 months ago
-LAN- 36f1b4b222
fix: Ensure model config integrity in retrieval processes (#20576)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 257bf13fef
refactor: Removes unused LLMMode value_of method (#20575)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 957f5b212e
fix: Upgrade Flask-Cors (#20577)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 72fdafc180
refactor: Replaces direct DB session usage with context managers (#20569)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 270edd43ab r2 10 months ago
jyong b8f3b23b1a r2 10 months ago
jyong 0486aa3445 r2 10 months ago
zhaobingshuang 3f7aa38d77
fix: #20560 When elasticsearch is used as the vector database, the Retrieval Test fails to filter the data after setting the Score Threshold, and the score of the recalled results is empty (#20561) 10 months ago
Contrail a145c2a8fe
fix: ensure proper conversation role alternation for vLLM (#18837) 10 months ago
不如归去 c29cb503be
Fix #20536: Force header in custom tool be string (#20537)
Co-authored-by: Peter Xin <iami@Artemis.local>
10 months ago
不如归去 8025ad0661
Fixes #20534: Allow $ref in parameter for custom tools (#20535)
Co-authored-by: Peter Xin <iami@Artemis.local>
10 months ago
Cheney Zhang b4b59148dc
check zilliz cloud of full-text search (#20519) 10 months ago
湛露先生 b33f8b47ca
nacos config init , and force add ts parms. (#20526)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
10 months ago
kurokobo c26e1929d6
fix(housekeeping): exclude files that are used as app icons or avatar images from being removed (#20532) 10 months ago
jyong 3fb02a7933 r2 10 months ago
-LAN- 92528360f9
fix: fetch tenant_id in other trace providers besides langfuse (#20495)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 631768ea1d r2 10 months ago
Ganondorf 51f64797cd
Add APIs for Knowledge Base Tag Management and Dataset Binding (#20023)
Co-authored-by: lizb <lizb@sugon.com>
10 months ago
Dongyu Li 1ea4459d9f
update knowledge base api (#20426) 10 months ago
Yasuhiro Ohno 55371e5abf
Improve CONVERSATION_TITLE_PROMPT to correctly handle Japanese and input (#20351) 10 months ago
Jyong fb12a3033d
fix celery job not closed issue (#19268) 10 months ago
-LAN- a6ea15e63c
Refactor/message cycle manage and knowledge retrieval (#20460)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
yihong 5a991295e0
fix: drop some type fixme (#20344) 10 months ago
-LAN- db488bef51
refactor(api/core/workflow/enums): Rename WORKFLOW_RUN_ID to WORKFLOW_EXECUTION_ID (#20459)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- f2e0d161a1
fix(ops_trace_manager): Adds app_id to TraceTask initialization (#20461)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 2ebf4e767b
fix(models): WorkflowRun's total_steps and exceptions_count mismatch with database (#20452)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- f7fb10635f
refactor(workflow): Rename workflow node execution models (#20458)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 32e779eef3
refactor(workflow): Rename NodeRunMetadataKey to WorkflowNodeExecutionMetadataKey (#20457)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 482e50aae9
Refactor/remove db from cycle manager (#20455)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- cd0a05f114
tests: Removes outdated marketplace download test (#20454)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 976b465e76 r2 10 months ago
jyong 804e55824d r2 10 months ago
jyong 69529fb16d r2 10 months ago
jyong cb5cfb2dae r2 10 months ago
jyong a826879cf7 Merge branch 'main' into feat/r2 10 months ago
jyong e7c48c0b69 r2 10 months ago
Yeuoly d4408e0f54
fix: handle values in output arrays for CodeNode transformation (#20437) 10 months ago
Bowen Liang eee88a8012
chore: improve error logging for requests to plugin daemon (#20328) 10 months ago
quicksand 2d4f8f1377
fix: apps/annotation missing 1 required positional argument: 'end_user' (#20428) 10 months ago
jyong a025db137d Merge branch 'main' into feat/r2 10 months ago
jyong 797d044714 r2 10 months ago
Novice b2ab401279
chore: remove agent turn limits (#19930) 10 months ago
Novice 9bbd646f40
fix: inner invoke llm token too long (#20391) 10 months ago
-LAN- c3c67d9608
fix: register user model to current_user in backward invoke. (#20374)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- f59fb94dae
feat(agent_node): ensure that the enum-checking syntax is compatible with Python 3.11. (#20373)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
jyong 7f59ffe7af r2 10 months ago
teawoong Kim 400ae664bb
fix(http): force multipart/form-data even without files(#20322) (#20323) 10 months ago
-LAN- eaaf551497
fix: Instance <Account> is not bound to a Session (#20347)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- f233a64eb5
fix(workflow): fetch user failed when workflow run in parallel mode (#20321)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
AichiB7A 2b81b6673f
[Observability] Add type check and try-except in otel (#20319) 10 months ago
-LAN- 4c46f04d77
fix: Enhances tenant ID handling in telemetry (#20304)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- fe01de5667
chore(*): Bump version to 1.4.1 (#20275)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 275b042998
chore(remove_app_and_related_data_task): Revert `_delete_app_workflow_node_executions` (#20278)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
rouxiaomin 4c4887c5fc
feat(qdrant):add replication_factor when create collection in qdrant (#20133)
Co-authored-by: 刘敏 <min.liu@tongdun.net>
10 months ago
Mio Inamijima 0ebaba98f0
fix: dataset permission check for partial team members (#19249) (#20242)
Co-authored-by: MioINAMIJIMA <m.inamijima@optimaize-consulting.com>
10 months ago
-LAN- d3bfcd498b
fix: Refactor web reader to use readabilipy (#19789)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
-LAN- 9c9d3d7bd0
feat: document extractor chardet encoding (#20269)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Good Wood 756f35f480
feat: add pagination for plugin page (#20151) 10 months ago
-LAN- 55503ce771
fix: persist workflow execution status on partial success and failure (#20264)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Dongyu Li c57726a587
fix[cve]: update qdrant-client from 1.7.3 to 1.9.0 (#20231) 10 months ago
-LAN- b357eca307
fix: Copy request context and current user in app generators. (#20240)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
非法操作 acd4b9a8ac
fix: not save workflow_run_id of chatflow message (#20257) 10 months ago
jyong 5fc2bc58a9 r2 10 months ago
-LAN- f21e6e03a3
refactor: Consolidate Flask-Login Authentication Logic (#20235)
Signed-off-by: -LAN- <laipz8200@outlook.com>
10 months ago
Good Wood 6f982eb7e4
feat: add author_name for app list card (#16900)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
10 months ago
cooper.wu 2cad98f01f
fix: #18132 when deepseek llm model, auto_generate name can't work (#18646)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
10 months ago
Yeuoly 83ca7f8deb feat: add datasource support to PluginDeclaration and PluginCategory 10 months ago
jyong 678d6ffe2b r2 10 months ago
Heyang Wang b9b5d43dc6
fix: add 'floatfmt' when extract number from excel ( #20153 ) (#20193)
Co-authored-by: wangheyang <wangheyang@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
10 months ago