Commit Graph

3801 Commits (c67a7abbe244cba2f83dbcadfbfee47a897fbecf)

Author SHA1 Message Date
QuantumGhost 55eb4765cb refactor(api): Rename `output` parameter of `save` method to `outputs`.
Keep the parameter names consistent with the field names `NodeRunResult`.
1 year ago
QuantumGhost e8de080add fix(api): fix incorrect adjust to Extensible
`__file__` records the path of the `Extensible` class, not the receiver class
of `scan_extensions` method.

This commit fixes this by switching to `inspect.getfile`.
1 year ago
QuantumGhost 312601e964 feat(api): implement flies handling for `DraftWorkflowNodeRunApi`
Add TODOs to existing file parsing logic.
1 year ago
QuantumGhost 2edc837585 fix(api): adjust `UpdatedVariable` handling
It's impossible to use Pydantic to restore subclasses of
`Segment` from serialized dictionary (using discriminated
union does not help, neither.)

So migrate to save `variable_type` and `new_value`
separately, instead of store it altogether as a `Segment`
class.
1 year ago
QuantumGhost 83d6a5e92a fix(api): fix the issue that prefilled conv var not commited 1 year ago
-LAN- 5ccfb1f4ba
refactor: Improve model status handling and structured output (#20586)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Dongyu Li 92614765ff
Feat/queue monitor (#20647) 1 year ago
QuantumGhost eeab59215a test(api): Add tests for variable codec in WorkflowDraftVariable. 1 year ago
Abdullah AlOsaimi 006496f24e
raise error when process_rule is required but missing (#20599) 1 year ago
kenwoodjw 01d500db14
fix: autocorrect everything in web (#20605)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
1 year ago
Novice 4ac3600f81
fix: update app tag error (#20618) 1 year ago
QuantumGhost 9c0bbb2d2d fix(api): Fix _should_variable_be_visible, removed unused tests 1 year ago
QuantumGhost 9dcf410fd2 chore(api): fix mypy violation for `scoped_session`. 1 year ago
QuantumGhost 2db269da95 chore(api): Rename import for `NodeRunMetadataKey`.
`NodeRunMetadataKey` has been renamed to
`WorkflowNodeExecutionMetadataKey`.
1 year ago
QuantumGhost ffa9bc8998 feat(api): set `last_edited_at` to `None` after resetting 1 year ago
QuantumGhost a002b5f000 fix(api): Fix duplicated resource name issue 1 year ago
QuantumGhost 18d681db52 fix(api): Fix the issue that conversation variable saving not working 1 year ago
-LAN- 275e86a26c
refactor: Removes tenant ID check from rate limit logic (#20585)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
非法操作 ca0b268ae5
fix: variable aggregator with group and file raise exception (#20581) 1 year ago
QuantumGhost ea67a96d81 Merge remote-tracking branch 'upstream/main' into feat/variable-pool-rebased 1 year ago
QuantumGhost 9a26211cbf feat(api): implement conversation variable reset api. 1 year ago
QuantumGhost c604659287 feat(api): Update variable handling for `VariableAssigner` nodes
- Put updated variables data in `process_data`
- Use structured object to describe updated variables.
1 year ago
QuantumGhost a3202356e6 fix(api): correct path retrieval in scan_extensions method
The previous does not work when `cwd` is not `api`, switching to
`__file__` fixes this.
1 year ago
QuantumGhost 03f91daa27 feat(api): implement PydanticModelEncoder for JSON serialization
Use `PydanticModelEncoder` for JSON serialization while persisting
node execution data.
1 year ago
QuantumGhost 77ec5f3f68 chore(api): fix mypy typing issues, remove debugging code 1 year ago
QuantumGhost 9e17eb39e2 chore(api): Fix scoped session typing issue 1 year ago
Bowen Liang 888cd86afd
chore: prepare the plugin daemon base url to yarl URL ahead intstead of in every invocation (#20541) 1 year ago
Anshuman Saini e40e9db39a
fixes #19634 (#20545) 1 year ago
-LAN- 36f1b4b222
fix: Ensure model config integrity in retrieval processes (#20576)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 257bf13fef
refactor: Removes unused LLMMode value_of method (#20575)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 957f5b212e
fix: Upgrade Flask-Cors (#20577)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 72fdafc180
refactor: Replaces direct DB session usage with context managers (#20569)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
zhaobingshuang 3f7aa38d77
fix: #20560 When elasticsearch is used as the vector database, the Retrieval Test fails to filter the data after setting the Score Threshold, and the score of the recalled results is empty (#20561) 1 year ago
Contrail a145c2a8fe
fix: ensure proper conversation role alternation for vLLM (#18837) 1 year ago
QuantumGhost e8ec9112b4 fix(api): Fix the issue that output is not saved ...
when using `Default Value` error handling strategy

refactor draft variable saving logic into a separate method.
1 year ago
不如归去 c29cb503be
Fix #20536: Force header in custom tool be string (#20537)
Co-authored-by: Peter Xin <iami@Artemis.local>
1 year ago
不如归去 8025ad0661
Fixes #20534: Allow $ref in parameter for custom tools (#20535)
Co-authored-by: Peter Xin <iami@Artemis.local>
1 year ago
Cheney Zhang b4b59148dc
check zilliz cloud of full-text search (#20519) 1 year ago
QuantumGhost 72561300ec feat(api): Prefill conversation variables in draft workflow and update related services 1 year ago
QuantumGhost 43cae8fc0b fix(api): update `last_edited_at` when updating a draft variable 1 year ago
QuantumGhost 61840f64b3 feat(api): Add `fallback_variables` support for DraftVarLoader. 1 year ago
QuantumGhost d43ebabbbc fix(api): Fix TypeError while serializing File object 1 year ago
湛露先生 b33f8b47ca
nacos config init , and force add ts parms. (#20526)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
1 year ago
kurokobo c26e1929d6
fix(housekeeping): exclude files that are used as app icons or avatar images from being removed (#20532) 1 year ago
-LAN- 92528360f9
fix: fetch tenant_id in other trace providers besides langfuse (#20495)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Ganondorf 51f64797cd
Add APIs for Knowledge Base Tag Management and Dataset Binding (#20023)
Co-authored-by: lizb <lizb@sugon.com>
1 year ago
Dongyu Li 1ea4459d9f
update knowledge base api (#20426) 1 year ago
Yasuhiro Ohno 55371e5abf
Improve CONVERSATION_TITLE_PROMPT to correctly handle Japanese and input (#20351) 1 year ago
Jyong fb12a3033d
fix celery job not closed issue (#19268) 1 year ago
-LAN- a6ea15e63c
Refactor/message cycle manage and knowledge retrieval (#20460)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
yihong 5a991295e0
fix: drop some type fixme (#20344) 1 year ago
-LAN- db488bef51
refactor(api/core/workflow/enums): Rename WORKFLOW_RUN_ID to WORKFLOW_EXECUTION_ID (#20459)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- f2e0d161a1
fix(ops_trace_manager): Adds app_id to TraceTask initialization (#20461)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 2ebf4e767b
fix(models): WorkflowRun's total_steps and exceptions_count mismatch with database (#20452)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- f7fb10635f
refactor(workflow): Rename workflow node execution models (#20458)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 32e779eef3
refactor(workflow): Rename NodeRunMetadataKey to WorkflowNodeExecutionMetadataKey (#20457)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 482e50aae9
Refactor/remove db from cycle manager (#20455)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- cd0a05f114
tests: Removes outdated marketplace download test (#20454)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Yeuoly d4408e0f54
fix: handle values in output arrays for CodeNode transformation (#20437) 1 year ago
Bowen Liang eee88a8012
chore: improve error logging for requests to plugin daemon (#20328) 1 year ago
quicksand 2d4f8f1377
fix: apps/annotation missing 1 required positional argument: 'end_user' (#20428) 1 year ago
Novice b2ab401279
chore: remove agent turn limits (#19930) 1 year ago
Novice 9bbd646f40
fix: inner invoke llm token too long (#20391) 1 year ago
QuantumGhost 7a382a35b4 feat(api): simplify gevent setup logic 1 year ago
QuantumGhost 6df77c7ae2 feat(api): add support for conversation input fields in draft node run api 1 year ago
QuantumGhost ae53286bcc feat(api): add support for conversation input fields in draft node run api 1 year ago
QuantumGhost 4c7873bdd9 feat(api): inject the variable_loader all the way down for loop & iteration
# Conflicts:
#	api/core/app/apps/advanced_chat/app_generator.py
#	api/core/app/apps/workflow/app_generator.py
1 year ago
QuantumGhost 31fa5baadf feat(api): overhaul draft variable saving logic
add support for many node types
1 year ago
QuantumGhost 29bc0d5000 feat(api): Add a method for extract a node configration from workflow 1 year ago
QuantumGhost 7c632bdea9 docs(api): Add a comment about repetitive json loading in `Workflow.graph_dict` 1 year ago
QuantumGhost cf034b53e0 feat(api): Move DummyLoader from workflow_entry to variable_loader
add a utility function for variable loading logic.
1 year ago
QuantumGhost 710d729b4b feat(api): Add a dummy `VariableLoader`, add a utility function
for variable loading logic.
1 year ago
QuantumGhost d720287504 feat(api): utilize `ConversationVariableUpdater` in variable assigner nodes
Removed the original logic
1 year ago
QuantumGhost 1b234de81f feat(api): Implement variable mapping extraction for VariableAssignerNode 1 year ago
QuantumGhost b376f7aeec feat(api): include the loop variables in extracted variable mappings 1 year ago
QuantumGhost 253978b8df docs(api): Update docs for `extract_variable_selector_to_variable_mapping` 1 year ago
QuantumGhost c1313dd914 test(api): add tests for `VariablePool` construction 1 year ago
QuantumGhost fd38cfd6b2 chore(api): remove the constructor for `VariablePool`
Replace it with `model_post_init` as suggested by
Pydantic docs.
1 year ago
QuantumGhost c730f0fcf2 test(api): Add some tests for DraftVariable related code 1 year ago
QuantumGhost 7165333468 feat(api): Add some utility functions for working with generators 1 year ago
QuantumGhost 701d659f54 fix(api): Fix input variable handling for `Start` node. 1 year ago
QuantumGhost ed4b072467 feat(api): Implement VariableLoader in `DraftVarLoader`.
Use DraftVarLoader to load required variables when single stepping a
node.
1 year ago
QuantumGhost b7a4117341 feat(api): Introduce a VariableLoader interface.
The `VariableLoader` interface is used to load referenced variables
when running a single node.
1 year ago
QuantumGhost d83c8ade4a feat(api): Implement variable mapping extraction for `IfElseNode`
This allows us to extract referenced variables from `IfElseNode` configurations.
1 year ago
QuantumGhost c4e7489be5 docs(api): Add documentation for `extract_variable_selector_to_variable_mapping`
Add a detail description about the arguments and
the return value of
`BaseNode.extract_variable_selector_to_variable_mapping`.
1 year ago
QuantumGhost 85ab1dc8d9 fix(api): Fix incorrect handling of `Variable` types in `VariablePool` 1 year ago
QuantumGhost 7ee95dbc1c docs(api): Add a documentation about equality of `FloatSegment` 1 year ago
QuantumGhost 325b737f09 fix(api): Fix incorrect variable name for sys var. 1 year ago
QuantumGhost 5aa044e392 feat(api): implement draft var related api 1 year ago
QuantumGhost c7e6b9ce9c feat(api): save output variables to draft variables while debugging workflow 1 year ago
QuantumGhost 655d55f290 feat(api): add a `version` class method to BaseNode and subclasses
This ensures that we can get the version of node while executing.

Add `node_version` to `BaseNodeEvent` to ensure that all node
related events includes node version information.
1 year ago
QuantumGhost 1fbeb8d9bf feat(api): Save output variables as draft variables in single stepping 1 year ago
QuantumGhost 254324cd6c feat(api): Save output variables as draft variables in single stepping 1 year ago
QuantumGhost 9650ade7fb feat(api): Implement WorkflowDraftService 1 year ago
QuantumGhost 0d5a0a4b24 feat(api): add an API to retrieve the last execution of a given node. 1 year ago
-LAN- c3c67d9608
fix: register user model to current_user in backward invoke. (#20374)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- f59fb94dae
feat(agent_node): ensure that the enum-checking syntax is compatible with Python 3.11. (#20373)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
teawoong Kim 400ae664bb
fix(http): force multipart/form-data even without files(#20322) (#20323) 1 year ago
-LAN- eaaf551497
fix: Instance <Account> is not bound to a Session (#20347)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- f233a64eb5
fix(workflow): fetch user failed when workflow run in parallel mode (#20321)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
AichiB7A 2b81b6673f
[Observability] Add type check and try-except in otel (#20319) 1 year ago
-LAN- 4c46f04d77
fix: Enhances tenant ID handling in telemetry (#20304)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- fe01de5667
chore(*): Bump version to 1.4.1 (#20275)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 275b042998
chore(remove_app_and_related_data_task): Revert `_delete_app_workflow_node_executions` (#20278)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
rouxiaomin 4c4887c5fc
feat(qdrant):add replication_factor when create collection in qdrant (#20133)
Co-authored-by: 刘敏 <min.liu@tongdun.net>
1 year ago
Mio Inamijima 0ebaba98f0
fix: dataset permission check for partial team members (#19249) (#20242)
Co-authored-by: MioINAMIJIMA <m.inamijima@optimaize-consulting.com>
1 year ago
-LAN- d3bfcd498b
fix: Refactor web reader to use readabilipy (#19789)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 9c9d3d7bd0
feat: document extractor chardet encoding (#20269)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Good Wood 756f35f480
feat: add pagination for plugin page (#20151) 1 year ago
-LAN- 55503ce771
fix: persist workflow execution status on partial success and failure (#20264)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Dongyu Li c57726a587
fix[cve]: update qdrant-client from 1.7.3 to 1.9.0 (#20231) 1 year ago
-LAN- b357eca307
fix: Copy request context and current user in app generators. (#20240)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
非法操作 acd4b9a8ac
fix: not save workflow_run_id of chatflow message (#20257) 1 year ago
-LAN- f21e6e03a3
refactor: Consolidate Flask-Login Authentication Logic (#20235)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Good Wood 6f982eb7e4
feat: add author_name for app list card (#16900)
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
1 year ago
cooper.wu 2cad98f01f
fix: #18132 when deepseek llm model, auto_generate name can't work (#18646)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
1 year ago
Heyang Wang b9b5d43dc6
fix: add 'floatfmt' when extract number from excel ( #20153 ) (#20193)
Co-authored-by: wangheyang <wangheyang@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
非法操作 9b1dc1de7a
fix: system file upload can't export custom file types (#20122) 1 year ago
Boris Feld c939f04b1a
Add support for tracking conversation with Opik Tracer (#20063) 1 year ago
Boris Feld 9afd7f6c87
chore: Update S3StorageConfig to match boto3 type hints (#20072) 1 year ago
jameshui1997 648393cc7b
fix: improve tracing provider validation logic in OpsTraceManager (#20042) 1 year ago
He Huang 6f48af2610
Refactor OpenSearch config to separate use_ssl and verify_certs flags (#20075)
Co-authored-by: he.huang <he.huang1@outlook.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
zhudongwork adca981eee
fix: uninitialized variable error on empty knowledge retrieval(agent) (#20025)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
GonzaHM 38b1e46241
fix: correct indentation in dataset retrieval model assignment (#20040) 1 year ago
-LAN- 6b3666f826
feat: Split WorkflowCycleManager (#20071)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
heyszt 02929b2cce
Fix/fix trace provider delete err (#20070) 1 year ago
-LAN- d31235ca13
feat: Introduce WorkflowExecution Domain Entity and Repository, Replace WorkflowRun Direct Usage, and Unify Stream Response Logic (#20067)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
wlleiiwang 7d230acf40
tencent vectordb compatible with version 1.1.3 and below (#20056)
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
1 year ago
QuantumGhost 13dc1c8795
Simplify `execution_metadata` Handling for `WorkflowNodeExecution` (#20062)
Currently, `WorkflowNodeExecution.execution_metadata_dict` returns `None` when metadata is absent in the database. This requires all callers to perform `None` checks when processing metadata, leading to more complex caller-side logic.

This pull request updates the `execution_metadata_dict` method to return an empty dictionary instead of `None` when metadata is absent. This change would simplify the caller logic, as it removes the need for explicit `None` checks and provides a more consistent data structure to work with.
1 year ago
-LAN- 57bcb616bc
fix(sqlalchemy_workflow_node_execution_repository): Missing `triggered_from` while querying WorkflowNodeExecution (#20044)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 3196dc2d61
refactor: Use typed SQLAlchemy base model and fix type errors (#19980)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Panpan ef3569e667
feat: support chatflow start node custom input field hidden (#19678) 1 year ago
俊晨 36b321735e
fix create_tracing_app_config error (#19884) (#20004)
Co-authored-by: codly <codly.fun@gmail.com>
1 year ago
crazywoola d35d854259
Revert "fix: fix duplicate app lose custom image" (#19995) 1 year ago
luckylhb90 c58678d84d
chore: Reduce the invocation of the plugin interface (#19629)
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
CorrectRoad 618981f1ae
fix: fix duplicate app lose custom image (#19775) 1 year ago
Zihe JI 87f9d11d65
fix: ensure Decimal values in metadata are JSON serializable (fixes #19936) (#19955)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Darlewo 8cb3b4aef2
fix: multiple retrieve reranking_enabled switch (#19958) 1 year ago
NFish d186daa131
E-300 (#19726)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Hash Brown <hi@xzd.me>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: GareArc <chen4851@purdue.edu>
Co-authored-by: Byron.wang <byron@dify.ai>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Garfield Dai <dai.hai@foxmail.com>
Co-authored-by: KVOJJJin <jzongcode@gmail.com>
Co-authored-by: Alexi.F <654973939@qq.com>
Co-authored-by: Xiyuan Chen <52963600+GareArc@users.noreply.github.com>
Co-authored-by: kautsar_masuara <61046989+izon-masuara@users.noreply.github.com>
Co-authored-by: achmad-kautsar <achmad.kautsar@insignia.co.id>
Co-authored-by: Xin Zhang <sjhpzx@gmail.com>
Co-authored-by: kelvintsim <83445753+kelvintsim@users.noreply.github.com>
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
Co-authored-by: Zixuan Cheng <61724187+Theysua@users.noreply.github.com>
1 year ago
Raina Otoni 6a8ca8296b
chore: update redis dependency to version 6.1.0 in api/pyproject.toml (#19885) 1 year ago
crazywoola 7ae529c3b0
Revert "chore: upgrade Redis from v6 to v7 in middlewares" (#19960) 1 year ago
湛露先生 911f9eadd0
fix model workflow_draft_variables duplicate app_id set. (#19949)
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
1 year ago
Amir Mohsen Asaran c9ee60e197
Feat(WaterCrawl error handling): add custom exceptions and error handling (#19948) 1 year ago
Bowen Liang a18a6f50ab
chore: upgrade Redis from v6 to v7 in middlewares (#19935) 1 year ago
QuantumGhost 6a9e0b1005
feat(api): Introduce `WorkflowDraftVariable` Model (#19737)
- Introduce `WorkflowDraftVariable` model and the corresponding migration.
- Implement `EnumText`,  a custom column type for SQLAlchemy designed
  to work seamlessly with enumeration classes based on `StrEnum`.
1 year ago
非法操作 bbebf9ad3e
fix: db_model save to _node_execution_cache (#19911) 1 year ago
heyszt 11146b6bae
fix create_tracing_app_config error (#19884) 1 year ago
Hashcon 6a74c97a0a
feat: add debug log for request and response (#19781) (#19783)
Co-authored-by: hashjang <hash@geek.com>
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
1 year ago
-LAN- e0e8cd6ca3
feat(DraftWorkflowApi): Requires environment_variables in DraftWorkflowApi (#19849)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 7d0106b220
fix: correct type mismatch in WorkflowService node execution handling (#19846)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago