Commit Graph

2502 Commits (c67a7abbe244cba2f83dbcadfbfee47a897fbecf)

Author SHA1 Message Date
QuantumGhost fd208c4035 docs(api): add note to avoid using `handle_special_values` in new code 1 year ago
QuantumGhost 743b792869 feat(api): reconstruct File object from dictionary when saving outputs.
This ensures that the variables type is correct. It also simplify handling of variable
values when serializing.
1 year ago
QuantumGhost 55eb4765cb refactor(api): Rename `output` parameter of `save` method to `outputs`.
Keep the parameter names consistent with the field names `NodeRunResult`.
1 year ago
QuantumGhost e8de080add fix(api): fix incorrect adjust to Extensible
`__file__` records the path of the `Extensible` class, not the receiver class
of `scan_extensions` method.

This commit fixes this by switching to `inspect.getfile`.
1 year ago
QuantumGhost 312601e964 feat(api): implement flies handling for `DraftWorkflowNodeRunApi`
Add TODOs to existing file parsing logic.
1 year ago
QuantumGhost 2edc837585 fix(api): adjust `UpdatedVariable` handling
It's impossible to use Pydantic to restore subclasses of
`Segment` from serialized dictionary (using discriminated
union does not help, neither.)

So migrate to save `variable_type` and `new_value`
separately, instead of store it altogether as a `Segment`
class.
1 year ago
-LAN- 5ccfb1f4ba
refactor: Improve model status handling and structured output (#20586)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
kenwoodjw 01d500db14
fix: autocorrect everything in web (#20605)
Signed-off-by: kenwoodjw <blackxin55+@gmail.com>
1 year ago
QuantumGhost 2db269da95 chore(api): Rename import for `NodeRunMetadataKey`.
`NodeRunMetadataKey` has been renamed to
`WorkflowNodeExecutionMetadataKey`.
1 year ago
QuantumGhost 18d681db52 fix(api): Fix the issue that conversation variable saving not working 1 year ago
-LAN- 275e86a26c
refactor: Removes tenant ID check from rate limit logic (#20585)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
非法操作 ca0b268ae5
fix: variable aggregator with group and file raise exception (#20581) 1 year ago
QuantumGhost ea67a96d81 Merge remote-tracking branch 'upstream/main' into feat/variable-pool-rebased 1 year ago
QuantumGhost 9a26211cbf feat(api): implement conversation variable reset api. 1 year ago
QuantumGhost c604659287 feat(api): Update variable handling for `VariableAssigner` nodes
- Put updated variables data in `process_data`
- Use structured object to describe updated variables.
1 year ago
QuantumGhost a3202356e6 fix(api): correct path retrieval in scan_extensions method
The previous does not work when `cwd` is not `api`, switching to
`__file__` fixes this.
1 year ago
QuantumGhost 03f91daa27 feat(api): implement PydanticModelEncoder for JSON serialization
Use `PydanticModelEncoder` for JSON serialization while persisting
node execution data.
1 year ago
QuantumGhost 77ec5f3f68 chore(api): fix mypy typing issues, remove debugging code 1 year ago
QuantumGhost 9e17eb39e2 chore(api): Fix scoped session typing issue 1 year ago
Bowen Liang 888cd86afd
chore: prepare the plugin daemon base url to yarl URL ahead intstead of in every invocation (#20541) 1 year ago
-LAN- 36f1b4b222
fix: Ensure model config integrity in retrieval processes (#20576)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 257bf13fef
refactor: Removes unused LLMMode value_of method (#20575)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 72fdafc180
refactor: Replaces direct DB session usage with context managers (#20569)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
zhaobingshuang 3f7aa38d77
fix: #20560 When elasticsearch is used as the vector database, the Retrieval Test fails to filter the data after setting the Score Threshold, and the score of the recalled results is empty (#20561) 1 year ago
Contrail a145c2a8fe
fix: ensure proper conversation role alternation for vLLM (#18837) 1 year ago
QuantumGhost e8ec9112b4 fix(api): Fix the issue that output is not saved ...
when using `Default Value` error handling strategy

refactor draft variable saving logic into a separate method.
1 year ago
不如归去 c29cb503be
Fix #20536: Force header in custom tool be string (#20537)
Co-authored-by: Peter Xin <iami@Artemis.local>
1 year ago
不如归去 8025ad0661
Fixes #20534: Allow $ref in parameter for custom tools (#20535)
Co-authored-by: Peter Xin <iami@Artemis.local>
1 year ago
Cheney Zhang b4b59148dc
check zilliz cloud of full-text search (#20519) 1 year ago
QuantumGhost 72561300ec feat(api): Prefill conversation variables in draft workflow and update related services 1 year ago
QuantumGhost d43ebabbbc fix(api): Fix TypeError while serializing File object 1 year ago
-LAN- 92528360f9
fix: fetch tenant_id in other trace providers besides langfuse (#20495)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Dongyu Li 1ea4459d9f
update knowledge base api (#20426) 1 year ago
Yasuhiro Ohno 55371e5abf
Improve CONVERSATION_TITLE_PROMPT to correctly handle Japanese and input (#20351) 1 year ago
-LAN- a6ea15e63c
Refactor/message cycle manage and knowledge retrieval (#20460)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
yihong 5a991295e0
fix: drop some type fixme (#20344) 1 year ago
-LAN- db488bef51
refactor(api/core/workflow/enums): Rename WORKFLOW_RUN_ID to WORKFLOW_EXECUTION_ID (#20459)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- f2e0d161a1
fix(ops_trace_manager): Adds app_id to TraceTask initialization (#20461)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- f7fb10635f
refactor(workflow): Rename workflow node execution models (#20458)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 32e779eef3
refactor(workflow): Rename NodeRunMetadataKey to WorkflowNodeExecutionMetadataKey (#20457)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 482e50aae9
Refactor/remove db from cycle manager (#20455)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Yeuoly d4408e0f54
fix: handle values in output arrays for CodeNode transformation (#20437) 1 year ago
Bowen Liang eee88a8012
chore: improve error logging for requests to plugin daemon (#20328) 1 year ago
Novice b2ab401279
chore: remove agent turn limits (#19930) 1 year ago
Novice 9bbd646f40
fix: inner invoke llm token too long (#20391) 1 year ago
QuantumGhost 4c7873bdd9 feat(api): inject the variable_loader all the way down for loop & iteration
# Conflicts:
#	api/core/app/apps/advanced_chat/app_generator.py
#	api/core/app/apps/workflow/app_generator.py
1 year ago
QuantumGhost 31fa5baadf feat(api): overhaul draft variable saving logic
add support for many node types
1 year ago
QuantumGhost cf034b53e0 feat(api): Move DummyLoader from workflow_entry to variable_loader
add a utility function for variable loading logic.
1 year ago
QuantumGhost 710d729b4b feat(api): Add a dummy `VariableLoader`, add a utility function
for variable loading logic.
1 year ago
QuantumGhost d720287504 feat(api): utilize `ConversationVariableUpdater` in variable assigner nodes
Removed the original logic
1 year ago
QuantumGhost 1b234de81f feat(api): Implement variable mapping extraction for VariableAssignerNode 1 year ago
QuantumGhost b376f7aeec feat(api): include the loop variables in extracted variable mappings 1 year ago
QuantumGhost 253978b8df docs(api): Update docs for `extract_variable_selector_to_variable_mapping` 1 year ago
QuantumGhost fd38cfd6b2 chore(api): remove the constructor for `VariablePool`
Replace it with `model_post_init` as suggested by
Pydantic docs.
1 year ago
QuantumGhost ed4b072467 feat(api): Implement VariableLoader in `DraftVarLoader`.
Use DraftVarLoader to load required variables when single stepping a
node.
1 year ago
QuantumGhost b7a4117341 feat(api): Introduce a VariableLoader interface.
The `VariableLoader` interface is used to load referenced variables
when running a single node.
1 year ago
QuantumGhost d83c8ade4a feat(api): Implement variable mapping extraction for `IfElseNode`
This allows us to extract referenced variables from `IfElseNode` configurations.
1 year ago
QuantumGhost c4e7489be5 docs(api): Add documentation for `extract_variable_selector_to_variable_mapping`
Add a detail description about the arguments and
the return value of
`BaseNode.extract_variable_selector_to_variable_mapping`.
1 year ago
QuantumGhost 85ab1dc8d9 fix(api): Fix incorrect handling of `Variable` types in `VariablePool` 1 year ago
QuantumGhost 7ee95dbc1c docs(api): Add a documentation about equality of `FloatSegment` 1 year ago
QuantumGhost 5aa044e392 feat(api): implement draft var related api 1 year ago
QuantumGhost c7e6b9ce9c feat(api): save output variables to draft variables while debugging workflow 1 year ago
QuantumGhost 655d55f290 feat(api): add a `version` class method to BaseNode and subclasses
This ensures that we can get the version of node while executing.

Add `node_version` to `BaseNodeEvent` to ensure that all node
related events includes node version information.
1 year ago
-LAN- f59fb94dae
feat(agent_node): ensure that the enum-checking syntax is compatible with Python 3.11. (#20373)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
teawoong Kim 400ae664bb
fix(http): force multipart/form-data even without files(#20322) (#20323) 1 year ago
-LAN- eaaf551497
fix: Instance <Account> is not bound to a Session (#20347)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- f233a64eb5
fix(workflow): fetch user failed when workflow run in parallel mode (#20321)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
rouxiaomin 4c4887c5fc
feat(qdrant):add replication_factor when create collection in qdrant (#20133)
Co-authored-by: 刘敏 <min.liu@tongdun.net>
1 year ago
-LAN- d3bfcd498b
fix: Refactor web reader to use readabilipy (#19789)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 9c9d3d7bd0
feat: document extractor chardet encoding (#20269)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Good Wood 756f35f480
feat: add pagination for plugin page (#20151) 1 year ago
-LAN- 55503ce771
fix: persist workflow execution status on partial success and failure (#20264)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- b357eca307
fix: Copy request context and current user in app generators. (#20240)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
非法操作 acd4b9a8ac
fix: not save workflow_run_id of chatflow message (#20257) 1 year ago
cooper.wu 2cad98f01f
fix: #18132 when deepseek llm model, auto_generate name can't work (#18646)
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
1 year ago
Heyang Wang b9b5d43dc6
fix: add 'floatfmt' when extract number from excel ( #20153 ) (#20193)
Co-authored-by: wangheyang <wangheyang@corp.netease.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Boris Feld c939f04b1a
Add support for tracking conversation with Opik Tracer (#20063) 1 year ago
jameshui1997 648393cc7b
fix: improve tracing provider validation logic in OpsTraceManager (#20042) 1 year ago
He Huang 6f48af2610
Refactor OpenSearch config to separate use_ssl and verify_certs flags (#20075)
Co-authored-by: he.huang <he.huang1@outlook.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
zhudongwork adca981eee
fix: uninitialized variable error on empty knowledge retrieval(agent) (#20025)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
-LAN- 6b3666f826
feat: Split WorkflowCycleManager (#20071)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
heyszt 02929b2cce
Fix/fix trace provider delete err (#20070) 1 year ago
-LAN- d31235ca13
feat: Introduce WorkflowExecution Domain Entity and Repository, Replace WorkflowRun Direct Usage, and Unify Stream Response Logic (#20067)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
wlleiiwang 7d230acf40
tencent vectordb compatible with version 1.1.3 and below (#20056)
Co-authored-by: wlleiiwang <wlleiiwang@tencent.com>
1 year ago
QuantumGhost 13dc1c8795
Simplify `execution_metadata` Handling for `WorkflowNodeExecution` (#20062)
Currently, `WorkflowNodeExecution.execution_metadata_dict` returns `None` when metadata is absent in the database. This requires all callers to perform `None` checks when processing metadata, leading to more complex caller-side logic.

This pull request updates the `execution_metadata_dict` method to return an empty dictionary instead of `None` when metadata is absent. This change would simplify the caller logic, as it removes the need for explicit `None` checks and provides a more consistent data structure to work with.
1 year ago
-LAN- 57bcb616bc
fix(sqlalchemy_workflow_node_execution_repository): Missing `triggered_from` while querying WorkflowNodeExecution (#20044)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 3196dc2d61
refactor: Use typed SQLAlchemy base model and fix type errors (#19980)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Panpan ef3569e667
feat: support chatflow start node custom input field hidden (#19678) 1 year ago
俊晨 36b321735e
fix create_tracing_app_config error (#19884) (#20004)
Co-authored-by: codly <codly.fun@gmail.com>
1 year ago
luckylhb90 c58678d84d
chore: Reduce the invocation of the plugin interface (#19629)
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Zihe JI 87f9d11d65
fix: ensure Decimal values in metadata are JSON serializable (fixes #19936) (#19955)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago
Darlewo 8cb3b4aef2
fix: multiple retrieve reranking_enabled switch (#19958) 1 year ago
Amir Mohsen Asaran c9ee60e197
Feat(WaterCrawl error handling): add custom exceptions and error handling (#19948) 1 year ago
QuantumGhost 6a9e0b1005
feat(api): Introduce `WorkflowDraftVariable` Model (#19737)
- Introduce `WorkflowDraftVariable` model and the corresponding migration.
- Implement `EnumText`,  a custom column type for SQLAlchemy designed
  to work seamlessly with enumeration classes based on `StrEnum`.
1 year ago
非法操作 bbebf9ad3e
fix: db_model save to _node_execution_cache (#19911) 1 year ago
heyszt 11146b6bae
fix create_tracing_app_config error (#19884) 1 year ago
-LAN- 7d0106b220
fix: correct type mismatch in WorkflowService node execution handling (#19846)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 4977bb21ec
feat(workflow): domain model for workflow node execution (#19430)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
1 year ago
Yeuoly ff0feaf34e
fix: handle EndpointSetupFailedError in BasePluginClient (#19613) 1 year ago
k-kayashima b292990075
Fix: Ensure unique index names for pgvector knowledge tables (#19672)
Co-authored-by: crazywoola <427733928@qq.com>
1 year ago