Commit Graph

152 Commits (5f7f851b177f4e0b3e1a29debd04bcbb596b97cd)

Author SHA1 Message Date
-LAN- 559ab46ee1
fix: Removes redundant token calculations and updates dependencies
Eliminates unnecessary pre-calculation of token limits and recalculation of max tokens
across multiple app runners, simplifying the logic for prompt handling.

Updates tiktoken library from version 0.8.0 to 0.9.0 for improved tokenization performance.

Increases default token limit in TokenBufferMemory to accommodate larger prompt messages.

These changes streamline the token management process and leverage the latest
improvements in the tiktoken library.

Fixes potential token overflow issues and prepares the system for handling larger
inputs more efficiently.

Relates to internal optimization tasks.

Signed-off-by: -LAN- <laipz8200@outlook.com>
11 months ago
jiandanfeng edc29780ed
fix: "Model schema not found" error only in agents (#12655) (#12760) 1 year ago
jiandanfeng 9aaee8ee47
fix: Issues related to the deletion of conversation_id (#12488) (#12665) 1 year ago
Bowen Liang 166221d784
chore(lint): fix quotes for f-string formatting by bumping ruff to 0.9.x (#12702) 1 year ago
-LAN- 7ed6485f86
refactor: streamline initialization of application_generate_entity and task_state in task pipeline classes (#12326)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Yingchun Lai c135967e59
refactor: simplify some exception catch code (#12246) 1 year ago
-LAN- 62f792ea14
fix: ensure workflow_run_id is always set and improve handling in Wor… (#12264)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- d4b848272e
fix: apply gevent threading patch early and ensure unique workflow node execution IDs (#12196)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 822af70dce
fix(workflow_service): assign UUID to workflow_node_execution id and update optional fields in WorkflowRun and WorkflowNodeExecution models (#12096)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 39ace9bdee
fix(app_generator): improve error handling for closed file I/O operat… (#12073)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- 83ea931e3c
refactor: optimize database usage (#12071)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
yihong 56e15d09a9
feat: mypy for all type check (#10921) 1 year ago
-LAN- 82134a1d50
fix: Replace generic exceptions with specific error classes in task p… (#12036)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Novice 453f324f54
fix: retry node in iteration logs wrong (#11995)
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
1 year ago
Novice c1aa55f3ea
fix: remove the unused retry index field (#11903)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
Co-authored-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- dd0e81d094
fix: enhance type hints and improve audio message handling in TTS pub… (#11947)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Kalo Chin 786cb6859b
fix: ensure WorkflowRun attributes are refreshed in WorkflowCycleMana… (#11913) 1 year ago
Novice 7abc7fa573
Feat: Retry on node execution errors (#11871)
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
1 year ago
-LAN- 92a840f1b2
feat(tool_node): Suppress exceptions thrown by the Tool (#11724)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
Novice e0b67536e0
fix: remove the unused QueueWorkflowPartialSuccessEvent handle in workflow (#11669)
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
1 year ago
yihong efd5575683
fix: _handle_workflow_run_partial_success args is wrong (#11562)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
liuzhenghua d05f189049
Fix: RateLimit requests were not released when a streaming generation exception occurred (#11540) 1 year ago
Novice 79a710ce98
Feat: continue on error (#11458)
Co-authored-by: Novice Lee <novicelee@NovicedeMacBook-Pro.local>
Co-authored-by: Novice Lee <novicelee@NoviPro.local>
1 year ago
yihong 225fcd5e41
Revert "fix: total tokens is wrong which is zero in inter way, close … (#11536) 1 year ago
-LAN- fd354d999d
fix(app_generator_service): overload type hints (#11507)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
yihong d9d5d35a77
fix: issue #10596 by making the iteration node outputs right (#11394)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
1 year ago
Jyong a8d32f9964
fix external retrieval without segment id (#11423) 1 year ago
yihong 5669cac16d
fix: some typos using typos (#11374)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
Yi Xiao e135ffc2c1
Feat: upgrade variable assigner (#11285)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
1 year ago
Hash Brown c4fad66f2a
fix: `dialogue_count` incorrect in chatflow when there's... (#11175) 1 year ago
-LAN- 3c8efe7c0a
fix(workflow_cycle_manage): Handle special values in the process_data. (#11253)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
-LAN- c34bdb74e6
Fix/type-error (#11240)
Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
yihong fd4be36991
fix: total tokens is wrong which is zero in inter way, close #11221 (#11224)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
-LAN- 8d5a1be227
fix: Cannot use files in the user inputs. (#11112) 1 year ago
-LAN- 98d85e6b74
fix: WorkflowNodeExecution.created_at may be earlier than WorkflowRun.created_at (#11070) 1 year ago
-LAN- 3eb51d85da
fix(workflow_entry): Support receive File and FileList in single step run. (#10947)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: JzoNg <jzongcode@gmail.com>
1 year ago
Bowen Liang 6c8e208ef3
chore: bump minimum supported Python version to 3.11 (#10386) 1 year ago
yihong 0181f1c08c
fix: wrong convert in PromptTemplateConfigManager (#11016)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
yihong 7f00c5a02e
fix: uuid not import bug (#11014)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
-LAN- c5f7d650b5
feat: Allow using file variables directly in the LLM node and support more file types. (#10679)
Co-authored-by: Joel <iamjoel007@gmail.com>
1 year ago
yihong 0067b16d1e
fix: refactor all 'or []' and 'or {}' logic to make code more clear (#10883)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
1 year ago
KVOJJJin 328965ed7c
Fix: crash of workflow file upload (#10831)
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
1 year ago
crazywoola 2fed55ae6b
Fix: number maybe empty string (#10743) 1 year ago
Bowen Liang 51db59622c
chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425) 1 year ago
Novice f414d241c1
Feat/iteration single run time (#10512) 1 year ago
-LAN- 172c7eb270
fix(file_upload): correct validation method and add unit tests (#10477) 1 year ago
-LAN- 25ca0278dd
refactor(core): Remove extra_config from File. (#10203) 1 year ago
Bowen Liang 0ebe198ff1
chore: use DEBUG in dify_config instead of parsing raw system environment variable in place (#10437) 1 year ago
Bowen Liang 574c4a264f
chore(lint): Use logging.exception instead of logging.error (#10415) 1 year ago
Novice d1505b15c4
feat: Iteration node support parallel mode (#9493) 1 year ago