You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
gcgj-dify-1.7.0/api/core
-LAN- 559ab46ee1
fix: Removes redundant token calculations and updates dependencies
Eliminates unnecessary pre-calculation of token limits and recalculation of max tokens
across multiple app runners, simplifying the logic for prompt handling.

Updates tiktoken library from version 0.8.0 to 0.9.0 for improved tokenization performance.

Increases default token limit in TokenBufferMemory to accommodate larger prompt messages.

These changes streamline the token management process and leverage the latest
improvements in the tiktoken library.

Fixes potential token overflow issues and prepares the system for handling larger
inputs more efficiently.

Relates to internal optimization tasks.

Signed-off-by: -LAN- <laipz8200@outlook.com>
1 year ago
..
agent fix: Removes redundant token calculations and updates dependencies 1 year ago
app fix: Removes redundant token calculations and updates dependencies 1 year ago
callback_handler feat: mypy for all type check (#10921) 2 years ago
entities Feat/support parent child chunk (#12092) 2 years ago
errors fix(core/errors): change base class of custom exceptions to ValueError (#11955) 2 years ago
extension feat: mypy for all type check (#10921) 2 years ago
external_data_tool chore(lint): fix quotes for f-string formatting by bumping ruff to 0.9.x (#12702) 1 year ago
file chore(lint): fix quotes for f-string formatting by bumping ruff to 0.9.x (#12702) 1 year ago
helper fix: SSRF proxy file descriptor leak in concurrent requests (#13108) 1 year ago
llm_generator Fix suggested_question_prompt (#12738) 1 year ago
memory fix: Removes redundant token calculations and updates dependencies 1 year ago
model_runtime fix: Removes redundant token calculations and updates dependencies 1 year ago
moderation feat: mypy for all type check (#10921) 2 years ago
ops Add new integration with Opik Tracking tool (#11501) 1 year ago
prompt feat: mypy for all type check (#10921) 2 years ago
rag refactor: Update Firecrawl API parameters and default settings (#13082) 1 year ago
tools feat: remove Vanna provider and associated assets from the project 1 year ago
variables chore(fix): Invalid quotes for using Array[String] in HTTP request node as JSON body (#12761) 1 year ago
workflow fix: Removes redundant token calculations and updates dependencies 1 year ago
__init__.py chore(api/core): apply ruff reformatting (#7624) 2 years ago
hosting_configuration.py feat: mypy for all type check (#10921) 2 years ago
indexing_runner.py fix: same chunk insert deadlock (#12502) 2 years ago
model_manager.py feat: mypy for all type check (#10921) 2 years ago
provider_manager.py feat: enhance credential extraction logic based on configurate method (#12853) 1 year ago