You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
gcgj-dify-1.7.0/api/core
-LAN- 559ab46ee1
fix: Removes redundant token calculations and updates dependencies
Eliminates unnecessary pre-calculation of token limits and recalculation of max tokens
across multiple app runners, simplifying the logic for prompt handling.

Updates tiktoken library from version 0.8.0 to 0.9.0 for improved tokenization performance.

Increases default token limit in TokenBufferMemory to accommodate larger prompt messages.

These changes streamline the token management process and leverage the latest
improvements in the tiktoken library.

Fixes potential token overflow issues and prepares the system for handling larger
inputs more efficiently.

Relates to internal optimization tasks.

Signed-off-by: -LAN- <laipz8200@outlook.com>
9 months ago
..
agent fix: Removes redundant token calculations and updates dependencies 9 months ago
app fix: Removes redundant token calculations and updates dependencies 9 months ago
callback_handler feat: mypy for all type check (#10921) 1 year ago
entities Feat/support parent child chunk (#12092) 1 year ago
errors fix(core/errors): change base class of custom exceptions to ValueError (#11955) 1 year ago
extension feat: mypy for all type check (#10921) 1 year ago
external_data_tool chore(lint): fix quotes for f-string formatting by bumping ruff to 0.9.x (#12702) 1 year ago
file chore(lint): fix quotes for f-string formatting by bumping ruff to 0.9.x (#12702) 1 year ago
helper fix: SSRF proxy file descriptor leak in concurrent requests (#13108) 1 year ago
llm_generator Fix suggested_question_prompt (#12738) 1 year ago
memory fix: Removes redundant token calculations and updates dependencies 9 months ago
model_runtime fix: Removes redundant token calculations and updates dependencies 9 months ago
moderation feat: mypy for all type check (#10921) 1 year ago
ops Add new integration with Opik Tracking tool (#11501) 1 year ago
prompt feat: mypy for all type check (#10921) 1 year ago
rag refactor: Update Firecrawl API parameters and default settings (#13082) 1 year ago
tools feat: remove Vanna provider and associated assets from the project 11 months ago
variables chore(fix): Invalid quotes for using Array[String] in HTTP request node as JSON body (#12761) 1 year ago
workflow fix: Removes redundant token calculations and updates dependencies 9 months ago
__init__.py chore(api/core): apply ruff reformatting (#7624) 1 year ago
hosting_configuration.py feat: mypy for all type check (#10921) 1 year ago
indexing_runner.py fix: same chunk insert deadlock (#12502) 1 year ago
model_manager.py feat: mypy for all type check (#10921) 1 year ago
provider_manager.py feat: enhance credential extraction logic based on configurate method (#12853) 1 year ago