You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
gcgj-dify-1.7.0/api
Ganondorf a147d2a200
feat(api): use `json_repair` to fix invalid json while generating structured output (#18977)
When generating JSON schema using an LLM in the structured output feature,
models may occasionally return invalid JSON, which prevents clients from correctly 
parsing the response and can lead to UI breakage.

This commit addresses the issue by introducing `json_repair` to automatically 
fix invalid JSON strings returned by the LLM, ensuring smoother functionality 
and better client-side handling of structured outputs.


Co-authored-by: lizb <lizb@sugon.com>
9 months ago
..
.idea fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) 1 year ago
.vscode feat/enhance the multi-modal support (#8818) 1 year ago
configs chore: Bump version to 1.3.1 (#18962) 9 months ago
constants feat (document_extractor): support .properties file (#18969) 9 months ago
contexts feat: Add caching mechanism for plugin model schemas (#14898) 11 months ago
controllers fix: annotation update need use http put method and annotation-reply api doc parms wrong (#18891) 9 months ago
core feat(api): use `json_repair` to fix invalid json while generating structured output (#18977) 9 months ago
docker add MAX_TASK_PRE_CHILD for celery (#18985) 9 months ago
events Remove dead code (#17899) 10 months ago
extensions [Observability][Bugfix] Fix expected an instance of Token, got None error in OpenTelemetry (#18934) 9 months ago
factories refactor: rename plugin manager to plugin client and rename path from manager to impl (#18876) 9 months ago
fields Resolves #18536 Retreive conversation variables (#18581) 10 months ago
libs Update login.py (#15320) 11 months ago
migrations Fix Performance Issues: (#17083) 10 months ago
models if as_attachment is in the url, add it to the sign_url (#18930) 9 months ago
schedule Fix function's name mismatch (#16681) 11 months ago
services refactor: Refactors repository imports structure (#18901) 9 months ago
tasks refactor: Refactors repository imports structure (#18901) 9 months ago
templates feat: account delete (#11829) 1 year ago
tests test(graph-engine-test): modify the assert condition (#19041) 9 months ago
.dockerignore Introduce Plugins (#13836) 12 months ago
.env.example [Lindorm VDB] Add the QUERY_TIMEOUT parameter to force the search query to fail. (#18613) 10 months ago
.ruff.toml chore(api): enhance ruff rules to disallow dangerous functions and modules (#16461) 11 months ago
Dockerfile build: introduce uv as Python package manager (#16317) 10 months ago
README.md chore: merge lint dependency group into dev group of python packages (#18088) 10 months ago
app.py fix(app.py): if condition (#12314) 1 year ago
app_factory.py [Observability][Bugfix] Fix expected an instance of Token, got None error in OpenTelemetry (#18934) 9 months ago
commands.py feat: clean up message_files table first before proceeding to find orphaned files (#19035) 9 months ago
dify_app.py refactor: assembling the app features in modular way (#9129) 1 year ago
mypy.ini Remove the useless excluded item in mypy.ini (#16777) 11 months ago
pyproject.toml refactor: switch to dynamic versioning in package configuration (#19019) 9 months ago
pytest.ini [Unit Test] Generate coverage number for UT (#18106) 10 months ago
uv.lock refactor: switch to dynamic versioning in package configuration (#19019) 9 months ago

README.md

Dify Backend API

Usage

[!IMPORTANT]

In the v1.3.0 release, poetry has been replaced with uv as the package manager for Dify API backend service.

  1. Start the docker-compose stack

    The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

    cd ../docker
    cp middleware.env.example middleware.env
    # change the profile to other vector database if you are not using weaviate
    docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
    cd ../api
    
  2. Copy .env.example to .env

    cp .env.example .env 
    
  3. Generate a SECRET_KEY in the .env file.

    bash for Linux

    sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env
    

    bash for Mac

    secret_key=$(openssl rand -base64 42)
    sed -i '' "/^SECRET_KEY=/c\\
    SECRET_KEY=${secret_key}" .env
    
  4. Create environment.

    Dify API service uses UV to manage dependencies. First, you need to add the uv package manager, if you don't have it already.

    pip install uv
    # Or on macOS
    brew install uv
    
  5. Install dependencies

    uv sync --dev
    
  6. Run migrate

    Before the first launch, migrate the database to the latest version.

    uv run flask db upgrade
    
  7. Start backend

    uv run flask run --host 0.0.0.0 --port=5001 --debug
    
  8. Start Dify web service.

  9. Setup your application by visiting http://localhost:3000.

  10. If you need to handle and debug the async tasks (e.g. dataset importing and documents indexing), please start the worker service.

uv run celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion

Testing

  1. Install dependencies for both the backend and the test environment

    uv sync --dev
    
  2. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml

    uv run -P api bash dev/pytest/pytest_all_tests.sh