You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
gcgj-dify-1.7.0/api
Bowen Liang 20268708cc
chore: improve position map conversion and tolerate empty position yaml file (#6541)
2 years ago
..
configs Enhance database URI security and add URL encoding (#6668) 2 years ago
constants Feat/environment variables in workflow (#6515) 2 years ago
contexts Feat/environment variables in workflow (#6515) 2 years ago
controllers chore: make prompt generator max tokens configurable (#6693) 2 years ago
core chore: improve position map conversion and tolerate empty position yaml file (#6541) 2 years ago
docker fix: kill signal is not passed to the main process (#6159) 2 years ago
events Feat/delete file when clean document (#5882) 2 years ago
extensions fix tencent_cos_storage image-preview error is not a byte (#6652) 2 years ago
fields fix(api/fields/workflow_fields.py): Add check in environment variables (#6621) 2 years ago
libs fix(api/services/app_generate_service.py): Remove wrong type hints. (#6535) 2 years ago
migrations Fix/6615 40 varchar limit on DatasetCollectionBinding and Embedding model name (#6723) 2 years ago
models Fix/6615 40 varchar limit on DatasetCollectionBinding and Embedding model name (#6723) 2 years ago
schedule Feat/environment variables in workflow (#6515) 2 years ago
services chore: optimize asynchronous deletion performance of app related data (#6634) 2 years ago
tasks chore: optimize asynchronous workflow deletion performance of app related data (#6639) 2 years ago
templates feat: implement forgot password feature (#5534) 2 years ago
tests chore: improve position map conversion and tolerate empty position yaml file (#6541) 2 years ago
.dockerignore build: support Poetry for depencencies tool in api's Dockerfile (#5105) 2 years ago
.env.example chore: make prompt generator max tokens configurable (#6693) 2 years ago
Dockerfile chore: skip pip upgrade preparation in api dockerfile (#5999) 2 years ago
README.md Chores: add missing profile for middleware docker compose cmd and fix ssrf-proxy doc link (#6372) 2 years ago
app.py Feat/environment variables in workflow (#6515) 2 years ago
commands.py feat: support AnalyticDB vector store (#5586) 2 years ago
poetry.lock add xlsx support hyperlink extract (#6722) 2 years ago
poetry.toml build: initial support for poetry build tool (#4513) 2 years ago
pyproject.toml add xlsx support hyperlink extract (#6722) 2 years ago

README.md

Dify Backend API

Usage

[!IMPORTANT] In the v0.6.12 release, we deprecated pip as the package management tool for Dify API Backend service and replaced it with poetry.

  1. Start the docker-compose stack

    The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

    cd ../docker
    cp middleware.env.example middleware.env
    # change the profile to other vector database if you are not using weaviate
    docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
    cd ../api
    
  2. Copy .env.example to .env

  3. Generate a SECRET_KEY in the .env file.

    sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env
    
    secret_key=$(openssl rand -base64 42)
    sed -i '' "/^SECRET_KEY=/c\\
    SECRET_KEY=${secret_key}" .env
    
  4. Create environment.

    Dify API service uses Poetry to manage dependencies. You can execute poetry shell to activate the environment.

  5. Install dependencies

    poetry env use 3.10
    poetry install
    

    In case of contributors missing to update dependencies for pyproject.toml, you can perform the following shell instead.

    poetry shell                                               # activate current environment
    poetry add $(cat requirements.txt)           # install dependencies of production and update pyproject.toml
    poetry add $(cat requirements-dev.txt) --group dev    # install dependencies of development and update pyproject.toml
    
  6. Run migrate

    Before the first launch, migrate the database to the latest version.

    poetry run python -m flask db upgrade
    
  7. Start backend

    poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
    
  8. Start Dify web service.

  9. Setup your application by visiting http://localhost:3000...

  10. If you need to debug local async processing, please start the worker service.

poetry run python -m celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion

The started celery app handles the async tasks, e.g. dataset importing and documents indexing.

Testing

  1. Install dependencies for both the backend and the test environment

    poetry install --with dev
    
  2. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml

    cd ../
    poetry run -C api bash dev/pytest/pytest_all_tests.sh