You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
gcgj-dify-1.7.0/api
Lawrence Li 76b0328eb1
feat: add gpustack model provider (#10158)
1 year ago
..
.idea fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) 1 year ago
.vscode feat/enhance the multi-modal support (#8818) 1 year ago
configs fix: avoid unexpected error when create knowledge base with baidu vector database and wenxin embedding model (#10130) 1 year ago
constants nltk security issue and upgrade unstructured (#9558) 1 year ago
contexts feat/enhance the multi-modal support (#8818) 1 year ago
controllers Feat/add-remote-file-upload-api (#9906) 1 year ago
core feat: add gpustack model provider (#10158) 1 year ago
docker fix: use LOG_LEVEL for celery startup (#7628) 1 year ago
events feat/enhance the multi-modal support (#8818) 1 year ago
extensions Revert "chore: improve validation and handler of logging timezone with TimezoneName" (#10077) 1 year ago
factories Feat/add-remote-file-upload-api (#9906) 1 year ago
fields Feat/add-remote-file-upload-api (#9906) 1 year ago
libs refactor: use dify_config to replace legacy usage of flask app's config (#9089) 1 year ago
migrations refactor(migration/model): update column types for workflow schema (#10160) 1 year ago
models refactor(migration/model): update column types for workflow schema (#10160) 1 year ago
schedule add tidb on qdrant type (#9831) 1 year ago
services Feat/add-remote-file-upload-api (#9906) 1 year ago
tasks Feat/new login (#8120) 1 year ago
templates Feat/new login (#8120) 1 year ago
tests feat: add gpustack model provider (#10158) 1 year ago
.dockerignore build: support Poetry for depencencies tool in api's Dockerfile (#5105) 2 years ago
.env.example chore: add tidb-on-qdrant configuration in env and docker-compose file (#10015) 1 year ago
Dockerfile fix(Dockerfile): conditionally install zlib1g based on architecture (#10118) 1 year ago
README.md fix: poetry installation in CI jobs (#9336) 1 year ago
app.py refactor: use dify_config to replace legacy usage of flask app's config (#9089) 1 year ago
app_factory.py refactor: use dify_config to replace legacy usage of flask app's config (#9089) 1 year ago
commands.py Added OceanBase as an option for the vector store in Dify (#10010) 1 year ago
poetry.lock fix: avoid unexpected error when create knowledge base with baidu vector database and wenxin embedding model (#10130) 1 year ago
poetry.toml build: initial support for poetry build tool (#4513) 2 years ago
pyproject.toml Added OceanBase as an option for the vector store in Dify (#10010) 1 year ago
pytest.ini feat: add models for gitee.ai (#9490) 1 year ago

README.md

Dify Backend API

Usage

[!IMPORTANT] In the v0.6.12 release, we deprecated pip as the package management tool for Dify API Backend service and replaced it with poetry.

  1. Start the docker-compose stack

    The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

    cd ../docker
    cp middleware.env.example middleware.env
    # change the profile to other vector database if you are not using weaviate
    docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
    cd ../api
    
  2. Copy .env.example to .env

  3. Generate a SECRET_KEY in the .env file.

    sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env
    
    secret_key=$(openssl rand -base64 42)
    sed -i '' "/^SECRET_KEY=/c\\
    SECRET_KEY=${secret_key}" .env
    
  4. Create environment.

    Dify API service uses Poetry to manage dependencies. You can execute poetry shell to activate the environment.

  5. Install dependencies

    poetry env use 3.10
    poetry install
    

    In case of contributors missing to update dependencies for pyproject.toml, you can perform the following shell instead.

    poetry shell                                               # activate current environment
    poetry add $(cat requirements.txt)           # install dependencies of production and update pyproject.toml
    poetry add $(cat requirements-dev.txt) --group dev    # install dependencies of development and update pyproject.toml
    
  6. Run migrate

    Before the first launch, migrate the database to the latest version.

    poetry run python -m flask db upgrade
    
  7. Start backend

    poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
    
  8. Start Dify web service.

  9. Setup your application by visiting http://localhost:3000...

  10. If you need to handle and debug the async tasks (e.g. dataset importing and documents indexing), please start the worker service.

poetry run python -m celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion

Testing

  1. Install dependencies for both the backend and the test environment

    poetry install --with dev
    
  2. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml

    cd ../
    poetry run -C api bash dev/pytest/pytest_all_tests.sh