You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
gcgj-dify-1.7.0/api
kurokobo 2e842333b1
fix: correct typos in the icons for microsoft (#5243)
2 years ago
..
.vscode build: initial support for poetry build tool (#4513) 2 years ago
constants feat: Added hindi translation i18n (#5240) 2 years ago
controllers Feat/firecrawl data source (#5232) 2 years ago
core fix: correct typos in the icons for microsoft (#5243) 2 years ago
docker improvement: introduce Super-Linter actions to check style for shell script, dockerfile and yaml files (#1966) 2 years ago
events fix: initialize site with customized icon and icon_background (#5227) 2 years ago
extensions add aws s3 iam check (#5174) 2 years ago
fields fix: workspace member's last_active should be last_active_time, but not last_login_time (#4906) 2 years ago
libs Feat/firecrawl data source (#5232) 2 years ago
migrations Feat/firecrawl data source (#5232) 2 years ago
models Feat/firecrawl data source (#5232) 2 years ago
schedule Feat/dify rag (#2528) 2 years ago
services Feat/firecrawl data source (#5232) 2 years ago
tasks Feat/firecrawl data source (#5232) 2 years ago
templates fix: email template style (#1914) 2 years ago
tests Feat/firecrawl data source (#5232) 2 years ago
.dockerignore build: fix .dockerignore file (#800) 3 years ago
.env.example Feat/firecrawl data source (#5232) 2 years ago
Dockerfile improvement: speed up dependency installation in docker image rebuilds by mounting cache layer (#3218) 2 years ago
README.md Update README.md (#5228) 2 years ago
app.py refactor: config file (#3852) 2 years ago
commands.py feat: support tencent vector db (#3568) 2 years ago
config.py version to 0.6.11 (#5224) 2 years ago
poetry.lock feat: support tencent vector db (#3568) 2 years ago
poetry.toml build: initial support for poetry build tool (#4513) 2 years ago
pyproject.toml version to 0.6.11 (#5224) 2 years ago
requirements-dev.txt chore: skip explicit installing jinja2 as testing dependency (#4845) 2 years ago
requirements.txt feat: support tencent vector db (#3568) 2 years ago

README.md

Dify Backend API

Usage

  1. Start the docker-compose stack

    The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

    cd ../docker
    docker-compose -f docker-compose.middleware.yaml -p dify up -d
    cd ../api
    
  2. Copy .env.example to .env

  3. Generate a SECRET_KEY in the .env file.

    sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env
    
  4. Create environment.

    Dify API service uses Poetry to manage dependencies. You can execute poetry shell to activate the environment.

    Using pip can be found below.

  5. Install dependencies

    poetry install
    

    In case of contributors missing to update dependencies for pyproject.toml, you can perform the following shell instead.

    poetry shell                                               # activate current environment
    poetry add $(cat requirements.txt)           # install dependencies of production and update pyproject.toml
    poetry add $(cat requirements-dev.txt) --group dev    # install dependencies of development and update pyproject.toml
    
  6. Run migrate

    Before the first launch, migrate the database to the latest version.

    poetry run python -m flask db upgrade
    
  7. Start backend

    poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
    
  8. Start Dify web service.

  9. Setup your application by visiting http://localhost:3000...

  10. If you need to debug local async processing, please start the worker service.

poetry run python -m celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail

The started celery app handles the async tasks, e.g. dataset importing and documents indexing.

Testing

  1. Install dependencies for both the backend and the test environment

    poetry install --with dev
    
  2. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml

    cd ../
    poetry run -C api bash dev/pytest/pytest_all_tests.sh
    

Usage with pip

[!NOTE]
In the next version, we will deprecate pip as the primary package management tool for dify api service, currently Poetry and pip coexist.

  1. Start the docker-compose stack

    The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

    cd ../docker
    docker-compose -f docker-compose.middleware.yaml -p dify up -d
    cd ../api
    
  2. Copy .env.example to .env

  3. Generate a SECRET_KEY in the .env file.

    sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env
    
  4. Create environment.

    If you use Anaconda, create a new environment and activate it

    conda create --name dify python=3.10
    conda activate dify
    
  5. Install dependencies

    pip install -r requirements.txt
    
  6. Run migrate

    Before the first launch, migrate the database to the latest version.

    flask db upgrade
    
  7. Start backend:

    flask run --host 0.0.0.0 --port=5001 --debug
    
  8. Setup your application by visiting http://localhost:5001/console/api/setup or other apis...

  9. If you need to debug local async processing, please start the worker service.

celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail

The started celery app handles the async tasks, e.g. dataset importing and documents indexing.

Testing

  1. Install dependencies for both the backend and the test environment

    pip install -r requirements.txt -r requirements-dev.txt
    
  2. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml

    dev/pytest/pytest_all_tests.sh