You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
quicksand 680eb7a9f6
fix(datasets): retrieval_model null issue when updating dataset info (#25907)
hace 1 mes
..
.idea fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) hace 1 año
.vscode feat/enhance the multi-modal support (#8818) hace 1 año
configs fix: remote code execution in email endpoints (#25753) hace 1 mes
constants chore: adopt StrEnum and auto() for some string-typed enums (#25129) hace 1 mes
contexts feat: knowledge pipeline (#25360) hace 1 mes
controllers fix: Message => str (#25876) hace 1 mes
core fix(api): fix single stepping variable loading (#25908) hace 1 mes
docker feat: knowledge pipeline (#25360) hace 1 mes
events feat: knowledge pipeline (#25360) hace 1 mes
extensions chore: improve opendal storage and ensure closing file after reading files in `load_stream` method (#25874) hace 1 mes
factories feat: knowledge pipeline (#25360) hace 1 mes
fields feat: knowledge pipeline (#25360) hace 1 mes
libs feat: knowledge pipeline (#25360) hace 1 mes
migrations feat: knowledge pipeline (#25360) hace 1 mes
models feat: knowledge pipeline (#25360) hace 1 mes
repositories feat: knowledge pipeline (#25360) hace 1 mes
schedule chore: add ast-grep rule to convert Optional[T] to T | None (#25560) hace 1 mes
services fix(datasets): retrieval_model null issue when updating dataset info (#25907) hace 1 mes
tasks fix: remote code execution in email endpoints (#25753) hace 1 mes
templates Feat/email register refactor (#25369) hace 1 mes
tests feat: make SQLALCHEMY_POOL_TIMEOUT configurable (#25468) hace 1 mes
.dockerignore Enhance Code Consistency Across Repository with `.editorconfig` (#19023) hace 6 meses
.env.example feat: make SQLALCHEMY_POOL_TIMEOUT configurable (#25468) hace 1 mes
.importlinter feat: knowledge pipeline (#25360) hace 1 mes
.ruff.toml ruff check preview (#25653) hace 1 mes
Dockerfile chore: update uv to 0.8.9 (#23833) hace 2 meses
README.md [Chore/Refactor] Switch from MyPy to Basedpyright for type checking (#25047) hace 2 meses
app.py feat: knowledge pipeline (#25360) hace 1 mes
app_factory.py [Chore/Refactor] Improve type checking configuration (#25185) hace 1 mes
celery_entrypoint.py feat: knowledge pipeline (#25360) hace 1 mes
commands.py feat(api/commands): add migrate-oss to migrate from Local/OpenDAL to … (#25828) hace 1 mes
dify_app.py refactor: assembling the app features in modular way (#9129) hace 11 meses
gunicorn.conf.py feat: knowledge pipeline (#25360) hace 1 mes
pyproject.toml chore: improve opendal storage and ensure closing file after reading files in `load_stream` method (#25874) hace 1 mes
pyrightconfig.json feat: knowledge pipeline (#25360) hace 1 mes
pytest.ini Refactor/remove db from cycle manager (#20455) hace 5 meses
ty.toml chore: apply ty checks on api code with script and ci action (#24653) hace 2 meses
uv.lock chore: improve opendal storage and ensure closing file after reading files in `load_stream` method (#25874) hace 1 mes

README.md

Dify Backend API

Usage

[!IMPORTANT]

In the v1.3.0 release, poetry has been replaced with uv as the package manager for Dify API backend service.

  1. Start the docker-compose stack

The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

   cd ../docker
   cp middleware.env.example middleware.env
   # change the profile to other vector database if you are not using weaviate
   docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
   cd ../api
  1. Copy .env.example to .env
   cp .env.example .env
  1. Generate a SECRET_KEY in the .env file.

bash for Linux

   sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env

bash for Mac

   secret_key=$(openssl rand -base64 42)
   sed -i '' "/^SECRET_KEY=/c\\
   SECRET_KEY=${secret_key}" .env
  1. Create environment.

Dify API service uses UV to manage dependencies. First, you need to add the uv package manager, if you don’t have it already.

   pip install uv
   # Or on macOS
   brew install uv
  1. Install dependencies
   uv sync --dev
  1. Run migrate

Before the first launch, migrate the database to the latest version.

   uv run flask db upgrade
  1. Start backend
   uv run flask run --host 0.0.0.0 --port=5001 --debug
  1. Start Dify web service.

  2. Setup your application by visiting http://localhost:3000.

  3. If you need to handle and debug the async tasks (e.g. dataset importing and documents indexing), please start the worker service.

uv run celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion,plugin,workflow_storage,conversation

Addition, if you want to debug the celery scheduled tasks, you can use the following command in another terminal:

uv run celery -A app.celery beat

Testing

  1. Install dependencies for both the backend and the test environment
   uv sync --dev
  1. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml, more can check Claude.md
   uv run pytest                           # Run all tests
   uv run pytest tests/unit_tests/         # Unit tests only
   uv run pytest tests/integration_tests/  # Integration tests

   # Code quality
   ../dev/reformat               # Run all formatters and linters
   uv run ruff check --fix ./    # Fix linting issues
   uv run ruff format ./         # Format code
   uv run basedpyright .         # Type checking