You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Hiroshi Fujita 1d8385f7ac
Sync INDEXING_MAX_SEGMENTATION_TOKENS_LENGTH between API and Web (#11230)
hace 11 meses
..
.idea fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) hace 1 año
.vscode feat/enhance the multi-modal support (#8818) hace 1 año
configs Sync INDEXING_MAX_SEGMENTATION_TOKENS_LENGTH between API and Web (#11230) hace 11 meses
constants chore: add Thai GUI (#11201) hace 11 meses
contexts feat/enhance the multi-modal support (#8818) hace 1 año
controllers Sync INDEXING_MAX_SEGMENTATION_TOKENS_LENGTH between API and Web (#11230) hace 11 meses
core fix(workflow_tool): Rename `stream` to `streaming` (#11258) hace 11 meses
docker fix: remove unused queue `generation` (#10532) hace 11 meses
events chore: bump minimum supported Python version to 3.11 (#10386) hace 11 meses
extensions refactor: assembling the app features in modular way (#9129) hace 11 meses
factories fix(file_factory): Remove transfer_method validation (#11207) hace 11 meses
fields feat: Check and compare the DSL version before import an app (#10969) hace 11 meses
libs Fix/type-error (#11240) hace 11 meses
migrations Feat/clean message records (#10588) hace 11 meses
models fix: Cannot use files in the user inputs. (#11112) hace 11 meses
schedule update the scheduler of update_tidb_serverless_status_task to 1/10min (#11135) hace 11 meses
services Sync INDEXING_MAX_SEGMENTATION_TOKENS_LENGTH between API and Web (#11230) hace 11 meses
tasks fix: wrong param name (#11039) hace 11 meses
templates Feat/new login (#8120) hace 1 año
tests refactor: assembling the app features in modular way (#9129) hace 11 meses
.dockerignore build: support Poetry for depencencies tool in api's Dockerfile (#5105) hace 1 año
.env.example Sync INDEXING_MAX_SEGMENTATION_TOKENS_LENGTH between API and Web (#11230) hace 11 meses
.ruff.toml chore(lint): extract ruff configs into .ruff.toml file keeping pyproject.toml clean (#11222) hace 11 meses
Dockerfile chore(api/Dockerfile): Bump perl to 0.40.0-8 (#11234) hace 11 meses
README.md chore: update base image to Python 3.12 in Dockerfile (#10358) hace 11 meses
app.py refactor: assembling the app features in modular way (#9129) hace 11 meses
app_factory.py refactor: assembling the app features in modular way (#9129) hace 11 meses
commands.py refactor: assembling the app features in modular way (#9129) hace 11 meses
dify_app.py refactor: assembling the app features in modular way (#9129) hace 11 meses
poetry.lock chore(lint): extract ruff configs into .ruff.toml file keeping pyproject.toml clean (#11222) hace 11 meses
poetry.toml build: initial support for poetry build tool (#4513) hace 1 año
pyproject.toml chore(lint): extract ruff configs into .ruff.toml file keeping pyproject.toml clean (#11222) hace 11 meses
pytest.ini feat: Add support for TEI API key authentication (#11006) hace 11 meses

README.md

Dify Backend API

Usage

[!IMPORTANT] In the v0.6.12 release, we deprecated pip as the package management tool for Dify API Backend service and replaced it with poetry.

  1. Start the docker-compose stack

The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

   cd ../docker
   cp middleware.env.example middleware.env
   # change the profile to other vector database if you are not using weaviate
   docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
   cd ../api
  1. Copy .env.example to .env
   cp .env.example .env 
  1. Generate a SECRET_KEY in the .env file.

bash for Linux

   sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env

bash for Mac

   secret_key=$(openssl rand -base64 42)
   sed -i '' "/^SECRET_KEY=/c\\
   SECRET_KEY=${secret_key}" .env
  1. Create environment.

Dify API service uses Poetry to manage dependencies. You can execute poetry shell to activate the environment.

  1. Install dependencies
   poetry env use 3.12
   poetry install
  1. Run migrate

Before the first launch, migrate the database to the latest version.

   poetry run python -m flask db upgrade
  1. Start backend
   poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
  1. Start Dify web service.
  2. Setup your application by visiting http://localhost:3000
  3. If you need to handle and debug the async tasks (e.g. dataset importing and documents indexing), please start the worker service.
   poetry run python -m celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion

Testing

  1. Install dependencies for both the backend and the test environment
   poetry install -C api --with dev
  1. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml
   poetry run -C api bash dev/pytest/pytest_all_tests.sh