You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Kalo Chin 2681bafb76
fix: handle document fetching from URL in Anthropic LLM model, solving base64 decoding error (#11858)
10 months ago
..
.idea fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) 1 year ago
.vscode feat/enhance the multi-modal support (#8818) 1 year ago
configs feat: add workflow parallel depth limit configuration (#11460) 10 months ago
constants fix: support mdx files close #11557 (#11565) 10 months ago
contexts feat/enhance the multi-modal support (#8818) 1 year ago
controllers feat: add workflow parallel depth limit configuration (#11460) 10 months ago
core fix: handle document fetching from URL in Anthropic LLM model, solving base64 decoding error (#11858) 10 months ago
docker feat: integrate opendal storage (#11508) 10 months ago
events chore: bump minimum supported Python version to 3.11 (#10386) 11 months ago
extensions chore(db): use a better way to export models and remove unused table (#11838) 10 months ago
factories feat(llm_node): support order in text and files (#11837) 10 months ago
fields Feat: Retry on node execution errors (#11871) 10 months ago
libs chore(db): use a better way to export models and remove unused table (#11838) 10 months ago
migrations chore: add retry index migration (#11887) 10 months ago
models Feat: Retry on node execution errors (#11871) 10 months ago
schedule improve message clean logic (#11487) 10 months ago
services Feat: Retry on node execution errors (#11871) 10 months ago
tasks fix: ExternalDatasetService.process_external_api wrong args (#11586) 10 months ago
templates Feat/new login (#8120) 1 year ago
tests feat: add workflow parallel depth limit configuration (#11460) 10 months ago
.dockerignore build: support Poetry for depencencies tool in api's Dockerfile (#5105) 1 year ago
.env.example feat: add workflow parallel depth limit configuration (#11460) 10 months ago
.ruff.toml fix: remove ruff ignore SIM300 (#11810) 10 months ago
Dockerfile chore(api/Dockerfile): Bump perl to 0.40.0-8 (#11234) 11 months ago
README.md chore: update base image to Python 3.12 in Dockerfile (#10358) 11 months ago
app.py feat(app_factory): speed up api startup (#11762) 10 months ago
app_factory.py feat: full support for opendal and sync configurations between .env and docker-compose (#11754) 10 months ago
commands.py fix: some typos using typos (#11374) 11 months ago
dify_app.py refactor: assembling the app features in modular way (#9129) 11 months ago
poetry.lock fix: memory leak by pypdfium2 close(maybe) #11510 (#11700) 10 months ago
poetry.toml build: initial support for poetry build tool (#4513) 1 year ago
pyproject.toml fix: memory leak by pypdfium2 close(maybe) #11510 (#11700) 10 months ago
pytest.ini feat: Add support for TEI API key authentication (#11006) 11 months ago

README.md

Dify Backend API

Usage

[!IMPORTANT] In the v0.6.12 release, we deprecated pip as the package management tool for Dify API Backend service and replaced it with poetry.

  1. Start the docker-compose stack

The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

   cd ../docker
   cp middleware.env.example middleware.env
   # change the profile to other vector database if you are not using weaviate
   docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
   cd ../api
  1. Copy .env.example to .env
   cp .env.example .env 
  1. Generate a SECRET_KEY in the .env file.

bash for Linux

   sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env

bash for Mac

   secret_key=$(openssl rand -base64 42)
   sed -i '' "/^SECRET_KEY=/c\\
   SECRET_KEY=${secret_key}" .env
  1. Create environment.

Dify API service uses Poetry to manage dependencies. You can execute poetry shell to activate the environment.

  1. Install dependencies
   poetry env use 3.12
   poetry install
  1. Run migrate

Before the first launch, migrate the database to the latest version.

   poetry run python -m flask db upgrade
  1. Start backend
   poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
  1. Start Dify web service.
  2. Setup your application by visiting http://localhost:3000
  3. If you need to handle and debug the async tasks (e.g. dataset importing and documents indexing), please start the worker service.
   poetry run python -m celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion

Testing

  1. Install dependencies for both the backend and the test environment
   poetry install -C api --with dev
  1. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml
   poetry run -C api bash dev/pytest/pytest_all_tests.sh