ComfyUI/tests
doctorpangloss 2bc95c1711 Test improvements and fixes
- move workflows to distinct json files
 - add the comfy-org workflows for testing
 - fix issues where workflows from windows users would not be compatible
   with backends running on linux or macos in light of separator
   differences. Because this codebase uses get_or_download wherever
   checkpoints, models, etc. are used, this is the only place where the
   comparison is gracefully handled for downloading. Validation code
   will correctly convert backslashes to forward slashes, assuming that
   100% of the places they are used and when comparing with a list, they
   are intended to be paths and not strict symbols
2024-08-05 15:55:46 -07:00
..
asyncio Merge branch 'execution_model_inversion' of github.com:guill/ComfyUI into pr-execution 2024-07-19 17:49:41 -07:00
distributed Fix AuraFlow 2024-07-15 15:29:49 -07:00
downloader Fixes for tests and completing merge 2024-08-01 18:28:51 -07:00
inference Test improvements and fixes 2024-08-05 15:55:46 -07:00
library Improve automated test coverage 2024-07-05 11:11:21 -07:00
unit Test improvements and fixes 2024-08-05 15:55:46 -07:00
__init__.py Ci quality workflows (#1423) 2023-09-18 23:18:06 -04:00
conftest.py Fixes for tests and completing merge 2024-08-01 18:28:51 -07:00
README.md PyInstaller 2024-01-29 17:02:45 -08:00

Automated Testing

Running tests locally

Additional requirements for running tests:

pip install .[dev]

Run inference tests:

pytest tests/inference

Quality regression test

Compares images in 2 directories to ensure they are the same

  1. Run an inference test to save a directory of "ground truth" images
    pytest tests/inference --output_dir tests/inference/baseline
  1. Make code edits

  2. Run inference and quality comparison tests

pytest