ComfyUI/comfy/ldm
Jedrzej Kosinski fc247150fe
Implement EasyCache and Invent LazyCache (#9496)
* Attempting a universal implementation of EasyCache, starting with flux as test; I screwed up the math a bit, but when I set it just right it works.

* Fixed math to make threshold work as expected, refactored code to use EasyCacheHolder instead of a dict wrapped by object

* Use sigmas from transformer_options instead of timesteps to be compatible with a greater amount of models, make end_percent work

* Make log statement when not skipping useful, preparing for per-cond caching

* Added DIFFUSION_MODEL wrapper around forward function for wan model

* Add subsampling for heuristic inputs

* Add subsampling to output_prev (output_prev_subsampled now)

* Properly consider conds in EasyCache logic

* Created SuperEasyCache to test what happens if caching and reuse is moved outside the scope of conds, added PREDICT_NOISE wrapper to facilitate this test

* Change max reuse_threshold to 3.0

* Mark EasyCache/SuperEasyCache as experimental (beta)

* Make Lumina2 compatible with EasyCache

* Add EasyCache support for Qwen Image

* Fix missing comma, curse you Cursor

* Add EasyCache support to AceStep

* Add EasyCache support to Chroma

* Added EasyCache support to Cosmos Predict t2i

* Make EasyCache not crash with Cosmos Predict ImagToVideo latents, but does not work well at all

* Add EasyCache support to hidream

* Added EasyCache support to hunyuan video

* Added EasyCache support to hunyuan3d

* Added EasyCache support to LTXV (not very good, but does not crash)

* Implemented EasyCache for aura_flow

* Renamed SuperEasyCache to LazyCache, hardcoded subsample_factor to 8 on nodes

* Eatra logging when verbose is true for EasyCache
2025-08-22 22:41:08 -04:00
..
ace Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
audio Fix torch warning about deprecated function. (#8075) 2025-05-12 14:32:01 -04:00
aura Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
cascade Fix stable cascade VAE on some lowvram machines. 2025-03-08 20:24:04 -05:00
chroma Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
cosmos Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
flux Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
genmo Switch mochi and wan modes to use pytorch RMSNorm. (#7925) 2025-05-03 19:07:55 -04:00
hidream Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
hunyuan3d Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
hunyuan_video Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
hydit Change cosmos and hydit models to use the native RMSNorm. (#7934) 2025-05-04 06:26:20 -04:00
lightricks Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
lumina Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
models Don't add tiny bit of random noise when VAE encoding. (#8705) 2025-06-27 14:14:56 -04:00
modules Add elementwise fusions (#9495) 2025-08-22 19:39:15 -04:00
omnigen Omnigen2 model implementation. (#8669) 2025-06-25 19:35:57 -04:00
pixart Remove windows line endings. (#8866) 2025-07-11 02:37:51 -04:00
qwen_image Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
wan Implement EasyCache and Invent LazyCache (#9496) 2025-08-22 22:41:08 -04:00
common_dit.py add RMSNorm to comfy.ops 2025-04-14 18:00:33 -04:00
util.py Fix and enforce new lines at the end of files. 2024-12-30 04:14:59 -05:00