rattus128 653ceab414 Reduce Peak WAN inference VRAM usage - part II (#10062) ... * flux: math: Use _addcmul to avoid expensive VRAM intermediate The rope process can be the VRAM peak and this intermediate for the addition result before releasing the original can OOM. addcmul_ it. * wan: Delete the self attention before cross attention This saves VRAM when the cross attention and FFN are in play as the VRAM peak.		2025-09-27 18:14:16 -04:00
..
audio_encoders	Support the HuMo model. (#9903)	2025-09-17 00:12:48 -04:00
cldm	Replace print with logging (#6138)	2024-12-20 16:24:55 -05:00
comfy_types	LoRA Trainer: LoRA training node in weight adapter scheme (#8446)	2025-06-13 19:25:59 -04:00
extra_samplers	Uni pc sampler now works with audio and video models.	2025-01-18 05:27:58 -05:00
image_encoders	Add Hunyuan 3D 2.1 Support (#8714)	2025-09-04 20:36:20 -04:00
k_diffusion	Fix depending on asserts to raise an exception in BatchedBrownianTree and Flash attn module (#9884)	2025-09-15 20:05:03 -04:00
ldm	Reduce Peak WAN inference VRAM usage - part II (#10062)	2025-09-27 18:14:16 -04:00
sd1_tokenizer	Silence clip tokenizer warning. (#8934)	2025-07-16 14:42:07 -04:00
t2i_adapter	Controlnet refactor.	2024-06-27 18:43:11 -04:00
taesd	Improvements to the TAESD3 implementation.	2024-06-16 02:04:24 -04:00
text_encoders	Don't add template to qwen2.5vl when template is in prompt. (#10043)	2025-09-26 18:34:17 -04:00
weight_adapter	Fix LoRA Trainer bugs with FP8 models. (#9854)	2025-09-20 21:24:48 -04:00
checkpoint_pickle.py	Remove pytorch_lightning dependency.	2023-06-13 10:11:33 -04:00
cli_args.py	Print all fast options in --help (#9737)	2025-09-06 01:05:05 -04:00
clip_config_bigg.json	Fix potential issue with non clip text embeddings.	2024-07-30 14:41:13 -04:00
clip_model.py	USO style reference. (#9677)	2025-09-02 15:36:22 -04:00
clip_vision_config_g.json	Add support for clip g vision model to CLIPVisionLoader.	2023-08-18 11:13:29 -04:00
clip_vision_config_h.json	Add support for unCLIP SD2.x models.	2023-04-01 23:19:15 -04:00
clip_vision_config_vitl_336_llava.json	Support llava clip vision model.	2025-03-06 00:24:43 -05:00
clip_vision_config_vitl_336.json	support clip-vit-large-patch14-336 (#4042)	2024-07-17 13:12:50 -04:00
clip_vision_config_vitl.json	Add support for unCLIP SD2.x models.	2023-04-01 23:19:15 -04:00
clip_vision_siglip_384.json	Support new flux model variants.	2024-11-21 08:38:23 -05:00
clip_vision_siglip_512.json	Support 512 siglip model.	2025-04-05 07:01:01 -04:00
clip_vision.py	Some changes to the previous hunyuan PR. (#9725)	2025-09-04 20:39:02 -04:00
conds.py	Add some warnings and prevent crash when cond devices don't match. (#9169)	2025-08-04 04:20:12 -04:00
context_windows.py	Make step index detection much more robust (#9392)	2025-08-17 18:54:07 -04:00
controlnet.py	Support qwen inpaint controlnet. (#9772)	2025-09-08 17:30:26 -04:00
diffusers_convert.py	Remove useless code.	2025-01-24 06:15:54 -05:00
diffusers_load.py	load_unet -> load_diffusion_model with a model_options argument.	2024-08-12 23:20:57 -04:00
float.py	Clamp output when rounding weight to prevent Nan.	2024-10-19 19:07:10 -04:00
gligen.py	Remove some useless code. (#8812)	2025-07-06 07:07:39 -04:00
hooks.py	Hooks Part 2 - TransformerOptionsHook and AdditionalModelsHook (#6377)	2025-01-11 12:20:23 -05:00
latent_formats.py	Add support for Chroma Radiance (#9682)	2025-09-13 17:58:43 -04:00
lora_convert.py	Implement the USO subject identity lora. (#9674)	2025-09-01 18:54:02 -04:00
lora.py	Support the omnigen2 umo lora. (#9886)	2025-09-15 18:10:55 -04:00
model_base.py	Basic WIP support for the wan animate model. (#9939)	2025-09-19 03:07:17 -04:00
model_detection.py	Basic WIP support for the wan animate model. (#9939)	2025-09-19 03:07:17 -04:00
model_management.py	Fix memory leak by properly detaching model finalizer (#9979)	2025-09-24 22:35:12 -04:00
model_patcher.py	USO style reference. (#9677)	2025-09-02 15:36:22 -04:00
model_sampling.py	Basic initial support for cosmos predict2 text to image 2B and 14B models. (#8517)	2025-06-13 07:05:23 -04:00
ops.py	Fix LoRA Trainer bugs with FP8 models. (#9854)	2025-09-20 21:24:48 -04:00
options.py	Only parse command line args when main.py is called.	2023-09-13 11:38:20 -04:00
patcher_extension.py	Implement EasyCache and Invent LazyCache (#9496)	2025-08-22 22:41:08 -04:00
pixel_space_convert.py	Changes to the previous radiance commit. (#9851)	2025-09-13 18:03:34 -04:00
rmsnorm.py	Add warning when using old pytorch. (#9347)	2025-08-15 00:22:26 -04:00
sample.py	Auto reshape 2d to 3d latent for single image generation on video model.	2024-12-29 02:26:49 -05:00
sampler_helpers.py	Added context window support to core sampling code (#9238)	2025-08-13 21:33:05 -04:00
samplers.py	Add 'input_cond' and 'input_uncond' to the args dictionary passed into sampler_cfg_function (#10044)	2025-09-26 19:55:03 -07:00
sd1_clip_config.json	Fix potential issue with non clip text embeddings.	2024-07-30 14:41:13 -04:00
sd1_clip.py	Disable prompt weights for qwen. (#9438)	2025-08-20 01:08:11 -04:00
sd.py	Changes to the previous radiance commit. (#9851)	2025-09-13 18:03:34 -04:00
sdxl_clip.py	Add a T5TokenizerOptions node to set options for the T5 tokenizer. (#7803)	2025-04-25 19:36:00 -04:00
supported_models_base.py	Mixed precision diffusion models with scaled fp8.	2024-10-21 18:12:51 -04:00
supported_models.py	Lower wan memory estimation value a bit. (#9964)	2025-09-20 22:09:35 -04:00
utils.py	Add WAN ATI support (#8874)	2025-07-24 20:59:19 -04:00